Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Specialist - Data Engineering @ Apptad

Home > Data Science & Machine Learning

 Specialist - Data Engineering

Job Description

We are looking for a skilled Data Engineer with 3 to 6 years of experience in processing data pipelines using Databricks, PySpark, and SQL on Cloud distributions like AWS. The ideal candidate should have hands-on experience with Databricks, Spark, SQL, and AWS Cloud platform, especially S3, EMR, Databricks, Cloudera, etc.Roles and Responsibility
  • Design and develop large-scale data pipelines using Databricks, Spark, and SQL.
  • Optimize data operations using Databricks and Python.
  • Develop solutions to meet business needs reflecting a clear understanding of the objectives, practices, and procedures of the corporation, department, and business unit.
  • Evaluate alternative risks and solutions before taking action.
  • Utilize all available resources efficiently.
  • Collaborate with cross-functional teams to achieve business goals.
  • Job
  • Experience working in projects involving data engineering and processing.
  • Proficiency in large-scale data operations using Databricks and overall comfort with Python.
  • Familiarity with AWS compute, storage, and IAM concepts.
  • Experience with S3 Data Lake as the storage tier.
  • ETL background with Talend or AWS Glue is a plus.
  • Cloud Warehouse experience with Snowflake is a huge plus.
  • Strong analytical and problem-solving skills.
  • Relevant experience with ETL methods and retrieving data from dimensional data models and data warehouses.
  • Strong experience with relational databases and data access methods, especially SQL.
  • Excellent collaboration and cross-functional leadership skills.
  • Excellent communication skills, both written and verbal.
  • Ability to manage multiple initiatives and priorities in a fast-paced, collaborative environment.
  • Ability to leverage data assets to respond to complex questions that require timely answers.
  • Working knowledge of migrating relational and dimensional databases on AWS Cloud platform.
  • Job Classification

    Industry: Recruitment / Staffing
    Functional Area / Department: Data Science & Analytics
    Role Category: Data Science & Machine Learning
    Role: Data Engineer
    Employement Type: Full time

    Contact Details:

    Company: Apptad
    Location(s): Bengaluru

    + View Contactajax loader


    Keyskills:   sql spark python relational databases aws cloudera hive scala pyspark data warehousing emr azure data factory plsql aws cloud hadoop etl big data data lake snowflake talend microsoft azure warehouse data engineering aws glue data bricks sqoop

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    Data Science Manager, gTech Ads Solutions

    • Google
    • 2 - 4 years
    • Bengaluru
    • 5 hours ago
    ₹ Not Disclosed

    Associate Data Scientist

    • Optum
    • 1 - 3 years
    • Noida, Gurugram
    • 10 hours ago
    ₹ -14 Lacs P.A.

    Sr Data Science Engineer

    • Amgen
    • 5 - 9 years
    • Hyderabad
    • 12 hours ago
    ₹ Not Disclosed

    Sr Data Science Engineer

    • Amgen
    • 5 - 9 years
    • Hyderabad
    • 15 hours ago
    ₹ Not Disclosed

    Apptad

    .https://apptad.com/