Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Azure Data Engineer @ Merit Data

Home > Data Science & Analytics - Other

 Azure Data Engineer

Job Description

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and analytics solutions on the Microsoft Azure cloud platform. The ideal candidate will have strong expertise in Azure Data Factory, Databricks, Data Lakes, PySpark, Python, Azure Synapse, and SQL, along with a solid understanding of data modeling, ETL/ELT processes, and big data technologies.


Responsibilities

  • Design, develop, and deploy data pipelines using Azure Data Factory and Azure Databricks.
  • Implement and optimize Delta Lake and Azure Data Lake Storage (Gen2) solutions for structured and unstructured data.
  • Develop and maintain PySpark scripts for data processing, transformation, and analytics.
  • Build and manage Azure Synapse Analytics workspaces, SQL pools, and serverless SQL queries.
  • Optimize SQL queries, stored procedures, and data models for performance and scalability.
  • Collaborate with data scientists, analysts, and business teams to ensure data solutions meet business requirements.
  • Implement data security, governance, and compliance best practices in Azure.
  • Monitor, troubleshoot, and enhance data pipelines for reliability and efficiency.
  • Automate data workflows using Python scripting and CI/CD pipelines (Azure DevOps/GitHub Actions).
  • Stay updated with the latest Azure data services and recommend improvements to existing architectures.

Qualifications

  • 5-8 years of hands-on experience in Azure data engineering with a strong focus on:
  • Azure Data Factory (ADF) Pipeline orchestration, triggers, and integration.
  • Azure Databricks Spark jobs, Delta Lake, and notebook development.
  • Azure Data Lake Storage (ADLS Gen2) Data partitioning, access control, and optimization.
  • PySpark C Python Data processing, transformations, and automation.
  • Azure Synapse Analytics Dedicated SQL pools, serverless queries, and Synapse Pipelines.
  • SQL C T-SQL Query optimization, stored procedures, and data modeling.
  • Experience with data warehousing, ETL/ELT frameworks, and big data processing.
  • Familiarity with Azure DevOps, Git, and CI/CD for data pipeline deployments.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Analytics - Other
Role: Data Science & Analytics - Other
Employement Type: Full time

Contact Details:

Company: Merit Data
Location(s): Mumbai

+ View Contactajax loader


Keyskills:   Azure Data Factory Pyspark Data Bricks Azure Databricks SQL

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Data Engineering Specialist

  • Sanofi
  • 7 - 11 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Data Analyst

  • Fiserv
  • 3 - 5 years
  • Mumbai
  • 3 days ago
₹ Not Disclosed

S&c Gn - Data&ai - Hi Tech - Data Science - Consultant

  • Accenture
  • 3 - 7 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Data Specialist - Research

  • Amgen Inc
  • 9 - 13 years
  • Hyderabad
  • 3 days ago
₹ Not Disclosed

Merit Data

We build DATA + CODE for some of the worlds leading B2B brands. Through pioneering marketing data, product data,customised software and marketing automation, Merit helps brands of all sizes confidently embrace the challenges ofthe future.