Azure Data Engineer @ CRG Solutions

Home > Data Science & Machine Learning

Azure Data Engineer

CRG Solutions
5 - 6 years
Pune
6 months ago
Email to a friend
Report this job

Job Description

We are seeking an experienced Azure Data Engineer to join our team. The ideal candidate should have a strong background in designing, implementing, and maintaining data solutions on the Microsoft Azure platform. As a key member of our data engineering team, you will be responsible for developing robust data pipelines, implementing data models, and ensuring the scalability, security, and efficiency of our data solutions.

Roles and Responsibilities

Data Solution Development:

Design, implement, and manage end-to-end data pipelines and ETL processes on Azure.
Develop and deploy data storage solutions, including Azure SQL Database, Data Lake Storage, Blob Storage, and Cosmos DB.

Azure Data Services:

Utilize Azure Data Factory to orchestrate and automate data workflows and transformations.
Implement and manage Azure Databricks for data exploration, analytics, and machine learning tasks.
Configure and optimize Azure Synapse Analytics for scalable analytics and data warehousing.

Data Modeling and Optimization:

Develop and maintain data models and schemas, ensuring data integrity and performance.
Optimize data storage, indexing, and partitioning strategies for improved query performance.

Data Integration and Streaming:

Implement real-time and batch data integration using Azure Stream Analytics, Event Hubs, or Kafka on Azure.
Build data pipelines for ingesting, processing, and analyzing streaming data.

Security and Compliance:

Implement data security measures, including encryption, access control, and compliance with industry standards (e.g., GDPR, HIPAA).
Monitor and manage data governance, ensuring data quality and compliance across platforms.

Monitoring and Troubleshooting:

Monitor data pipelines and infrastructure for performance issues, bottlenecks, and errors.
Troubleshoot and resolve data-related issues, ensuring high availability and reliability of data
solutions.

Collaboration and Documentation:

Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
Create and maintain comprehensive documentation for data architectures, processes, and
workflows.

Qualifications

Bachelor s degree in Computer Science, Engineering, or related field.
5-6 years of experience in data engineering with a focus on Microsoft Azure services.
Strong expertise in Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Proficiency in programming languages like Python, SQL, Pyspark or Scala for data manipulation and transformation.
Experience with data modeling, database design, and optimization.
Familiarity with data streaming technologies and real-time analytics.
Strong problem-solving skills and the ability to troubleshoot complex data issues.

Job Classification

Industry: Analytics / KPO / Research
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: CRG Solutions
Location(s): Pune

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: Computer science Compliance Data modeling Database design Machine learning Troubleshooting Analytics Monitoring SQL Python

Job seems aged, it may have been expired!
Fraud Alert to job seekers!

₹ Not Disclosed

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Similar positions

S&c Global Network - Ai - Cdi - Data Science Manager

Accenture

10 - 15 years

Mumbai

7 hours ago

₹ Not Disclosed

Vice President - Data Science, Applied AI & ML

JPMorgan Chase Bank

12 - 15 years

Hyderabad

10 hours ago

₹ Not Disclosed

Assistant Vice President - Data Science, Applied Ai & Ml

JPMorgan Chase Bank

10 - 15 years

Hyderabad

11 hours ago

₹ Not Disclosed

Data Science Senior Manager - HIH - Evernorth

ManipalCigna Health

13 - 16 years

Hyderabad

20 hours ago

₹ Not Disclosed

CRG Solutions

CRG Solutions is a Business Performance Improvement company, helping organizations traverse their Data to Insights journey and beyond. It leverages curated Analytics Technology such as Tableau & Alteryx. It is one of Tableau's longest standing Gold Partners with vast experience in Visual Analyti...

Azure Data Engineer @ CRG Solutions

Home > Data Science & Machine Learning