Data Engineering Manager
- Net Connect
- 12 - 17 years
- Bengaluru
- 27 days ago
- Email to a friend
- Report this job
Job Description
Key Responsibilities
- Lead and mentor a team of data engineers to ensure effective implementation of data solutions.
- Oversee data integration processes and ensure data quality and accuracy.
- Work collaboratively with cross-functional teams to identify and prioritize data needs.
- Design and implement data models and databases that meet company needs.
- Manage pipeline operations and optimize data processes.
- Continuously assess and improve data architectures and engineering practices.
- Serve as the primary point of contact for data engineering projects and initiatives.
- Support strategic decision-making by providing insights from complex data analysis.
- Minimum 5 years of relevant experience for 10 12 years of total experience (Architect/Managerial level).
- Minimum 5 years of relevant experience for 6 9 years of total experience (Developer/SA/SC level).
- Deep expertise in Data Factory, Data Bricks, SQLDB (complex Stored Procedures), Synapse, Python, and PySpark scripting.
- Mandatory certification: DP-203 Azure Data Engineer Associate.
- Certified Databricks Data Engineer Associate for Developer roles; Professional certification for Architect/Managerial roles.
- Proficiency in Data Factory, Data Bricks, SQLDB, Synapse, and Azure Analysis Services.
- Advanced skills in Python and PySpark scripting.
- Strong problem-solving and debugging capabilities.
- Expertise with GITHUB and Azure DevOps.
- Experience in creating complex PySpark queries for analysis.
- Strong troubleshooting and debugging skills.
- Proven experience with source control technologies (GITHUB, Azure DevOps), build and release pipelines.
- Experience in writing complex PySpark queries for data analysis.
- Good to have certifications in Apache Spark 3.0.
- Familiarity with visualization tools such as Power BI and Tableau.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Net ConnectLocation(s): Bengaluru+ View Contact
Keyskills: Data Engineering Data Factory Synapse Azure Analysis GITHUB SQLDB Data Bricks Azure DevOps
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Net Connect
NCG began its journey in 1997 with a small team driven by huge dreams. Nearly three decades later, our passion, pioneering spirit and purpose remains unchanged. We're just getting started!
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in