Job Description
Job Role: Lead - Data Engineer
Location: Bangalore, Mumbai, Chennai, Hyderabad, Pune
Work Mode: Hybrid
Shift: 4 pm - 1.30 am (cab drop)
Experience: 7+ to 12 years - (Technical Lead),
Skill: Snowflake, ADF (Azure Data Factory), migration, technical lead/team handling (good to have)
Job Overview:
The Lead Data Engineer will implement monitoring solutions, optimize ETL jobs for performance, and provide comprehensive support from data ingestion, migration and to final output
Role & responsibilities:
- Lead the design, development, and maintenance of a scalable Snowflake data solution serving our enterprise data & analytics team.
- Architect and implement data pipelines, ETL/ELT workflows, and data warehouse solutions using Snowflake and related technologies.
- Design and implement data pipelines for ingesting data from various sources (databases, cloud storage, streaming platforms) into Snowflake.
- Deep understanding of Snowflake's architecture, features, and best practices.
- Implement data transformations using ADF and quality checks within the pipelines & Experience around migrating SSIS job to ADF.
- Experience in various Ingestion methods in Snowflake (Copy, Snowpipe, Dynamic tables, streams and tasks)
- Deep understanding about EDW Concepts, CDC Mechanisms, Dimensional Modelling concepts
- Optimize and maintain Snowflake data warehouse and query performance.
- Integrate Snowflake with various data sources and third-party tools.
- Collaborate with cross-functional teams to define and implement data solutions.
- Provide technical leadership and mentorship to junior and mid-level data engineers.
Preferred candidate profile
- Experience in implementing CI/CD pipelines for Snowflake using Azure DevOps.
- 7+ years of experience in-depth data engineering, with at least 3+ minimum years of dedicated experience engineering solutions in a Snowflake environment
- Proficiency in SQL and Python or other scripting languages.
- Strong experience with cloud platforms (preference to Azure) and their data services
- Proficiency in ETL/ELT development using tools such as Azure Data Factory
- Experience in Data Migration to Cloud.
- Knowledge of data security best practices and relevant regulations.
- Snowpro Core Certified
- Those serving notice/Immediate joiner highly preferred
Job Classification
Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Analytics - Other
Role: Data Science & Analytics - Other
Employement Type: Full time
Contact Details:
Company: Citiustech
Location(s): Pune
Keyskills:
Azure Data Factory
Snowflake
adf
migration