Azure Data Engineer
- Pi Techniques
- 3 - 8 years
- Mumbai
- 3 months ago
- Email to a friend
- Report this job
Job Description
Responsibilities
Data Modelling Design and implement data models including measures and dimensions to support business intelligence and analytical reporting requirements
Azure Data Factory Development Create manage and optimize data pipelines in Azure Data Factory to extract transform and load ETL data from various sources into the data warehouse
Dimensional Modelling Develop and implement dimensional models for data warehousing ensuring efficient storage and retrieval of data for analytical purposes
ETL Processes Build and maintain ETL processes within Azure Data Factory to transform and cleanse data before loading it into the data warehouse
Integration with Analytics Services Collaborate with data scientists and analysts to integrate Azure Data Factory with analytics services such as Azure Synapse Analytics Azure Databricks and Power BI
Data Quality and Governance Implement data quality checks and governance measures to ensure the accuracy completeness and consistency of data stored in the data warehouse
Performance Tuning Monitor and optimize data warehouse performance including query performance and data loading processes to meet performance and scalability requirements
Security and Compliance Implement security measures for data access and ensure compliance with data governance policies and regulatory requirements
Documentation Create and maintain documentation for data models ETL processes and data warehouse configurations
Collaboration Work closely with business analysts data scientists and other stakeholders to understand reporting requirements and deliver effective data solutions
Qualifications
Bachelor s degree in computer science Information Technology or a related field
Strong experience with Azure Data Factory Azure Synapse Analytics and other Azure data services
Proficiency in SQL and data querying languages
Expertise in dimensional modeling and data warehousing concepts
Handson experience with ETL processes and tools
Familiarity with analytics and reporting tools such as Power BI
Knowledge of cloud computing concepts and services especially within the Microsoft Azure ecosystem
Strong problemsolving and troubleshooting skills
Certifications such as Microsoft Certified Azure Data Engineer Associate are a plus
Preferred Skills
MongoDB certification eg MongoDB Certified Database Administrator
Experience with MongoDB databases Minimum of 3 years experience as DBA
Experience with other NoSQL DB eg CosmoDB DynamoDB Cassandra etc
Familiarity with containerization technologies eg Docker Kubernetes
Data Modelling Design and implement data models including measures and dimensions to support business intelligence and analytical reporting requirements
Azure Data Factory Development Create manage and optimize data pipelines in Azure Data Factory to extract transform and load ETL data from various sources into the data warehouse
Dimensional Modelling Develop and implement dimensional models for data warehousing ensuring efficient storage and retrieval of data for analytical purposes
ETL Processes Build and maintain ETL processes within Azure Data Factory to transform and cleanse data before loading it into the data warehouse
Integration with Analytics Services Collaborate with data scientists and analysts to integrate Azure Data Factory with analytics services such as Azure Synapse Analytics Azure Databricks and Power BI
Data Quality and Governance Implement data quality checks and governance measures to ensure the accuracy completeness and consistency of data stored in the data warehouse
Performance Tuning Monitor and optimize data warehouse performance including query performance and data loading processes to meet performance and scalability requirements
Security and Compliance Implement security measures for data access and ensure compliance with data governance policies and regulatory requirements
Documentation Create and maintain documentation for data models ETL processes and data warehouse configurations
Collaboration Work closely with business analysts data scientists and other stakeholders to understand reporting requirements and deliver effective data solutions
Bachelor s degree in computer science Information Technology or a related field
Strong experience with Azure Data Factory Azure Synapse Analytics and other Azure data services
Proficiency in SQL and data querying languages
Expertise in dimensional modeling and data warehousing concepts
Handson experience with ETL processes and tools
Familiarity with analytics and reporting tools such as Power BI
Knowledge of cloud computing concepts and services especially within the Microsoft Azure ecosystem
Strong problemsolving and troubleshooting skills
Certifications such as Microsoft Certified Azure Data Engineer Associate are a plus
MongoDB certification eg MongoDB Certified Database Administrator
Experience with MongoDB databases Minimum of 3 years experience as DBA
Experience with other NoSQL DB eg CosmoDB DynamoDB Cassandra etc
Familiarity with containerization technologies eg Docker Kubernetes
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Pi TechniquesLocation(s): Mumbai
Keyskills: Computer science Performance tuning Cloud computing Analytical Data quality Business intelligence Troubleshooting Information technology Analytics SQL
Similar positions
Pi Techniques
Established in 1992, Pi Techniques started as a small support services company to cater to individuals and home offices. We have now grown to have multiple divisions and have serviced over 300 clients. At Pi Techniques its always keep it simple thats how we manage to keep our large client base delig...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in