SUMMARY
We are looking for a highly motivated Azure Data engineer to join our dynamic development team. This is an exciting opportunity for an individual who is passionate about working on trending technology and wants to contribute to the growth of our company.
KEY RESPONSIBILITIES
Design, develop, and maintain scalable data pipelines and use Azure Data Factory and Azure Stream Analytics
Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
Implement data governance and security best practices to ensure compliance and data integrity.
Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
Proven experience as a Data Engineer or in a similar role.
Experience in designing and hands-on development in cloud-based (Azure) analytics solutions.
Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Azure App Service, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.
Experience in SQL server and procedures.
Thorough understanding of Azure Infrastructure offerings.
Strong experience in common data warehouse modelling principles including Kimball, Inmon.
Experience in additional Modern Database terminologies.
Working knowledge of Python or Java or Scala is desirable
Strong knowledge of data modeling, ETL processes, and database technologies
Solid understanding of data governance, data security, and data quality best practices.
Strong analytical and problem-solving skills, with attention to detail.
MANDATORY SKILLS
Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Azure App Service, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics
Keyskills: Azure Data Factory Azure Synapse Azure data stream Azure Data Warehouse Azure Databricks Pyspark Azure Data Lake SQL Azure Data Bricks Python
Dev Information Technology Ltd DEV IT Pvt. Ltd, ISO 9001:2000 certified, is actively working in the field of IT Consultancy, Software Development, Implementation and Technology Enabling with headquarters at Ahmedabad, India. Having proven experience after undergoing various learning curves for d...