As an Azure Data Engineer, you will be expected to design, implement, and manage data solutions
on the Microsoft Azure cloud platform. The ideal candidate will have a proven track record of writing.
complex SQL stored procedures with implementing OTLP database solutions (using Microsoft SQL
Server). As well as experience with Azure Synapse / PySpark / Azure Databricks for big data
processing.
Key Responsibilities:
Collaborate with cross-functional teams to gather, analyze, and document business
requirements for data integration projects.
Expertise in T-SQL, Dynamic SQL, Spark SQL, and ability to write complex stored
procedures.
Write complex stored procedures to support data transformation and to implement
business validation logic.
Experience in writing notebooks in Azure Synapse/Databricks using Spark SQL or PySpark to
process and analyse large volumes of data
Develop and maintain robust data pipelines using Azure Data Factory ensuring seamless
data flow between systems.
Strong algorithmic programming skills
Work closely with the team to ensure data quality, integrity, and accuracy across all
systems.
Experience on OLTP (Online Transaction Processing) systems using SQL Server and
contribute to their enhancement and optimization.
Qualifications:
Bachelor s degree in Computer Science, Information Technology, or a related field.
Hands-on experience in writing complex T-SQL queries and stored procedures
Good experience in data integration and database development.
Proficiency in T-SQL and Spark SQL/PySpark. (Synapse/ Databricks)
Extensive experience with Azure Data Factory
Excellent problem-solving skills and attention to detail
Keyskills: Data processing WPA microsoft azure Data quality Stored procedures Transaction processing OLTP Information technology