Job Title: Azure Data Engineer
Experience:5+Years
Main location: Bangalore
Employment Type: Full Time
Position Description
Strong experience in Azure Functions, Azure Data Factory, Azure Sql, Azure Key Vault
Strong Experience in Azure Data Bricks, Notebooks, ADLS, Delta Lake
Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL
Proficient in integrating, transforming, and consolidating data from various structured and unstructured data.
Knowledge on Autosys jobs, Batch scripts
Hands on experience in using Agile methodology, Azure DevOps(CI/CD Pipeline)
Knowledge on Streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI
Knowledge on Ability to work independently as well as in a team
Roles & Responsibilities:
Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage.
Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses
Implement business solution using Azure DataBricks.
Align with DevOps strategy to promote the code to Production.
Think out of the solution to create reusable Databricks components
Should have working experience in migration and modernization projects
Involve in due diligence phases to transform the requirements to implementation
Good communication skills
Behavioural Competencies :
Keyskills: Azure Data Factory Pyspark Azure Databricks Azure Data Lake