Job description
Role: Data Engineer
Experience: 5+ Years
Skill set:
Azure Databricks, Azure Data Factory, Python, SQL and Azure Data Engineer
Roles and Responsibilities:
Should have programming skills with the ability to write optimized and reusable high-quality code.
Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python, SQL.
Optimize SQL queries for efficient data extraction and manipulation.
Demonstrate expertise in Databricks including workflow management and data exploration.
Collaborate with cross functional teams to understand the business requirements.
Implement best practices for data pipelines optimization, ETL, and query performance.
Create and maintain documentations for data pipelines and workflows.
Troubleshoot and resolve issues in data pipelines, ensuring minimal downtime.
Keyskills: Azure Data Factory Azure Databricks Python
Colan Infotech Pvt Ltd Colan Infotech is an IT services company, having an offshore software development office located in India and serving to clients across USA, Canada & UK We are a Nasscom listed & CMMI Level 3 customer-centric technology firm