Design, develop, and maintain data pipelines and ETL processes using PySpark or Scala. Work extensively with Python to build scalable data solutions. Develop and manage data workflows in Azure Data Factory (ADF). Implement and optimize data solutions on cloud platforms such as Azure or AWS. Ensure data integrity, performance, and security across data pipelines. Collaborate with data scientists, analysts, and other stakeholders to support business needs. Lead and mentor a team of junior data engineers (if applicable). Requirements 3 to 10 years of experience in data engineering or related roles. Strong hands-on experience with PySpark or Scala. Proficiency in Python for data processing and automation. Experience working with Azure Data Factory (ADF). Hands-on experience with cloud platforms (Azure or AWS). Strong understanding of ETL processes, data warehousing, and big data technologies. Experience in leading a team is a plus.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Data Engineer Job in InFynd at Coimbatore