Data Engineer @ Sourcefuse

We are seeking a proficient Data Engineer with expertise in AWS Glue to join our team. The role involves designing, implementing, and maintaining scalable data pipelines and ETL processes using AWS Glue. The ideal candidate will collaborate closely with data scientists and analysts to ensure efficient data integration and support various data-driven initiatives.

• Design, implement, and maintain scalable data pipelines and ETL processes using AWS Glue

• Develop and optimize data transformations to support business analytics and reporting requirements

• Collaborate with data scientists and analysts to integrate data sources and support data architecture needs

• Ensure data quality and integrity throughout the data pipeline using AWS Glue

• Implement best practices for data governance, security, and compliance

• Troubleshoot and optimize performance issues with AWS Glue jobs and data workflows

• Document data engineering processes, pipelines, and configurations

• Stay updated with AWS Glue features and advancements to enhance data engineering capabilities

• Bachelor s degree in Computer Science, Engineering, or a related field

• Proven experience as a Data Engineer with hands-on experience in AWS Glue

• Strong proficiency in SQL and scripting languages (e.g., Python, Scala) for data transformation and ETL processes

• Experience with AWS services, particularly AWS Glue, S3, and Redshift

• Knowledge of data warehousing concepts and architectures

• Familiarity with big data technologies such as Apache Spark

• Understanding of data modeling, segmentation, and data governance practices

• Excellent problem-solving and analytical skills

• Strong communication and collaboration abilities

• Ability to work independently and in a team environment

• AWS Glue

• SQL and scripting languages (Python, Scala)

• ETL frameworks and processes

• Data governance and compliance

• Big data technologies (Apache Spark)

• Assessment

• Technical Interview Round 1

• Technical Interview Round 2