As a Data Engineer, you will work with Apache Spark, Airflow, Java/Scala, Google Cloud Storage (GCS), Apache Hudi, and BigQuery to develop and maintain scalable data pipelines. You will play a key role in shaping data architecture, processing frameworks, and governance strategies to ensure efficient and secure data operations.
What youll do:
We are looking for a seasoned and energetic staff engineer who can drive the development of the platform working with a group of high energy engineers, other architects, product managers and report to leadership team. This role requires to be technically strong and be able to drive the development in a fast paced environment. The candidate is expected to work with global teams, provide thought leadership, understand the business context and help provide right solutions, work with product and program managers to plan the releases, participate in sprint planning and handle deployments to production.
What youll bring:
4+ years of Data engineering experience
You have consistently high standards, your passion for quality is inherent in everything
Well versed with Hive, Spark , Kubernetes, Cloud, API and Data Lake concepts .
You evangelize an extremely high standard of code quality, system reliability, and performance
You have a proven track record coding with at least one programming language (e.g., Java, Python)
You re experienced in computing platforms (e.g., GCP, Azure)
You re skilled in data modelling & data migration protocols
Experience with Kafka connect, , Big Query and Looker is added advantage.
Experience with the integration tools like Automic, Airflow
Job Classification
Industry: RetailFunctional Area / Department: Engineering - Software & QA, Role Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full time