Data Engineering - Lead
- Omnicom Media Group
- 4 - 6 years
- Bengaluru
- 3 months ago
- Email to a friend
- Report this job
Job Description
Position Overview
Annalect is currently seeking a data engineering lead to join our technology team. In this role you will be building data pipelines and developing data set processes. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will lead teams working on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. You will also help us drive the vision forward for data engineering projects by helping us extend and improve standards, and by building high performing, collaborative, enthusiastic teams.
Key Responsibilities:
- Evaluating architectural designs, technical tradeoffs, and solutions to problems to guide teams to deliver sustainable data and compute environments to facilitate usage of data assets.
- Coaching engineers to improve their technical and soft skills.
- Align teams with Annalects technical standards.
- Ensure compliance with critical security requirements.
- Leading collaboration with product and design to ensure delivery deadlines are met.
- Design, build, test and deploy scalable and reusable systems that handle large amounts of data
Required Skills
- 6+ Experience designing and managing data flows
- Experience designing systems and APIs to integrate data into applications
- 8+ years of Linux, Bash, Python, and SQL experience
- 6+ years using Spark or Hadoop ecosystem software
- 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift
- 6+ years managing team of developers
- Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges
Additional Skills
- Educational attainment of a degree in Computer Science or Engineering or comparable professional experience.
- Understanding and experience with Agile methodologies and their application to teams.
- Experience working with global teams and managing offshore resources.
- Experience managing external vendors and evaluating and integrating third-party solutions.
Job Classification
Industry: Film / Music / EntertainmentFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Omnicom Media GroupLocation(s): Bengaluru
Keyskills: hive software design development glue scala amazon redshift pyspark apache pig emr data pipeline sql cloud spark aws cloud linux flume hadoop big data hbase agile methodology python cloud services oozie impala data engineering mapreduce kafka hdfs bash athena sqoop aws data flow
Similar positions
Omnicom Media Group
At Annalect, we work with clients to develop data driven marketing strategies, powered by a connected system of technology, tools, consultants and digital activation. Drawing from the vast resources of our parent company Omnicom and spanning the globe in a variety of industry verticals, we are the d...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in