Lead Data Engineer - Mumbai
- Adept Global
- 9 to 14 Yrs
- Mumbai
- 5 years ago
- Email to a friend
- Report this job
Job Description
Job Description:
Experience: 8+ years
Location: Andheri (E), Mumbai
Designation: Lead Data Engineer
Minimum Qualifications:
- Previous experience in data engineering
- Familiar with more modern data engineering pipelines and how they all fit together. Experience with
- integration of data from multiple data sources
- Able to articulate needs on both sides easily. Can talk with backend and data science peopleboth with ease
- Data Engineer will work directly with the backend engineering team.
- Proficiency with REST APIs, Cassandra, Python, MongoDB, Postgres, and querying.
- Proficiency with both relational and non-relational databasesand how to combine them
- Proficiency with distributed computing engines, frameworks like Hadoop v2, Spark
- Experience with building stream-processing systems, (e.g., using solutions such as Spark-Streaming or Storm)
- Ability to manage Hadoop/Spark cluster or other ingestion tools, with all included services
- Previous Experience with various messaging systems, such as Kafka or Amazon Kinesis (for example)
- Coding Experience with any of the programming languages - Python, Java, Scala
- Excellent communication skills
- Willingness to document work in a wiki and track work through an issue tracking system
- 5+ years of data engineering experience
- BS in Computer Science or a related field and relevant experience
- Preferred Qualifications:
- Previous start-up experience
- Machine Learning experience or learning different ML techniques (for bigger data sets)
- Experience with AWS cloud platform and services
- Ability to solve any ongoing issues with operating the cluster/data pipelines
Software development methodologies skills such as:
o experience with a source control system
o experience with an issue tracking system
o preliminary testing and verification
o experience with the design and development life-cycle
o knowledge of debugging and problem-solving methodology, particularly as reported against Production software
- Have worked on shipping product
- Knowledge with Data Structures(e.g., queues, arrays, maps)
- Additional skills that add value to our company (technical or domain)
- A passion for our product space and a desire to improve the lives of others
Interested candidates can send in their updated resume to na****a@ad************g.in
Employement Category:
Employement Type: Full timeIndustry: IT - SoftwareRole Category: DBA / DatawarehousingFunctional Area: Not ApplicableRole/Responsibilies: Lead Data Engineer - MumbaiContact Details:
Company: Adept GlobalLocation(s): Mumbai+ View Contact
Fraud Alert to job seekers!
₹ 8 - 18 Lakh/Yr
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in