Data Lead Engineer - Big Data/hadoop
- Squareroot
- 6 - 11 yrs
- Bengaluru
- 6 years ago
- Email to a friend
- Report this job
Desired Candidate Profile
Job description - Data Lead EngineerWhom will you work with?
- Product Development team is charted to develop configurable classified products and E-commerce marketplace with an exceptional performance. Our current KPI's are 560m page views a month | 6m unique visitors a month | 600K new ads every month | 100% growth year on year | No. 1 local for 3 local country markets and you will get to be part of the 10X growth in next few years
- We are looking for an experienced Data engineer to join our team and help build analytics infrastructure which supports the e-commerce application that millions of people use every day and provides greater insights for management, marketing and local teams. You will play an important role in our data engineering practice, creating the infrastructure, integrating with 3rd party libraries, developing the analytics platform and also in data science implementation for automating manual processes and providing recommendations.
Skills :
- You've 7+ years of years of experience in a professional environment performing analysis, design and development tasks in distributed systems preferably in an eCommerce Domain
- You've built large-scale data pipelines which process millions of events per day and has experience in Java and SQL.
- Understanding of data flows, data architecture, ETL and processing of structured and unstructured data
- In-depth knowledge of Big Data distributions preferably with experience in messaging systems such as Kafka / Kinesis and stream processing systems such as Storm, Spark, Flume and cloud-based Columnar Data stores such as Amazon Redshift.
- You have good experience in AWS infrastructure
- You have good exposure to microservices architecture preferably with Thrift services.
- You possess strong computer science fundamentals: data structures, algorithms, programming languages, distributed systems, and information retrieval. Familiar with data mining concepts and machine learning algorithms.
- Experience with Data Warehouse design, Business Intelligence and reporting tools a plus
- Experience with MongoDB, Elasticsearch is desirable
- You are a strong communicator. Explaining complex technical concepts to product managers, support, and other engineers is no problem for you.
- You are someone that others enjoy working with due to your technical competence and positive attitude.
What you'll do :
- Responsible for developing, coding, testing and debugging solution related to our Data solutions
- Develop, enhance and maintain the data pipeline - ingestion, transformation, storage, analysis and visualization using combination of open source and paid technology tools.
- Automating data solutions for reporting KPI, trends, etc
So you think you can ask bold questions, challenge conventional wisdom, value data and can think outside the box? Then here is the place for you to live your passion for technology!
Education:
UG: Any Graduate - Any Specialization
PG: Any Postgraduate - Any Specialization
Doctorate: Doctorate Not Required
Contact Details:
+ View Contact
Keyskills: Information Retrieval Java Algorithms Hadoop Data Science Spark SQL Machine Learning Flume Data Mining
Fraud Alert to job seekers!
₹ Not Disclosed
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in