Lead Data Engineer
- Incedo
- 7 - 11 years
- Hyderabad
- 2 months ago
- Email to a friend
- Report this job
Job Description
Data Engineer Big Data
Incedo is a US-based consulting, data science and technology services firm with over 2,000 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities is also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.
Role Description: Data Engineer Big Data
The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning.
Designation:
Sr Developer : 7.6 Years 11 YearsRole and responsibilities
- Strong technical, analytical, and problem-solving skills
- Strong organizational skills, with the ability to work autonomously as well as in a team-based environment
- Data pipeline framework development
Technical skills requirements
The candidate must demonstrate proficiency in,
- CDH On-premise for data processing and extraction
- Ability to own and deliver on large, multi-faceted projects
- Fluency in complex SQL and experience with RDBMSs
- Project Experience in CDH experience, Spark, PySpark, Scala, Python, NiFi, Hive, NoSql DBs)
- Experience designing and building big data pipelines
- Experience working on large scale, distributed systems
- Experience working on any Databricks would be added advantage
- Strong hands-on experience of programming language like PySpark, Scala with Spark, Python.
- Exposure to various ETL and Business Intelligence tools
- Experience in shell scripting to automate pipeline execution.
- Solid grounding in Agile methodologies
- Experience with git and other source control systems
- Strong communication and presentation skills
Nice-to-have skills
- Certification in Hadoop/Big Data Hortonworks/Cloudera
- Databricks Spark certification
- Unix or Shell scripting
- Strong delivery background across the delivery of high-value, business-facing technical projects in major organizations
- Experience of managing client delivery teams, ideally coming from a Data Engineering / Data Science environment
Qualifications
- B.Tech./M.Tech./MS or BCA/MCA degree from a reputed university
We are an Equal Opportunity Employer
We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: IncedoLocation(s): Hyderabad
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in