Lead Data Engineer
- iLink Digital
- 8 - 10 years
- Bengaluru
- 25 days ago
- Email to a friend
- Report this job
Job Description
Requirements
We are seeking a highly experienced Lead Data Engineer to design, develop, optimize, and maintain robust data pipelines for large-scale data processing. The ideal candidate should have deep expertise in Python, Scala, Spark, Kafka, Kubernetes, SQL administration , and database management (Postgres, Redshift). This role requires hands-on experience in CI/CD pipeline creation and maintenance , along with strong problem-solving skills and the ability to lead data engineering initiatives.
Key Responsibilities:
Key Responsibilities:
- Develop & Optimize Data Pipelines u2013 Architect, build, and enhance scalable data pipelines for high-performance processing.
- Troubleshoot & Sustain u2013 Identify, diagnose, and resolve data pipeline issues to ensure operational efficiency.
- Data Architecture & Storage u2013 Design efficient data storage and retrieval strategies using Postgres, Redshift, and other databases.
- CI/CD Pipeline Management u2013 Implement and maintain continuous integration and deployment strategies for smooth workflow automation.
- Scalability & Performance Tuning u2013 Ensure the robustness of data solutions while optimizing performance at scale.
- Collaboration & Leadership u2013 Work closely with cross-functional teams to ensure seamless data flow and lead engineering best practices.
- Security & Reliability u2013 Establish governance protocols and ensure data integrity across all pipelines.
Technical Skills Required:
- Programming: Expert in Python and Scala
- Big Data Technologies: Proficient in Spark, Kafka
- DevOps & Cloud Infrastructure: Strong understanding of Kubernetes
- SQL & Database Management: Skilled in SQL administration, Postgres, Redshift
- CI/CD Implementation: Experience in automating deployment processes for efficient workflow
- Programming: Expert in Python and Scala
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: iLink DigitalLocation(s): Bengaluru+ View Contact
Keyskills: Telecom Cloud computing Automation Data management Healthcare Life sciences Analytics ASP SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
iLink Digital
iLink Digital, a CMMI Level 3 and ISO 9001:2008 Certified Global Software Solution Provider and Systems Integrator, delivers next-generation technology solutions to help clients solve complex business challenges, improve organizational effectiveness, increase business productivity, realize sustainab...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in