Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Engineer - Data Engg & AI @ anblicks

Home > Software Development

 Lead Engineer - Data Engg & AI

Job Description

Job Summary:
Lead Data Engineer to design, develop, and maintain data pipelines and ETL workflows for processing large-scale structured/unstructured data. The ideal candidate will have expertise in AWS Data Services (S3, Workflows, Databricks, SQL) along with big data processing, real-time analytics, and cloud data integration and Team Leading Experience.
Key Responsibilities:
  • Redesign optimized and scalable ETL using Spark, Python, SQL, UDF.
  • Implement ETL/ELT databricks workflows for structured data processing.
  • Quickly able to analyze the issues.
  • Create Data quality check using Unity Catalog.
  • Create DataStream in Adverity.
  • Drive daily status call and sprint planning meeting.
  • Ensure security, quality, and compliance of data pipelines.
  • Contribute to CI/CD integration, observability, and documentation.
  • Collaborate with data architects and analysts to meet business requirements.
Qualifications:
  • 8+ years of experience in data engineering; 2+ years working on AWS services.
  • Hands-on with tools like S3, Databricks, or Workflows.
  • Good to have knowledge in Adverity.
  • Good to have experience in any ticketing tool like Asana or JIRA.
  • Good to have experience Data Analyzing.
  • Strong SQL and data processing skills (e.g., PySpark, Python).
  • Experience with data cataloging, lineage, and governance frameworks.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: anblicks
Location(s): Ahmedabad

+ View Contactajax loader


Keyskills:   Ticketing Data analysis UDF Data processing Data quality JIRA AWS Analytics SQL Python

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Senior Software Engineer

  • Customerxps Software
  • 4 - 9 years
  • Mumbai
  • 1 day ago
₹ Not Disclosed

Software Engineer

  • Customerxps Software
  • 2 - 7 years
  • Mumbai
  • 1 day ago
₹ Not Disclosed

Software Engineer

  • Ford
  • 3 - 8 years
  • Chennai
  • 2 days ago
₹ Not Disclosed

Associate Consultant - Product Development

  • Yodlee
  • 9 - 14 years
  • Thiruvananthapuram
  • 3 days ago
₹ Not Disclosed

anblicks

Anblicks, a team of specialists in strategic dUnlock the full potential of your data with Anblicks, a team of strategic data modernization experts. Our tailored services cover seamless data migration, robust re-architecture, and transformative solutions. The AIM Framework from Anblicks, encompa...