Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Databricks Engineer @ Diverse Lynx

Home > Software Development

 Databricks Engineer

Job Description

  • Design and build scalable data pipelines and ETL/ELT workflows using Azure Databricks (Apache Spark).
  • Collaborate with data architects and analysts to transform business requirements into technical solutions.
  • Optimize and maintain data processing performance, including tuning Spark jobs and managing clusters.
  • Integrate data from various structured and unstructured sources (Azure Data Lake, Blob Storage, SQL DB, etc).
  • Implement best practices for code versioning, CI/CD pipelines, and data security.
  • Work with Azure services such as Data Factory, Data Lake, Synapse Analytics, and Event Hubs.
  • Troubleshoot data pipeline issues and provide production support as needed.
  • Develop notebooks in Python/Scala/SQL for data processing and analytics.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Platform Engineer
Employement Type: Full time

Contact Details:

Company: Diverse Lynx
Location(s): Hyderabad

+ View Contactajax loader


Keyskills:   Production support data security spark SCALA Data processing Management Troubleshooting Analytics SQL Python

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

System Development Engineer

  • Amazon
  • 0 - 5 years
  • Hyderabad
  • 13 hours ago
₹ Not Disclosed

Software Engineer

  • Orange Business
  • 3 - 8 years
  • Noida, Gurugram
  • 15 hours ago
₹ Not Disclosed

AEM & Edge Delivery Engineer

  • Capgemini
  • 3 - 7 years
  • Mumbai
  • 21 hours ago
₹ Not Disclosed

Software Development Engineer II, Geospatial

  • Amazon
  • 3 - 8 years
  • Hyderabad
  • 1 day ago
₹ Not Disclosed

Diverse Lynx

Diverse Lynx is your Go to Place for all IT needs. We combine industry leading expertise and our personal dedication for all your needs. Established in 2002, we are headquartered in Princeton NJ with an off-shore delivery center in New Delhi, India.