Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Databricks Engineer @ Diverse Lynx

Home > Software Development

 Databricks Engineer

Job Description

  • Design and build scalable data pipelines and ETL/ELT workflows using Azure Databricks (Apache Spark).
  • Collaborate with data architects and analysts to transform business requirements into technical solutions.
  • Optimize and maintain data processing performance, including tuning Spark jobs and managing clusters.
  • Integrate data from various structured and unstructured sources (Azure Data Lake, Blob Storage, SQL DB, etc).
  • Implement best practices for code versioning, CI/CD pipelines, and data security.
  • Work with Azure services such as Data Factory, Data Lake, Synapse Analytics, and Event Hubs.
  • Troubleshoot data pipeline issues and provide production support as needed.
  • Develop notebooks in Python/Scala/SQL for data processing and analytics.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Platform Engineer
Employement Type: Full time

Contact Details:

Company: Diverse Lynx
Location(s): Hyderabad

+ View Contactajax loader


Keyskills:   Production support data security spark SCALA Data processing Management Troubleshooting Analytics SQL Python

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Software Engineer III

  • JPMorgan Chase Bank
  • 0 - 5 years
  • Hyderabad
  • 1 day ago
₹ Not Disclosed

Lead Software Engineer - React, Node.js, Java

  • JPMorgan Chase Bank
  • 0 - 7 years
  • Bengaluru
  • 1 day ago
₹ Not Disclosed

Software Engineering - Application Developer

  • Trigent Software
  • 6 - 10 years
  • Bengaluru
  • 1 day ago
₹ 50,000-3 Lacs P.A.

Data Engineer-Data Platforms

  • IBM
  • 3 - 5 years
  • Mumbai
  • 1 day ago
₹ Not Disclosed

Diverse Lynx

Diverse Lynx is your Go to Place for all IT needs. We combine industry leading expertise and our personal dedication for all your needs. Established in 2002, we are headquartered in Princeton NJ with an off-shore delivery center in New Delhi, India.