Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Databricks Engineer @ Accion Labs

Home > Software Development

 Databricks Engineer

Job Description

Job Description / Skill set:

5+ years of related experience with a Bachelors degree; consulting experience preferred.
5+ years of hands-on experience in data engineering/ETL using Databricks on AWS / Azure cloud infrastructure and functions. 
3+ years of experience in PBI and Data Warehousing experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Experience with AWS (e.g. S3, Athena, Glue, Lambda, etc.) preferred.
Deep understanding of data warehousing concepts (Dimensional (star-schema), SCD2, Data Vault, Denormalized, OBT) implementing highly performant data ingestion pipelines from multiple sources 
Strong proficiency in Python and SQL.
Deep understanding of Databricks platform features (Delta Lake, Databricks SQL, MLflow) 
Experience with CI/CD on Databricks using tools such as BitBucket, GitHub Actions, and Databricks CLI  -nyea
Integrating the end-to-end Databricks pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. 
Experience with Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables (DLT), MLflow. 
Basic working knowledge of API or Stream based data extraction processes like Salesforce API, Bulk API.
Understanding of Data Management principles (quality, governance, security, privacy, life cycle management, cataloguing) 
Excellent problem-solving and analytical skills
Able to Work Independently 
Excellent oral and written communication skills 
Nice to have: Databricks certifications and AWS Solution Architect certification. 
Nice to have: experience with building data pipeline from various business applications like Salesforce, Marketo, NetSuite, Workday etc.


Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Accion Labs
Location(s): Noida, Gurugram

+ View Contactajax loader


Keyskills:   Power Bi Data Warehousing Data Bricks SQL Python Data Engineering Azure Databricks aws ETL

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Software Engineer III

  • JPMorgan Chase Bank
  • 0 - 5 years
  • Hyderabad
  • 10 hours ago
₹ Not Disclosed

Lead Software Engineer - React, Node.js, Java

  • JPMorgan Chase Bank
  • 0 - 7 years
  • Bengaluru
  • 11 hours ago
₹ Not Disclosed

Software Engineering - Application Developer

  • Trigent Software
  • 6 - 10 years
  • Bengaluru
  • 14 hours ago
₹ 50,000-3 Lacs P.A.

Data Engineer-Data Platforms

  • IBM
  • 3 - 5 years
  • Mumbai
  • 15 hours ago
₹ Not Disclosed

Accion Labs

Accion Labs is a Product Engineering Company Helping to Transform Businesses Through Emerging Technologies. This includes Web 2.0, Open Source, SaaS/Cloud, Mobility, IT Operations Management/ITSM, Big Data, and traditional BI/DW. Through nine global offices and a rapid-response delivery model, Accio...