Senior Data Engineer/Python Developer
- Luxoft
- 7 - 8 years
- Bengaluru
- 2 months ago
- Email to a friend
- Report this job
Job Description
A Data Engineer with experience in the following techologies:
Databricks and Azure
Apache Spark-based, hands on Python, SQL, Apache Airflow.
Databricks clusters for ETL processes.
Integration with ADLS, Blob Storage.
Efficiently ingest data from various sources, including on-premises databases, cloud storage, APIs, and streaming data.
Use Azure Key Vault for managing secrets.
Hands on experience working with APIs
Kafka/Azure EventHub streaming hands on experience
Hands on experience with data bricks delta APIs and UC catalog Hands on experience working with version control tools Github
Data Analytics
Supports various ML frameworks.
Integration with Databricks for model training.
OnPrem
Exposure on Linux based systems
Unix scripting
Skills
Must have
Python, Apache Airflow, Microsoft Azure and Databricks, SQL, databricks clusters for ETL, ADLS, Blob storage, ingestion from various sources including databases and cloud storage, APIs and streaming data, Kafka/Azure EventHub, databricks delta APIs and UC catalog.
Education: Typically, a Bachelors degree in Computer Science (preferably M.Sc. in Computer Science), Software Engineering, or a related field is required.
Experience: 7+ years of experience in development or related fields.
Problem-Solving Skills: Ability to troubleshoot and resolve issues related to application development and deployment.
Communication Skills: Ability to effectively communicate technical concepts to team members and stakeholders. This includes written and verbal communication.
Teamwork: Ability to work effectively in teams with diverse individuals and skill sets.
Continuous Learning: Given the rapidly evolving nature of web technologies, a commitment to learning and adapting to new technologies and methodologies is crucial.
Nice to have
Snowflake, PostGre, Redis exposure
GenAI exposure
Good understanding of RBAC
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: DBA / Data warehousingRole: Data warehouse DeveloperEmployement Type: Full timeContact Details:
Company: LuxoftLocation(s): Bengaluru+ View Contact
Keyskills: Computer science github Version control Linux cloud storage Application development Apache big data SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in