Job Description
Bengaluru, India BigData Development Cross Industry Solutions06/05/2025 Project description
Luxoft has been asked to contract a Developer in support of a number of customer initiatives. The primary objective is to develop based on client requirements in the Telecom/network work environment ResponsibilitiesA Data Engineer with experience in the following techologies: Databricks and Azure Apache Spark-based, hands on Python, SQL, Apache Airflow. Databricks clusters for ETL processes. Integration with ADLS, Blob Storage. Efficiently ingest data from various sources, including on-premises databases, cloud storage, APIs, and streaming data. Use Azure Key Vault for managing secrets. Hands on experience working with API's Kafka/Azure EventHub streaming hands on experience Hands on experience with data bricks delta API's and UC catalog Hands on experience working with version control tools Github Data Analytics Supports various ML frameworks. Integration with Databricks for model training. OnPrem Exposure on Linux based systems Unix scripting Skills
Must have Python, Apache Airflow, Microsoft Azure and Databricks, SQL, databricks clusters for ETL, ADLS, Blob storage, ingestion from various sources including databases and cloud storage, APIs and streaming data, Kafka/Azure EventHub, databricks delta APIs and UC catalog. EducationTypically, a Bachelor's degree in Computer Science (preferably M.Sc. in Computer Science), Software Engineering, or a related field is required. Experience7+ years of experience in development or related fields. Problem-Solving
Skills:Ability to troubleshoot and resolve issues related to application development and deployment. Communication Skills:Ability to effectively communicate technical concepts to team members and stakeholders. This includes written and verbal communication. TeamworkAbility to work effectively in teams with diverse individuals and skill sets. Continuous LearningGiven the rapidly evolving nature of web technologies, a commitment to learning and adapting to new technologies and methodologies is crucial. Nice to have Snowflake, PostGre, Redis exposure GenAI exposure Good understanding of RBAC OtherLanguagesEnglishC2 Proficient SenioritySenior Job Classification
Industry: Law Enforcement / Security Services
Functional Area / Department: Engineering - Software & QA
Role Category: DBA / Data warehousing
Role: Data warehouse Developer
Employement Type: Full time
Contact Details:
Company: Luxoft
Location(s): Bengaluru
Keyskills:
sql
python
airflow
microsoft azure
data bricks
redis
unix scripting
apache
postgresql
spark
linux
software engineering
api
etl
azure event hub
ml
snowflake
github
azure data lake
data analytics
rbac
python development
kafka
web technologies
unix