Azure Data Engineer - Databricks/Scala Job in
- Stratosphere
- 3 to 7 Yrs
- All India
- 6 months ago
- Email to a friend
- Report this job
Job Description
- Job Description We are seeking a talented Azure Data Engineer with expertise in Azure Databricks and Scala to join our dynamic team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure on the Azure platform. You will collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver robust solutions that drive actionable insights and support business objectives. Responsibilities Design and implement end-to-end data pipelines using Azure services such as Azure Data Factory, Azure Databricks, Azure Blob Storage, and Azure SQL Database. Develop data transformation processes using Scala within Azure Databricks notebooks or jobs to cleanse, integrate, and aggregate large volumes of data from various sources. Optimize and tune Spark jobs and Scala code to ensure high performance and scalability. Collaborate with data scientists to integrate machine learning models and algorithms into data pipelines for advanced analytics and predictive modeling. Implement data security and privacy measures, including encryption and access controls, to protect sensitive information. Monitor and troubleshoot data pipeline performance issues and ensure data quality and reliability. Document data engineering processes, workflows, and best practices for knowledge sharing and future reference. Stay up-to-date with Azure and Databricks technologies and incorporate new features and capabilities into existing infrastructure and workflows. Requirements Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred. Proven experience as a Data Engineer or similar role, with at least [X] years of hands-on experience in designing and implementing data solutions on the Azure platform. Strong proficiency in Scala programming language and experience with Spark for big data processing. Solid understanding of Azure cloud services, including Azure Data Factory, Azure Databricks, Azure Blob Storage, and Azure SQL Database. Experience with data modeling, ETL development, and data warehousing concepts. Ability to work effectively in a collaborative team environment and communicate technical concepts to non-technical stakeholders. Strong problem-solving skills and attention to detail. Azure certifications (e.g., DP-200, DP-201, DP-203) and familiarity with DevOps practices are a plus. Benefits Competitive salary and benefits package. Opportunities for professional growth and career advancement. Dynamic and collaborative work environment. Flexible work arrangements and remote work options. If you are passionate about leveraging Azure technologies to drive data-driven decision-making and innovation, we encourage you to apply for this exciting opportunity to join our team! Application Instructions Please submit your resume and cover letter detailing your relevant experience and qualifications for the position. We look forward to reviewing your application. (ref:hirist.tech),
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Azure Data Engineer - Databricks/Scala Job inContact Details:
Company: StratosphereLocation(s): All India+ View Contact
Keyskills: Scala Spark Data modeling Azure Data Factory
Fraud Alert to job seekers!
₹ Not Specified
Similar positions
Stratosphere
Stratosphere IT Services Pvt. Ltd. || TCS Tata Consultancy Services Limited is an Indian multinational information technology service and consulting company headquartered in Mumbai, Maharashtra, India. It is a subsidiary of Tata Group and operates in 46 countries. TCS is the second largest India...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in