Design, develop, test, deploy and maintain large-scale data pipelines using PySpark on Microsoft Azure platform.
Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions that meet business needs.
Develop complex SQL queries to extract insights from Snowflake databases and integrate them into the pipeline.
Troubleshoot issues related to data processing, storage, and retrieval in real-time.
Job Requirements :
4-12 years of experience in designing and developing big data architectures on cloud platforms like Microsoft Azure.
Strong expertise in working with PySpark for building scalable data pipelines.
Proficiency in writing complex SQL queries for querying large datasets stored in Snowflake databases.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full time