Data - Lead
- Iris Software
- 5 - 8 years
- Noida, Gurugram
- 8 days ago
- Email to a friend
- Report this job
Job Description
1.Architect and design end to end data pipelines starting from Source systems to Data warehouse.
2.Lead the development of scalable Python- Spark based data processing workflows
3.Define and implement data modeling standards for DWH including fact/dimension schema and historical handling.
4.Oversee performance tuning of Python, Spark and ETL loads.
5.Ensure robust data integration with Tableau reporting by designing data structures optimized for Bl consumption.
6.Mentor junior engineers and drive engineering best practices.
7.Work loosely with business stakeholders, developers and product teams to align data initiatives with business goals,
8.Define SLAs, error handling, logging, monitoring and alerting mechanisms across pipelines. Must Have:
1. Strong Oracle SQL expertise and deep oracle DWH experience.
2. Proficiency in Python and Spark with experience handling large scale data transformations.
3. Experience in building batch data pipelines and managing dependencies.
4. Solid understanding of data warehousing principles and dimensional modeling.
5. Experience working with reporting tools like Tableau.
6. Good to have experience in cloud-based DWHs (like Snowflake) for future- readiness.
- ETL - ETL - Data Stage
- Beh - Communication and collaboration
- BI and Reporting Tools - BI and Reporting Tools - Tableau
- QA/QE - QA Analytics - Data Analysis
- Database - Database Programming - SQL
- Big Data - Big Data - SPARK
- Programming Language - Python - Python Shell
- ETL - ETL - Ab Initio
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Technical LeadEmployement Type: Full timeContact Details:
Company: Iris SoftwareLocation(s): Noida, Gurugram
Keyskills: python datastage data warehousing dimensional modeling etl ab initio snowflake oracle data analysis performance tuning bi sql spark programming tableau data modeling spark shell scripting oracle sql big data data integration reporting tools
Similar positions
Iris Software
Iris is a professional software services organization offering high-quality, cost-effective solutions to businesses. It has helped meet the IT requirements of companies ranging from those among the Fortune 100 to medium-sized firms by utilizing best-of-breed technologies, rapidly deployable solution...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in