Senior Data Engineer
- Criticalriver
- 5 - 10 years
- Hyderabad
- 3 months ago
- Email to a friend
- Report this job
Job Description
Job Profile
We are seeking a Senior Data Engineer with proven expertise in designing and maintaining scalable, efficient, and reliable data pipelines. The ideal candidate should have strong proficiency in SQL, DBT, BigQuery, Python, and Airflow, along with a solid foundation in data warehousing principles. In this role, you will be instrumental in managing and optimizing data workflows, ensuring high data quality, and supporting data-driven decision-making across the organization. Experience with Oracle ERP systems and knowledge of data migration to a data warehouse environment will be considered a valuable advantage.
Years of Experience: 5 to 10 Years.
Shift Timings: 1PM to 10PM IST.
Skill Set
SQL: Advanced proficiency in writing optimized queries, working with complex joins, CTEs, window functions, etc.
DBT (Data Build Tool): Experience in modelling data with dbt, managing data transformations, and maintaining project structure.
- Python: Proficient in writing data processing scripts and building Airflow DAGs using Python.
- BigQuery: Strong experience with GCPs BigQuery, including
dataset optimization, partitioning, and query cost management.
- Apache Airflow: Experience building and managing DAGs, handling dependencies, scheduling jobs, and error handling.
- Data Warehousing Concepts: Strong grasp of ETL/ELT, dimensional modelling (star/snowflake), fact/dimension tables, slowly changing dimensions, etc.
- Version Control: Familiarity with Git/GitHub for code collaboration and deployment. Cloud Platforms: Working knowledge of Google Cloud Platform (GCP).
Job Description
Roles & Responsibilities:
- Design, build, and maintain robust ETL/ELT data pipelines using Python, Airflow, and DBT.
- Develop and manage dbt models to enable efficient, reusable, and well-documented
data transformations.
- Collaborate with stakeholders to gather data requirements and design data marts
comprising fact and dimension tables in a well-structured star schema.
- Manage and optimize data models and transformation logic in BigQuery, ensuring high
performance and cost-efficiency.
- Implement and uphold robust data quality checks, logging, and alerting mechanisms to ensure reliable data delivery.
- Maintain the BigQuery data warehouse, including routine optimizations and updates.
- Enhance and support the data warehouse architecture, including the use of
star/snowflake schemas, partitioning strategies, and data mart structures.
- Proactively monitor and troubleshoot production pipelines to minimize downtime and
ensure data accuracy.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CriticalriverLocation(s): Hyderabad
Similar positions
Criticalriver
About CriticalRiver: Critical River Inc is a technology services organization focused on design and implementation of Oracle and SaaS based solutions. In addition, we have a strong strategic staffing practice. One thing that differentiates us from our peers is that the founders of the firm and m...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in