Staff Data Engineer
- SE2
- 6 - 11 years
- Pune
- 1 month ago
- Email to a friend
- Report this job
Job Description
WHO WE ARE:
As a seasoned Data Engineer specializing in data engineering, you bring extensive expertise in optimizing data workflows using various database tools like Oracle, BigQuery, and SQL Server. You possess a deep understanding of ELT/ETL processes, data integration, and have a strong command of Python for data manipulation and automation tasks. You will possess advanced expertise in working with data platforms like Google Big Query, DBT, Python, and Airflow. Responsible for designing and maintaining scalable ETL pipelines, optimizing complex data systems, and ensuring smooth data flow across different platforms. As a Senior Data Engineer, you will also be required to work collaboratively in a team and contribute to building data infrastructure that drives business insights
WHAT YOU LL DO:
- Design, develop, and optimize complex ETL pipelines that integrate large data sets from various sources.
- Build and maintain high-performance data models using Google BigQuery and DBT for data transformation.
- Develop Python scripts for data ingestion, transformation, and automation.
- Implement and manage data workflows using Apache Airflow for scheduling and orchestration.
- Collaborate with data scientists, analysts, and other stakeholders to ensure data availability, reliability, and performance.
- Troubleshoot and optimize data systems, identifying issues and resolving them proactively.
- Work on cloud-based platforms, particularly AWS, to leverage scalability and storage options for data pipelines.
- Ensure data integrity, consistency, and security across systems.
- Take ownership of end-to-end data engineering tasks while mentoring junior team members.
- Continuously improve processes and technologies for more efficient data processing and delivery.
- Act as a key contributor to developing and supporting complex data architectures.
WHAT YOU LL NEED:
- Bachelor s degree in computer science, Information Technology, or a related field.
- 6+ years of hands-on experience in Data Engineering or related fields, with a strong background in building and optimizing data pipelines
- Strong proficiency in Google Big Query, including designing and optimizing queries.
- Advanced knowledge of DBT for data transformation and model management.
- Proficiency in Python for data engineering tasks, including scripting, data manipulation, and automation.
- Solid experience with Apache Airflow for workflow orchestration and task automation.
- Extensive experience in building and maintaining ETL pipelines.
- Familiarity with cloud platforms, particularly AWS (Amazon Web Services), including tools like S3, Lambda, Redshift, or Glue.
- Java knowledge is a plus.
- Excellent problem-solving and troubleshooting abilities.
- Strong communication and collaboration skills with the ability to work effectively in a team environment.
- Self-motivated, detail-oriented, and able to work with minimal supervision.
- Ability to manage multiple priorities and deadlines in a fast-paced environment.
- Experience with other cloud platforms (e.g., GCP, Azure) is a plus.
- Knowledge of data warehousing best practices and architecture.
WHAT S IN IT FOR YOU?
At Zinnia, you collaborate with smart, creative professionals who are dedicated to delivering cutting-edge technologies, deeper data insights, and enhanced services to transform how insurance is done. Visit our website at www.zinnia.com for more information. Apply by completing the online application on the careers section of our website. We are an Equal Opportunity employer committed to a diverse workforce. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability
#LI-SC1
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Software Development - OtherEmployement Type: Full timeContact Details:
Company: SE2Location(s): Pune+ View Contact
Keyskills: Computer science Automation Workflow Data processing Scheduling Oracle Apache Information technology SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
SE2
Come join a recognized leader in third-party administration for the US life and annuity insurance industry and experience a fast paced, fun and rewarding work environment. We offer excellent career progression and a competitive compensation and some great benefits, including health/term insurance, i...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in