AES - DE- Python Backend Engineer @ Zensar

We are seeking a skilled Data Engineer with 4+ years of experience in designing, developing, and optimizing data pipelines. The ideal candidate will have strong expertise in Python and SQL along with experience in database management, ETL processes, and cloud technologies.

Key

Design, develop, and maintain scalable and efficient data pipelines using Python and SQL.
Optimize and maintain ETL processes for data ingestion, transformation, and storage.
Develop and manage database schemas, tables, and indexes to support data processing.
Work with structured and unstructured data to clean, transform, and aggregate large datasets.
Collaborate with data scientists, analysts, and software engineers to ensure smooth data flow and accessibility.
Implement data quality checks and validation to ensure accuracy and consistency.
Optimize SQL queries for performance and scalability.
Work with cloud-based data solutions (AWS, GCP, or Azure) for storage and processing.
Automate workflows using Python scripting and scheduling tools like Airflow or Cron Jobs.
Monitor and troubleshoot data pipelines to ensure reliability and performance
Build and maintain the CI/CD pipelines

Required Skills & Qualifications:

4+ years of experience in Data Engineering, Data Warehousing, or related fields.
Strong proficiency in Python (Pandas, NumPy, PySpark, etc.) and SQL (Snowflake, PostgreSQL, MySQL, SQL Server, etc.).
Experience with containerization (Docker & Git bucket).
Hands-on experience with ETL tools and data pipeline orchestration (Snowflake, Python).
Experience with relational and NoSQL databases (MongoDB, Cassandra, etc.).
Proficiency in query optimization and database performance tuning.
Experience with cloud platforms (AWS,) and services like S3, BigQuery, or Snowflake.
Familiarity with data modeling concepts and best practices.
Understanding of big data frameworks (Hadoop, Spark, etc.) is a plus.
Strong problem-solving skills and ability to work in a collaborative environment.

Preferred Skills:

Familiarity with machine learning pipelines and integrating data with AI/ML models.
Experience working in Agile/Scrum methodologies.
Knowledge of data governance and security best practice