Sr. Data Engineer - Snowflake with AWS
- tsworks
- 9 - 14 years
- Bengaluru
- 20 days ago
- Email to a friend
- Report this job
Job Description
Greetings from tsworks Technologies India Pvt .
We are hiring for Sr. Data Engineer - Snowflake with AWS If you are interested, please share your CV to mo********r@ts****s.io
- Position: Senior Data Engineer
- Experience: 9+ Years
- Location: Bengaluru, India (Hybrid)
Mandatory Required Qualification
- Strong proficiency in AWS data services such as S3 buckets, Glue and Glue Catalog, EMR, Athena, Redshift, DynamoDB, Quick Sight, etc.
- Strong hands-on experience building Data Lake-House solutions on Snowflake, and using features such as streams, tasks, dynamic tables, data masking, data exchange etc.
- Hands-on experience using scheduling tools such as Apache Airflow, DBT, AWS Step Functions and data governance products such as Collibra
- Expertise in DevOps and CI/CD implementation
- Excellent Communication Skills
In This Role, You Will
- Design, implement, and manage scalable and efficient data architecture on the AWS cloud platform.
- Develop and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
- Perform complex data transformations and processing using PySpark (AWS Glue, EMR or Databricks), Snowflake's data processing capabilities, or other relevant tools.
- Hands-on experience working with Data Lake solutions such as Apache Hudi, Delta Lake or Iceberg.
- Develop and maintain data models within Snowflake and related tools to support reporting, analytics, and business intelligence needs.
- Collaborate with cross-functional teams to understand data requirements and design appropriate data integration solutions.
- Integrate data from various sources, both internal and external, ensuring data quality and consistency.
Skills & Knowledge
- Bachelor's degree in computer science, Engineering, or a related field.
- 9 + Years of experience in Information Technology, designing, developing and executing solutions.
- 4+ Years of hands-on experience in designing and executing data solutions on AWS and Snowflake cloud platforms as a Data Engineer.
- Strong proficiency in AWS services such as Glue, EMR, Athena, Databricks, with file formats such as Parquet and Avro.
- Hands-on experience in data modelling, batch and real-time pipelines, using Python, Java or JavaScript and experience working with Restful APIs are required.
- Hands-on experience in handling real-time data streams from Kafka or Kinesis is required.
- Expertise in DevOps and CI/CD implementation.
- Hands-on experience with SQL and NoSQL databases.
- Hands-on experience in data modelling, implementation, and management of OLTP and OLAP systems.
- Knowledge of data quality, governance, and security best practices.
- Familiarity with machine learning concepts and integration of ML pipelines into data workflows
- Hands-on experience working in an Agile setting.
- Is self-driven, naturally curious, and able to adapt to a fast-paced work environment.
- Can articulate, create, and maintain technical and non-technical documentation.
- AWS and Snowflake Certifications are preferred.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: tsworksLocation(s): Bengaluru
Keyskills: Snowflake AWS Glue Catalog Glue Quicksight Redshift Aws Dynamo Db DBT Data Lake EMR Athena
Similar positions
tsworks
With 1000+ Global teams and operations in the USA, UK, CANADA, and INDIA, VARITE is currently engaged with leading technology, financial, automotive, defense, energy, pharmaceuticals/life sciences, semiconductor, and engineering companies to provide software consulting, team augmentation and key bus...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in