Senior Data Engineer
- Puresoftware
- 5 - 9 years
- Pune
- 2 months ago
- Email to a friend
- Report this job
Job Description
Job Summary:
We are looking for a highly skilled AWS Data Engineer with over 5 years of experience in designing, developing, and maintaining scalable data pipelines on AWS. The ideal candidate will be proficient in data engineering best practices and cloud-native technologies, with hands-on experience in building ETL/ELT pipelines, working with large datasets, and optimizing data architecture for analytics and business intelligence.
Key Responsibilities:
- Design, build, and maintain scalable and robust data pipelines and ETL processes using AWS services (e.g., Glue, Lambda, EMR, Redshift, S3, Athena).
- Collaborate with data analysts, data scientists, and stakeholders to understand data requirements and deliver high-quality solutions.
- Implement data lake and data warehouse architectures, ensuring data governance, data quality, and compliance.
- Optimize data pipelines for performance, reliability, scalability, and cost.
- Automate data ingestion and transformation workflows using Python, PySpark, or Scala.
- Manage and monitor data infrastructure including logging, error handling, alerting, and performance metrics.
- Leverage infrastructure-as-code tools like Terraform or AWS CloudFormation for infrastructure deployment.
- Ensure security best practices are implemented for data access and storage (IAM, KMS, encryption, etc.).
- Document data processes, architectures, and standards.
Required Qualifications:
- Bachelors or Masters degree in Computer Science, Information Systems, or a related field.
- Minimum 5 years of experience as a Data Engineer with a focus on AWS cloud services.
- Strong experience in building ETL/ELT pipelines using AWS Glue, EMR, Lambda, and Step Functions.
- Proficiency in SQL, Python, PySpark, and data modeling techniques.
- Experience working with data lakes (S3) and data warehouses (Redshift, Snowflake, etc.).
- Experience with Athena, Kinesis, Kafka, or similar streaming data tools is a plus.
- Familiarity with DevOps and CI/CD processes, using tools like Git, Jenkins, or GitHub Actions.
- Understanding of data privacy, governance, and compliance standards such as GDPR, HIPAA, etc.
- Strong problem-solving and analytical skills, with the ability to work in a fast-paced environment.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: PuresoftwareLocation(s): Pune
Keyskills: SQL Aws Lambda Data Lake AWS Python Pyspark EMR Aws Glue Data Bricks Amazon Redshift Snowflake Data Warehousing ETL
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in