Your browser does not support javascript! Please enable it, otherwise web will not work for you.

AWS Data Engineer @ Leading Client

Home > Software Development

 AWS Data Engineer

Job Description

 Job Title:AWS Data Engineer
Experience5-10 Years
Location:Bangalore  :  Technical Skills:
  •  
  •  5 + Years of experience as AWS Data Engineer, AWS S3, Glue Catalog, Glue Crawler, Glue ETL, Athena 
  •  write Glue ETLs to convert data in AWS RDS for SQL Server and Oracle DB to Parquet format in S3 
  •  Execute Glue crawlers to catalog S3 files. 
  •  Create catalog of S3 files for easier querying 
  •  Create SQL queries in Athena 
  •  Define data lifecycle management for S3 files 
  •  Strong experience in developing, debugging, and optimizing Glue ETL jobs using PySpark or Glue Studio. 
  •  Ability to connect Glue ETLs with AWS RDS (SQL Server and Oracle) for data extraction and write transformed data into Parquet format in S3. 
  •  Proficiency in setting up and managing Glue Crawlers to catalog data in S3. 
  •  Deep understanding of S3 architecture and best practices for storing large datasets. 
  •  Experience in partitioning and organizing data for efficient querying in S3. 
  •  Knowledge of Parquet file format advantages for optimized storage and querying. 
  •  Expertise in creating and managing the AWS Glue Data Catalog to enable structured and schema-aware querying of data in S3. 
  •  Experience with Amazon Athena for writing complex SQL queries and optimizing query performance. 
  •  Familiarity with creating views or transformations in Athena for business use cases. 
  •  Knowledge of securing data in S3 using IAM policies, S3 bucket policies, and KMS encryption. 
  •  Understanding of regulatory requirements (e.g., GDPR) and implementing secure data handling practices. 

    •  Non-Technical Skills:
  •  
  •  Candidate needs to be Good Team Player 
  •  Effective interpersonal, team building and communication skills. 
  •  Ability to communicate complex technology to no tech audience in simple and precise manner. 

    • Job Classification

    Industry: Recruitment / Staffing
    Functional Area / Department: Engineering - Software & QA
    Role Category: Software Development
    Role: Data Engineer
    Employement Type: Full time

    Contact Details:

    Company: Leading Client
    Location(s): Bengaluru

    + View Contact

    Keyskills:   glue catalog debugging etl aws glue hive scala amazon redshift pyspark data warehousing sql parquet microservices java git unix shell scripting iam spark mysql hadoop big data hbase avro python oracle aws lambda sql server kafka athena sqoop aws db

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    Software Engineer III

    • JPMorgan Chase Bank
    • 0 - 5 years
    • Hyderabad
    • 5 hours ago
    ₹ Not Disclosed

    Lead Software Engineer - React, Node.js, Java

    • JPMorgan Chase Bank
    • 0 - 7 years
    • Bengaluru
    • 5 hours ago
    ₹ Not Disclosed

    Software Engineering - Application Developer

    • Trigent Software
    • 6 - 10 years
    • Bengaluru
    • 8 hours ago
    ₹ 50,000-3 Lacs P.A.

    Data Engineer-Data Platforms

    • IBM
    • 3 - 5 years
    • Mumbai
    • 9 hours ago
    ₹ Not Disclosed

    Leading Client

    Leading Client In Paper

    IndigoJobs © 2025

    For enquiries: contact(at)indigojobs.in

    We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in