Data Engineer - AWS & Python @ Agilisium

Home > Software Development

Data Engineer - AWS & Python

Agilisium
6 - 10 years
1 month ago
Email to a friend
Report this job

Job Description

Key Responsibilities:

Design, develop, and optimizedata pipelinesandETL workflowsusingAWS Glue, AWS Lambda, and Apache Spark.
Implement big data processingsolutions leveraging AWS EMR and AWS Redshift.
Develop and maintain data lakes and data warehouses on AWS (S3, Redshift, RDS).
Ensure data quality, integrity, and governance usingAWS Glue Data Catalog and AWS Lake Formation.
Optimize data storage and processingfor performance and cost efficiency.
Work withs tructured, semi-structured, and unstructured dataacross various storage formats (Parquet, Avro, JSON, etc.).
Automate and orchestrate data workflowsusing AWS Step Functions and Apache Airflow.
Implement best practices for CI/CD pipelinesin data engineering with AWS CodePipeline and AWS CodeBuild.
Monitor, troubleshoot, and optimize data pipeline performance and scalability.
Collaborate with cross-functional teams including data scientists, analysts, and software engineers.

Required Skills & Qualifications:

6+ yearsof experience indata engineeringand big data processing.
Strong experience withAWS cloud services:AWS Glue, AWS Lambda, AWS Redshift, AWS EMR, S3.
Proficiency inPythonfor data engineering tasks.
Hands-on experience withApache Spark and SQL for data processing.
Experience withdata modeling, schema design, and performance tuning.
Understanding ofAWS Lake FormationandLakehouse principles.
Experience withversion control (Git)and CI/CD pipelines.
Knowledge ofdata security, compliance, and governance best practices.
Experience withreal-time streaming technologies(Kafka, Kinesis) is a plus.
Strong problem-solving, analytical, and communication skills.

Job Classification

Industry: Analytics / KPO / Research
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Agilisium
Location(s): Saidapet

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: Python continuous integration cloud services performance tuning amazon redshift ci/cd kinesis aws lambda sql aws glue database design git data modeling aws cloud spark kafka aws

Fraud Alert to job seekers!

₹ Not Disclosed

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Similar positions

Mass & Balance || 4 To 6 Years

Capgemini

5 - 6 years

Bengaluru

2 hours ago

₹ Not Disclosed

Application Architect-Asset Management

IBM

4 - 8 years

Pune

4 hours ago

₹ Not Disclosed

Application Developer-Cloud FullStack

IBM

6 - 8 years

Kochi

5 hours ago

₹ Not Disclosed

Data Engineer-Data Platforms

IBM

3 - 5 years

Mumbai

5 hours ago

₹ Not Disclosed

Agilisium

Agilisium is a Los Angeles based AWS Advanced Consulting Partner with Big Data, EMR and Redshift competency. Agilisium exists to help organizations accelerate their Data-to-Insights-Leap. To this end, Agilisium has invested in all stages of data journey: Data Architecture Consulting, Data Integratio...

Data Engineer - AWS & Python @ Agilisium

Home > Software Development