AWS Data Engineers
- Ispecia Technologies
- 6 to 10 Yrs
- Chennai
- 2 months ago
- Email to a friend
- Report this job
Job Description
- We are seeking Experienced AWS Data Engineers with extensive expertise in AWS (EMR/S3/GLUE/REDSHIFT etc) to join our Cloud practice delivering transformative solutions to leading clients. This is a GREEN FIELD Project and NOT A lift and Shift Project. We are seeking highly experienced individuals who have experience in a AWS Green field setting. At this time, We welcome Freelancers, Contractors and other immediate joiners. Experience: 6+ Years of Relevant experience Location - Chennai / Bangalore/ Hyderabad/ Noida Mode - Hybrid AWS Data Engineers Data Engineer - Scale Migration Specialist Job Description: To drive the successful migration of on- premise Hadoop big data infrastructure to AWS, ensuring scalability, performance, and data integrity throughout the process. Senior Cloud Data Engineers Understand & demonstrate experience on AGILE development methodology. 1. Design and implement data migration strategies from on-premise Hadoop to 2. Develop and optimize Spark jobs for data processing on AWS EMR. 3. Manage and maintain S3 storage solutions for data lake architecture. 4. Configure and manage AWS Glue for ETL processes and data cataloging. 5. Ensure data quality and integrity throughout the migration process. 6. Collaborate with stakeholders to understand and document data requirements The Data Engineer will be a key player in our Ninja Team, responsible for designing, developing, and implementing data processing and migration strategies. The role involves working with various big data technologies and AWS services to facilitate a seamless transition from on-premise Hadoop to a cloud-based environment. This includes data migration, optimization, and integration tasks to ensure robust and scalable data 7. Perform data mapping and transformation tasks as part of the migration strategy solutions. 8. Implement and manage AWS Lake Formation for data governance and security 9. Troubleshoot and resolve data migration issues and performance bottlenecks. 10. Monitor and optimize data workflows for performance and cost efficiency. 11. Develop and maintain documentation for data processes and architecture. 12. Coordinate with cross-functional teams to align migration activities 13. Provide technical guidance and support to junior team members. 14. Conduct performance tuning and optimization of data processing tasks. 15. Ensure compliance with data security and privacy policies. 16. Design and implement automated data pipelines using AWS services. 17. Perform regular data validation and verification checks. 18. Collaborate with AWS support and engineering teams as needed. 19. Stay up-to-date with the latest developments in big data and cloud technology 20. Assist in training and knowledge transfer activities for team members.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: AWS Data EngineersContact Details:
Company: PTS ConsultingLocation(s): Chennai+ View Contact
Keyskills: AWS EMR GLUE Hadoop Spark ETL Data Governance Data Security Data Processing Data Migration AGILE Methodology REDSHIFT
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in