Data Engineer- AWS
- It a global analytics
- 6 - 10 years
- Noida, Gurugram
- 2 months ago
- Email to a friend
- Report this job
Job Description
Key Responsibilities:
- Data Pipeline Development:
- Design, build, and maintain scalable and reliable data pipelines to collect, process, and transform raw data into usable formats.
- Automate the movement and transformation of data across various systems and sources, ensuring data flows seamlessly.
- Database Management:
- Create and maintain robust data storage solutions, including data warehouses, data lakes, and databases.
- Ensure the database architecture is optimized for query performance, scalability, and security.
- Handle data migrations, backups, and data restoration processes.
- ETL (Extract, Transform, Load) Processes:
- Build and manage ETL pipelines to extract data from various sources, transform it to fit the needs of analytics and business intelligence, and load it into storage systems.
- Ensure data quality and consistency throughout the ETL pipeline.
- Data Modeling:
- Design and implement data models, schemas, and structures that efficiently store and retrieve data.
- Work with stakeholders to ensure that the data model aligns with business requirements and optimizes performance.
- Data Integration:
- Integrate data from multiple sources (internal and external) into a unified platform.
- Ensure proper data mapping, transformation, and consolidation across systems.
- Data Governance and Security:
- Implement data governance policies, including data lineage, data quality, and compliance (e.g., GDPR, HIPAA).
- Work with security teams to ensure that data is securely stored and accessed.
- Performance Optimization:
- Monitor and optimize data processing pipelines to handle increasing volumes of data efficiently.
- Troubleshoot and resolve any performance bottlenecks in data processing and storage systems.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA, Role Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: It a global analyticsLocation(s): Noida, Gurugram+ View Contact
Keyskills: Data Engineering AWS Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in