Python + Data Engineer
- Wissen Technology
- 5 - 10 years
- Mumbai
- 21 hours ago
- Email to a friend
- Report this job
Job Description
Wissen Technology is Hiring fo r Python + Data Engineer
About Wissen Technology: Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges.
Role Overview: We are seeking a skilled and innovative Python Data Engineer with expertise in designing and implementing data solutions using the AWS cloud platform. The ideal candidate will be responsible for building and maintaining scalable, efficient, and secure data pipelines while leveraging Python and AWS services to enable robust data analytics and decision-making processes.
Experience: 5-9 Years
Location: Mumbai
Key Responsibilities
- Design, develop, and optimize data pipelines using Python and AWS services such as Glue, Lambda, S3, EMR, Redshift, Athena, and Kinesis.
- Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).
- Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.
- Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.
- Ensure data quality and consistency by implementing validation and governance practices.
- Work on data security best practices in compliance with organizational policies and regulations.
- Automate repetitive data engineering tasks using Python scripts and frameworks.
- Leverage CI/CD pipelines for deployment of data workflows on AWS.
Required Skills:
- Professional Experience: 5+ years of experience in data engineering or a related field.
- Programming: Strong proficiency in Python, with experience in libraries like pandas, pyspark , or boto3.
- AWS Expertise: Hands-on experience with core AWS services for data engineering, such as:
- -AWS Glue for ETL/ELT.
- -S3 for storage.
- -Redshift or Athena for data warehousing and querying.
- -Lambda for serverless compute .
- -Kinesis or SNS/SQS for data streaming.
- -IAM Roles for security.
- Databases: Proficiency in SQL and experience with relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB) databases.
- Data Processing: Knowledge of big data frameworks (e.g., Hadoop, Spark) is a plus.
- DevOps: Familiarity with CI/CD pipelines and tools like Jenkins, Git, and CodePipeline .
- Version Control: Proficient with Git-based workflows.
- Problem Solving: Excellent analytical and debugging skills.
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking Finance, Telecom, and Healthcare domains. We help clients build world class products. We offer an array of services including Core Business Application Development, Artificial Intelligence Machine Learning, Big Data Analytics, Visualization Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile DevOps, Quality Assurance Test Automation.
Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always first time right .
- Problem Solving: Excellent analytical and debugging skills.
- Version Control: Proficient with Git-based workflows.
- DevOps: Familiarity with CI/CD pipelines and tools like Jenkins, Git, and CodePipeline .
- Data Processing: Knowledge of big data frameworks (e.g., Hadoop, Spark) is a plus.
- Databases: Proficiency in SQL and experience with relational (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB) databases.
- -IAM Roles for security.
- -Kinesis or SNS/SQS for data streaming.
- -Lambda for serverless compute .
- -Redshift or Athena for data warehousing and querying.
- -S3 for storage.
- -AWS Glue for ETL/ELT.
- AWS Expertise: Hands-on experience with core AWS services for data engineering, such as:
- Programming: Strong proficiency in Python, with experience in libraries like pandas, pyspark , or boto3.
- Professional Experience: 5+ years of experience in data engineering or a related field.
- Leverage CI/CD pipelines for deployment of data workflows on AWS.
- Automate repetitive data engineering tasks using Python scripts and frameworks.
- Work on data security best practices in compliance with organizational policies and regulations.
- Ensure data quality and consistency by implementing validation and governance practices.
- Monitor, troubleshoot, and enhance data workflows for performance and cost optimization.
- Collaborate with cross-functional teams to understand business requirements and translate them into scalable data solutions.
- Implement ETL/ELT processes to extract, transform, and load data from various sources into centralized repositories (e.g., data lakes or data warehouses).