Senior Data Engineer
- Recruiter Wings
- 4 to 8 Yrs
- Bengaluru
- 2 years ago
- Email to a friend
- Report this job
Job Description
:We are seeking a highly experienced Senior Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining a multi-tenant data stack that efficiently ingests, stores, and retrieves data for our clients. The successful candidate should have extensive experience in data modeling, ETL processes, data warehousing, and building data pipelines. In this role, you will lead a team of data engineers and work closely with data scientists and software engineers to ensure that data is collected, processed, and analyzed efficiently and accurately.
Responsibilities:
- Lead the design, development, and optimization of a multi-tenant data stack using managed stacks and services like AWS
- Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
- Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
- Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
- Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
- Develop and maintain automated testing frameworks to ensure data quality and accuracy
- Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
- Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
- Continuously improve processes and systems to increase efficiency and scalability
- Lead and mentor a team of data engineers
Requirements:
- Bachelor's degree in Computer Science, Mathematics, or a related field
- At least 7 years of experience in data engineering or a related field
- Proven experience leading a team of data engineers
- Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
- Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
- Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
- Experience with data visualization tools such as AWS QuickSight or Tableau Server
- Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
- Familiarity with distributed computing systems such as Hadoop and Spark
- Strong problem-solving and analytical skills
- Ability to work independently and in a team environment
- Excellent written and verbal communication skills
- Strong attention to detail and ability to multi-task
If you are a highly experienced Senior Data Engineer with a proven track record of designing, developing, and maintaining a multi-tenant data stack with efficient ingestion, storage, and retrieval using AWS managed stacks and services, and leading a team of data engineers, we encourage you to apply for this exciting opportunity.
Employement Category:
Employement Type: Full timeIndustry: IT - Software Role Category: Application Programming / Maintenance Functional Area: Not ApplicableRole/Responsibilies: Senior Data EngineerContact Details:
Company: Recruiter WingsLocation(s): Bengaluru
Keyskills: apache spark python mysql etl aws hadoop postgresql spark sql
Similar positions
Recruiter Wings
\\\\r\\\\nInfosys is a global leader in next-generation digital services and consulting. We enable clients in 45 countries to navigate their digital transformation. With over three decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in