Apache Airflow/Consultant Specialist
- SBC
- 3 - 7 years
- Hyderabad
- 1 month ago
- Email to a friend
- Report this job
Job Description
Some careers shine brighter than others.
If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist.
In this role, you will:
- Able to Evaluate and provide technical solutions to solve a variety of complex and interdependent processes.
- Ensure data quality and accuracy by implementing data quality checks, data contracts and data governance processes.
- Collaborate with software teams and business analysts to understand their data requirements and deliver quality fit for purpose data solutions
Requirements
To be successful in this role, you should meet the following requirements:
- Design, develop, and maintain data pipelines and workflows using Apache Airflow on GCP.
- Integrate and manage data from various sources into BigQuery and GCS.
- Implement data transformations, aggregations, and enrichment processes.
- Monitor and optimize the performance of data pipelines and workflows.
- Ensure data quality and consistency across all data pipelines.
- Expert in Python application development using various libraries such as Pandas.
- Implement and maintain GCP monitoring tools to track the performance and health of data pipelines.
- Troubleshoot and resolve issues related to data pipelines and workflows.
- Create and maintain technical documentation for data pipelines and workflows.
- Has experience in working with Agile methodology.
- Experience with CI/CD pipelines and DevOps practices.
- Proficient in SQL. should be able to write complex queries.
Job Classification
Industry: Consumer Electronics & AppliancesFunctional Area / Department: Engineering - Software & QARole Category: DevOpsRole: Release ManagerEmployement Type: Full timeContact Details:
Company: HsbcLocation(s): Hyderabad+ View Contact
Keyskills: GCP data governance Data quality Application development Agile methodology Apache Financial services SQL Technical documentation Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in