Lead - Data Engineering
- Talworx
- 6 - 11 years
- Hyderabad
- 2 months ago
- Email to a friend
- Report this job
Job Description
Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.
About the Role:
The Team:
As a member of the Data Transformation team you will work on building ML powered products and capabilities to power natural language understanding, data extraction, information retrieval and data sourcing solutions for Intelligence and our clients. You will spearhead development of production-ready AI products and pipelines while leading-by-example in a highly engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.
Key Responsibilities
- Build production ready data acquisition and transformation pipelines from ideation to deployment
- Being a hands-on problem solver and developer helping to extend and manage the data platforms
- Apply best practices in data modeling and building ETL pipelines (streaming and batch) using cloud-native solutions
What Were Looking For:
- 5-7 years of professional software work experience
- Expertise in Python and Apache Spark
- OOP Design patterns, Test-Driven Development and Enterprise System design
- SQL (any variant, bonus if this is a big data variant)
- Linux OS (e.g. bash toolset and other utilities)
- Version control system experience with Git, GitHub, or Azure DevOps.
- Problem-solving and debugging skills
- Software craftsmanship, adherence to Agile principles and taking pride in writing good code
- Techniques to communicate change to non-technical people
Nice to have
- Core Java 17+, preferably Java 21+, and associated toolchain
- DevOps with a keen interest in automation
- Apache Avro
- Apache Kafka
- Kubernetes
- Cloud expertise (AWS and GCP preferably)
- Other JVM based languages - e.g. Kotlin, Scala
- C# - in particular .NET Core
Job Classification
Industry: FinTech / PaymentsFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: TalworxLocation(s): Hyderabad
Keyskills: Spark Data Warehousing Data Modeling Data Platform Python Data Pipeline Batch Cloud ETL
Similar positions
Talworx
Talworx is a recruitment consulting firm, we are hiring for our client which is a multinational Software Product firm, Know more aobut us at https://www.linkedin.com/company/thetalentworx
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in