Data Pipeline Engineer
- Primetrace
- 4 - 9 years
- Noida, Gurugram
- 27 days ago
- Email to a friend
- Report this job
Job Description
About this role
Aladdin Data is at the heart of Aladdin and increasingly the ability to consume, store, analyze and gain insight from data has become a key component of our competitive advantage. The DOE team is responsible for the data ecosystem within BlackRock. Our goal is to build and maintain a leading-edge data platform that provides highly available, consistent data of the highest quality for all users of the platform, notably investors, operations teams and data scientists. We focus on evolving our platform to deliver exponential scale to the firm, powering the future growth of Aladdin.
Data Pipeline Engineers at BlackRock get to experience working at one of the most recognized financial companies in the world while being part of a software development team responsible for next generation technologies and solutions. Our engineers design and build large scale data storage, computation and distribution systems. They partner with data and analytics experts to deliver high quality analytical and derived data to our consumers.
We are looking for data engineers who like to innovate and seek complex problems. We recognize that strength comes from diversity and will embrace your unique skills, curiosity, drive, and passion while giving you the opportunity to grow technically and as an individual. We are committed to open source and we regularly give our work back to the community. Engineers looking to work in the areas of orchestration, data modeling, data pipelines, APIs, storage, distribution, distributed computation, consumption and infrastructure are ideal candidates.
Responsibilities
Data Pipeline Engineers are expected to be involved from inception of projects, understand requirements, architect, develop, deploy, and maintain data pipelines (ETL / ELT). Typically, they work in a multi-disciplinary squad (we follow Agile!) which involves partnering with program and product managers to expand product offering based on business demands. Design is an iterative process, whether for UX, services or infrastructure. Our goal is to drive up user engagement and adoption of the platform while constantly working towards modernizing and improving platform performance and scalability.
Deployment and maintenance require close interaction with various teams. This requires maintaining a positive and collaborative working relationship with teams within DOE as well as with wider Aladdin developer community. Production support for applications is usually required for issues that cannot be resolved by operations team. Creative and inventive problem-solving skills for reduced turnaround times are highly valued.
Preparing user documentation to maintain both development and operations continuity is integral to the role.
And Ideal candidate would have
- At least 4+ years experience as a data engineer
- Experience in SQL, Sybase, Linux is a must
- Experience coding in two of these languages for server side/data processing is required Java, Python, C++
- 2+ years experience using modern data stack (spark, snowflake, Big Query etc.) on cloud platforms (Azure, GCP, AWS)
- Experience building ETL/ELT pipelines for complex data engineering projects (using Airflow, dbt, Great Expectations would be a plus)
- Experience with Database Modeling, Normalization techniques
- Experience with object-oriented design patterns
- Experience with dev ops tools like Git, Maven, Jenkins, Gitlab CI, Azure DevOps
- Experience with Agile development concepts and related tools
- Ability to trouble shoot and fix performance issues across the codebase and database queries
- Excellent written and verbal communication skills
- Ability to operate in a fast-paced environment
- Strong interpersonal skills with a can-do attitude under challenging circumstances
- BA/BS or equivalent practical experience
Skills that would be a plus
- Perl, ETL tools (Informatica, Talend, dbt etc.)
- Experience with Snowflake or other Cloud Data warehousing products
- Exposure with Workflow management tools such as Airflow
- Exposure to messaging platforms such as Kafka
- Exposure to NoSQL platforms such as Cassandra, MongoDB
- Building and Delivering REST APIs
Our benefits .
Our hybrid work model
.
About BlackRock
.
This mission would not be possible without our smartest investment - the one we make in our employees. It s why we re dedicated to creating an environment where our colleagues feel welcomed, valued and supported with networks, benefits and development opportunities to help them thrive.
For additional information on BlackRock, please visit @blackrock | Twitter: @blackrock | LinkedIn: www.linkedin.com / company / blackrock
BlackRock is proud to be an Equal Opportunity Employer. We evaluate qualified applicants without regard to age, disability, family status, gender identity, race, religion, sex, sexual orientation and other protected attributes at law.
Job Classification
Industry: Financial ServicesFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: PrimetraceLocation(s): Noida, Gurugram+ View Contact
Keyskills: C++ Linux Production support Data modeling Perl Informatica Open source SyBase SQL Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Primetrace
Preqin was founded in 2003 and has since grown into a leading provider of financial data and information for the alternative assets industry. Clients rely on Preqins extensive database to perform due diligence, benchmark performance, conduct market research, and identify investment opportunities. ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in