Azure Data Engineer
- Speridian Technologies
- 8 - 10 years
- Kochi
- 2 months ago
- Email to a friend
- Report this job
Job Description
Role & responsibilities
- Senior Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)
- Collaborate with various stakeholders, and ensuring the efficient processing, storage, and retrieval of large volumes of data
- Technical Expertise and Responsibilities
- Design, build, and maintain scalable and reliable data pipelines.
- Should be able to design and build solutions in Azure data factory and Databricks to extract, transform and load data into different source and target systems.
- Should be able to design and build solutions in SSIS
- Should be able to analyze and understand the existing data landscape and provide recommendations/innovative ideas for rearchitecting / optimizing / streamlining to bring efficiency and scalability.
- Must be able to collaborate and effectively communicate with onshore counterparts to address technical gaps, requirement challenges, and other complex scenarios.
- Monitor and troubleshoot data systems to ensure high performance and reliability.
- Should be highly analytical and detail-oriented with extensive familiarity with database management principles.
- Optimize data processes for speed and efficiency.
- Ensure the data architecture supports business requirements and data governance policies.
- Define and execute the data engineering strategy in alignment with the companys goals.
- Integrate data from various sources, ensuring data quality and consistency.
- Stay updated with emerging technologies and industry trends.
- Understand the big picture business process utilizing deep knowledge in banking industry and translate them to data requirements.
- Enabling and running data migrations across different databases and different servers
- Perform thorough testing and validation to support the accuracy of data transformations and data verification used in machine learning models.
- Analyze data and different systems to define data requirements.
- Should be well versed with Data Structures & algorithms.
- Define data mapping working along with business and digital team and data team.
- Data pipeline maintenance/testing/performance validation
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Analyze and identify gaps on data needs and work with business and IT to bring in alignment on data needs.
- Troubleshoot and resolve technical issues as they arise.
- Optimize data flow and collection for cross-functional teams.
- Work closely with Data counterparts at onshore, product owners, and business stakeholders to understand data needs and strategies.
- Collaborate with IT and DevOps teams to ensure data infrastructure aligns with overall IT architecture.
- Implement best practices for data security and privacy.
- Drive continuous improvement initiatives within the data engineering function
- Optimize data flow and collection for cross-functional teams.
- Understand impact of data conversions as they pertain to servicing operations
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Speridian TechnologiesLocation(s): Kochi+ View Contact
Keyskills: Azure Data Factory Azure Synapse Data Engineering Azure Databricks Azure Data Lake
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Speridian Technologies
As a global business and technology solutions provider, Speridian and its 1,000+ business and technology experts help clients modernize their businesses through Digital Transformation. Headquartered in Albuquerque, NM, with regional offices across the globe, Speridian has been at the forefront of CR...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in