Data Engineer
- Ducen
- 4 - 10 years
- Kolkata
- 1 month ago
- Email to a friend
- Report this job
Job Description
We are seeking a talented and motivated Date Engineer to join our dynamic development team You will collaborate with cross-functional teams to create efficient, scalable, and high-performing software solutions.
Key Responsibilities:
- Design and Implement Data Pipelines: Create, deploy, and manage robust data pipelines using Azure Data Factory and other ETL tools to process structured and unstructured data.
- Data Integration: Integrate data from multiple sources (on-premises, cloud) into Azure-based data lakes, data warehouses, and analytics solutions.
- Data Modeling: Design and implement data models and schemas to ensure effective data management and accessibility.
- Optimize Data Solutions: Continuously improve data pipelines and data solutions by optimizing performance, scalability, and reliability.
- Data Security and Governance: Implement data security policies and practices to ensure the confidentiality, integrity, and availability of data in the cloud.
- Collaboration: Work with analysts, and other engineers to ensure data availability, reliability, and accessibility for business intelligence.
- Monitor and Maintain Data Systems: Monitor the performance of data pipelines and systems, providing regular updates and resolving any issues related to data processing and storage.
- Azure Services Utilization: Utilize Azure tools such as Azure SQL Data Warehouse, Azure Blob Storage, Azure Databricks, and Azure Synapse Analytics to build and maintain data systems.
- Strong experience in Azure Data Bricks, Azure Data Factory and Pyspark
- Experience in Data Fabricks
Skills & Qualifications:
- Experience: 3+ years of experience as a Data Engineer with hands-on experience in working with Azure data platforms and services.
- Azure Technologies: Strong knowledge of Azure services, including Azure Data Factory, Azure SQL Database, Azure Data Lake, Azure Blob Storage, Azure Synapse Analytics, and Azure Databricks.
- ETL Development: Proficiency in developing ETL processes and data integration workflows.
- SQL: Solid understanding and experience in writing complex SQL queries for data manipulation and transformation.
- Programming: Proficiency in languages such as PySpark, SQL, or Scala to create data solutions.
- Data Warehousing: Experience in building and maintaining data warehouses and/or data lakes.
- Problem-Solving Skills: Ability to troubleshoot and optimize complex data systems.
- Communication: Strong verbal and written communication skills for effectively working with cross-functional teams.
- Experience handling a team of 4+ Data Engineers
- Excellent communication & Articulation skills
Preferred Qualifications :
- Certifications: Azure Data Engineer Associate certification (DP-200, DP-201) or equivalent is a plus.
- Experience with BI tools: Familiarity with Power BI or other data visualization tools.
What we provide:
- Competitive Salary
- Performance based Variable Pay
- Health, Vision, Dental, and Life Insurance
- Comprehensive Employee Wellness Plan
- Retirement plan
- Paid Holidays and Vacation Time Accrual
- Encouraging and highly energetic environment
- Personal and Professional Growth Opportunities
Candidate Privacy Policy
Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, Orion, we or us ) are committed to protecting your privacy. This (orioninc.com) ( Notice ) explains:
- What information we collect during our application and recruitment process and why we collect it;
- How we handle that information; and
- How to access and update that information.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: DucenLocation(s): Kolkata+ View Contact
Keyskills: Business transformation Data management Data modeling Data processing Life sciences Business intelligence Analytics Financial services Automotive SQL
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Ducen
Ducen IT Private Limited Ducen is a CMMI Level 3 and Microsoft Partner (ISO-9001:2015 Certified) Information Technology Company. Ducen IT empower businesses across multiple industries with its powerful analytics platform and end-to-end IT services - arming decision makers with actionable insigh...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in