Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Data Engineer @ Datametica

Home > Software Development

 Senior Data Engineer

Job Description

Job DescriptionKey Responsibilities

  • Attend requirements gathering workshops, design meetings, and status review meetings
  • Experience in Solution Design for the data engineer model to build and implement respective projects on-premises and on the cloud
  • To be able to benchmark systems, analyses system bottlenecks and propose solutions to eliminate them
  • Lead the development team, construct, test, maintain and run Sprints for the development and roll-out of functionalities
  • Data Analysis, Code Development experience, ideally in ETL (Ab-Initio, Informatica, DataStage, Teradata, Alteryx, etc.) and/or Big Data (Scala, Spark, Hive, Hadoop, Python/Java, PySpark) Data Warehousing
  • Able to help programmers and leadership (Architects / Technical Project Managers) in the design, planning, and governance of implementing projects of any kind

Qualifications

  • Bachelor's or Master's degree in Computer Science or related field
  • 5 plus years of hands-on experience in IT Software Development Industry
  • Strong problem-solving and analytical skills
  • Data Governance and Data  Modeling experience
  • Implement and deploy high-performance, custom applications at scale on Hadoop
  • Strong experience with designing, creating, and maintaining Scala-based applications
  • Strong experience over Hadoop ecosystem (Spark/Pyspark, Hive, Sqoop, ect.) based projects 
  • Extract Transform Load (ETL) expertise
  • Experience with cloud-based data warehousing, cloud data pipeline and data management
  • Translate complex functional and technical requirements into detailed design and development
  • Good to have hands-on experience in Cloud Native Programming
  • Experience GCP services like Big Query, Dataflow, Dataproc, Composer, Streaming, Pub-Sub, etc.
  • Good to have experience over other cloud services - Azure (Data Factory, Data Bricks, Synapse etc.) / AWS (EMR, Glue, Athena, Redshift etc.) / Snowflake
  • Proficient with agile/scrum
  • Experience in architecting and implementing large-scale data solutions is a plus
  • Knowledge of Hadoop, Teradata, Oracle, and other database systems is a plus
  • Knowledge of any one of the tools Ab-Initio / Informatica / DataStage / Teradata / Alteryx / etc., good to have multiple (more than one) ETL tools hands-on

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Datametica
Location(s): Pune

+ View Contactajax loader


Keyskills:   GCP Hadoop SQL Hive Spark

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Principal Software Development Engineer - SaaS Continuity Engineering

  • Oracle
  • 8 - 13 years
  • Kolkata
  • 20 hours ago
₹ Not Disclosed

Senior Staff Software Engineer, AI Data Trust

  • Google
  • 2 - 4 years
  • Bengaluru
  • 24 hours ago
₹ Not Disclosed

Cloud Engineer, AI

  • Google
  • 1 - 4 years
  • Noida, Gurugram
  • 1 day ago
₹ Not Disclosed

Lead Software Engineer

  • Capgemini
  • 5 - 8 years
  • Hyderabad
  • 1 day ago
₹ Not Disclosed

Datametica

DataMetica is the leader in Big Data architecture, Advanced Analytics and Big Data Operations focused on serving large global companies. We provide a fast and reliable integration of Hadoop and related technologies into enterprise operations. Our team is comprised of highly experienced Hadoop, noSQL...