Data Engineer II
- Zeta
- 3 - 5 years
- Bengaluru
- 3 months ago
- Email to a friend
- Report this job
Job Description
Data Pipeline Operations
Design, build, and maintain robust and scalable data pipelines to ingest, transform, and deliver structured and unstructured data from multiple sources.
Ensure high-quality data by implementing monitoring, validation, and error-handling processes.
Platform Engineering & Optimization
Create and update data models to represent the structure of the data.
Design, implement, and maintain database systems. Optimize database performance and ensure data integrity. Troubleshoot and resolve database issues.
Build and manage data warehouses for storage and analysis of large datasets.
Collaborate on data modeling, schema design, and performance optimization for large-scale datasets.
Data Quality and Governance: Implement and enforce data quality standards. Contribute to data governance processes and policies.
Scripting and Programming: Develop and automate data processes through programming languages (eg, Python, Java, SQL). Implement data validation scripts and error handling mechanisms.
Version Control: Use version control systems (eg, Git) to manage codebase changes for data pipelines.
Monitoring and Optimization: Implement monitoring solutions to track the performance and health of data systems. Optimize data processes for efficiency and scalability.
Cloud Platforms: Work with cloud platforms (eg, AWS, Azure, GCP) to deploy and manage data infrastructure. Utilize cloud-based services for data storage, processing, and analytics.
Security: Implement and adhere to data security best practices. Ensure compliance with data protection regulations.
Troubleshooting and Support: Provide support for data-related issues and participate in root cause analysis.
- Expertise in data modeling, database design, and data warehousing. Proficient in SQL and programming languages such as Python, Java, or Scala.
- Experience with big data technologies such as Hadoop, Spark, and Kafka.
- Cloud-native architecture expertise (AWS, GCP, or Azure), including containerization (Docker, Kubernetes) and infrastructure-as-code (Terraform, CloudFormation).
Experience and Qualifications
- bachelors/masters degree in engineering (computer science, information systems) with 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
- Excellent command on SQL and one or more programming languages, preferably Python or Java.
- Knowledge of Flink, Airflow, Apache Spark, DBT, Athena / Presto
- Experience working with Kubernetes.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Zeta Inc.Location(s): Bengaluru
Keyskills: Version control Data modeling Database design Data quality Analytics Monitoring SQL Python Core banking
Similar positions
Zeta
Zetais in the business of providing a full-stack, cloud-native, API-first neo-banking platform including a digital core and a payment engine for issuance of credit, debit, and prepaid products that enable legacy banks and new-age fintech institutions to launch modern retail and corporate fintech pro...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in