Job Description
Pipeline Development: Ability to design, build, and optimize complex SnapLogic pipelines for various applications, including ETL, real-time integrations, and API management. Experience in error handling and ensuring data quality within pipelines.
Snaps Expertise: Familiarity with essential Snap packs, including REST/SOAP Snaps, File Operations Snaps, Transformation Snaps, JMS Snap Pack, Amazon Simple Queue Service (SQS) Snap Pack, and Cloud Integrations Snaps (AWS, Azure, GCP). Proficient in utilizing Custom Snaps or extensions for tailored integrations.
Integration Design: Experience in integrating cloud-based applications with on-premise systems and data lakes (e.g., AWS S3, Delta Lake). Knowledge of real-time versus batch integration patterns and performance optimization.
Debugging and Optimization: Skilled in debugging and troubleshooting pipelines, utilizing SnapLogics Dashboard and Pipeline Execution Statistics. Proficiency in enhancing pipeline performance through efficient snap sequencing and data stream management.
Versioning and Deployment: Experience in organizing SnapLogic projects, managing pipeline versioning, and promoting changes across environments (development, QA, production). Familiarity with SnapLogics Pipeline Lifecycle Management (PLM).
Who you are? - A minimum of 2 to 5 years of experience in Data Engineering.
- Strong expertise in the AWS Cloud Platform.
- Practical experience with ETL tools, particularly SnapLogic.
Mandatory Skills: ETL - Snaplogic tool, AWS, Python, Data Lake. Desirable Skills (Optional): Java, Shell Scripting, Spark, Pentaho Data Integration, or any other ETL tools, SAP connectors. The ideal candidate for this position should possess:
- Data Integration: Proficiency in at least one ETL tool such as SnapLogic, Pentaho Kettle.
- AWS Cloud Platform: Experience with Redshift, S3, AWS Glue, and Athena.
- Data Processing: good skills in Python.
- Databases: Familiarity with MySQL, PostgreSQL, or Redshift.
- Programming Languages: Knowledge of Shell Scripting (optional).
- Technologies and Frameworks: Expertise in AWS
Job Classification
Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Head - Data Science
Employement Type: Full time
Contact Details:
Company: Syncron
Location(s): Hyderabad
Keyskills:
Supply chain
Service management
SAP
MySQL
Shell scripting
Debugging
Data processing
Data quality
Troubleshooting
Analytics