Senior Associate Data Engineer @ Ignatiuz Software

• Design, deploy, and manage the data warehouse to support efficient storage and retrieval of large volumes of data.
  
• Ensure the data warehouseu2019s performance, security, and scalability meet business requirements.
  
• Build robust and reliable data pipelines to extract data from diverse sources (databases, APIs, log files, etc.).
  
• Transform, clean, and enrich raw data to ensure its suitability for analysis.
  
• Develop Extract, Transform, Load (ETL) processes to efficiently move data from source systems to the data warehouse.
  
• Monitor and optimize ETL jobs for performance and reliability.
  
• Integrate data warehouse solutions with ERP platforms and other cloud-based systems to streamline data exchange and enhance data visibility.
  
• Design and implement data models to facilitate efficient data querying and analysis.
  
• Collaborate with data scientists and analysts to ensure data models meet analytical requirements.
  
• Implement data quality checks and data governance processes to maintain data accuracy and consistency.
  
• Ensure compliance with data privacy and security regulations.
  
• Continuously monitor and fine-tune the data infrastructure for optimal performance and cost-efficiency.
  
• Identify and resolve bottlenecks in data processing and storage.
  
• Maintain comprehensive documentation of data pipelines, ETL processes, and data models.
  
• Collaborate with cross-functional teams to understand data requirements and deliver data solutions that meet business needs.

Requirements

• Bachelors or Masters degree in computer science, Data Engineering, or related field.
  
• Proven experience as a Data Engineer, with hands-on experience in managing data warehouses, developing data pipelines, building ETL processes, integrating with ERP platforms, and creating data models.
  
• Proficient in SQL and one or more programming languages (e.g., Python, Java, Scala) for data manipulation and scripting.
  
• Familiarity with cloud-based data warehousing platforms (e.g., Amazon Redshift, Google BigQuery, Snowflake) and related services.
  
• Strong analytical and problem-solving skills, with keen attention to detail.
  
• Excellent communication and teamwork abilities, with the capacity to work effectively in a collaborative environment.