Role Overview
As a Software Engineer you will design, develop, and maintain software systems. This role involves both creative and analytical skills to solve complex problems and create efficient, reliable software. You will use your expertise in requirements analysis, programming languages, software development methodologies, and tools to build and deliver software products that meet the needs of businesses, organizations, or end-users. You will work with other engineers, product managers and delivery leads, to design systems, determine functional and non-functional needs and implement solutions accordingly. You should be ready to work independently as well as in a team.
What will you do in this role
- Data Pipeline Development: Design, implement, and optimize scalable data pipelines and ETL processes to ensure seamless data flow from various sources to data warehouses.
- Data Architecture: Collaborate with data architects to create and maintain a robust data architecture that meets business needs while ensuring data quality and integrity.
- Database Management: Manage and optimize relational and non-relational databases, ensuring efficient data storage and retrieval.
- Data Transformation: Develop and apply data transformation techniques to prepare data for analysis and reporting.
- Collaboration with Teams: Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and provide support for analytics initiatives.
- Monitoring and Maintenance: Monitor existing data systems and pipelines for performance and reliability; troubleshoot and resolve issues as they arise.
- Documentation: Create and maintain documentation related to data systems, processes, and workflows.
Data Governance: Ensure compliance with data governance policies, including data security and data privacy regulations.
What should you have
Education: Bachelor s degree in Computer Science, Information Technology, Data Science, or a related field.
Experience: Minimum of 3-5 years of experience in data engineering or related roles.
Technical Skills:
o Proficient in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
o Experience with big data technologies such as Hadoop, Spark, or Kafka.
o Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data services (e.g., Redshift, BigQuery)
o Familiarity with DataBricks, dbt, AirFlow, MuleSoft Anypoint Platform , Rest API
o Strong coding skills in programming languages such as Python, Java.
Data Modeling: Knowledge of data modelling techniques and concepts. (Star/Dimensional/Normalized)
Analytical Skills: Strong problem-solving skills and the ability to analyze complex data sets.
Communication: Excellent verbal and written communication skills, with the ability to collaborate effectively with cross-functional teams.
Agile Methodologies: Experience with Agile development methodologies is a plus.
Capability to quickly learn modern technologies and adapt to evolving project requirements .
Experience with CI/CD
Preferred Qualifications:
Knowledge of data visualization tools (e.g., Tableau, Power BI).
Experience with machine learning concepts and frameworks.
Knowledge of modern data architecture patterns like data lakehouse, data mesh, or data fabric.
Experience with Collibra or similar data catalog tools for metadata management and governance and Immuta for access control
Experience in the healthcare or Pharma preferred.