Data Quality Engineer
- Smartavya Analytica
- 4 - 6 years
- Pune
- 25 days ago
- Email to a friend
- Report this job
Job Description
Job Summary
We are looking for a Data Quality Engineer who will safeguard the integrity of our cloud-native data assets. You will design and execute automated and manual data-quality checks across structured and semi-structured sources on Azure and GCP, validating that our data pipelines deliver accurate, complete, and consistent datasets for analytics, reporting, and AI initiatives.
Key Responsibilities
- Define, build, and maintain data-quality frameworks that measure accuracy, completeness, timeliness, consistency, and validity of data ingested through ETL/ELT pipelines.
- Develop automated tests using SQL, Python, or similar tools; supplement with targeted manual validation where required.
- Collaborate with data engineers to embed data-quality gates into CI/CD pipelines on Azure Data Factory / Synapse / Fabric and GCP Dataflow / Cloud Composer.
- Profile new data sources (structured and semi-structuredJSON, Parquet, Avro) to establish baselines, detect anomalies, and recommend cleansing or transformation rules.
- Monitor data-quality KPIs and publish dashboards/alerts that surface issues to stakeholders in near-real time.
- Conduct root-cause analysis for data-quality defects, propose remediation strategies, and track resolution to closure.
- Maintain comprehensive documentation of test cases, data-quality rules, lineage, and issue logs for audit and governance purposes.
- Partner with data governance, security, and compliance teams to ensure adherence to regulatory requirements
Must-Have Skills
- 4-6 years of experience in data quality, data testing, or data engineering roles within cloud environments.
- Hands-on expertise with at least one major cloud data stackAzure (Data Factory, Synapse, Databricks/Fabric) or GCP (BigQuery, Dataflow, Cloud Composer).
- Strong SQL skills and proficiency in a scripting language such as Python for building automated validation routines.
- Solid understanding of data-modeling concepts (dimensional, 3NF, data vault) and how they impact data-quality rules.
- Experience testing semi-structured data formats (JSON, XML, Avro, Parquet) and streaming/near-real-time pipelines.
- Excellent analytical and communication skills; able to translate complex data issues into clear, actionable insights for technical and business stakeholders.
Nice-to-Have Skills
- Familiarity with BI/reporting tools (Power BI, Looker, Tableau) for surfacing data-quality metrics.
Preferred Certifications
- Google Professional Data Engineer or Associate Cloud Engineer (GCP track) - OR - Microsoft Certified: Azure Data Engineer Associate
Education
- Bachelors or Masters degree in Computer Science, Information Systems, Engineering, Mathematics, or a related field. Comparable professional experience will also be considered.
Why Join Us?
You will be the guardian of our datas trustworthiness, enabling decision-makers to rely on insights with confidence. If you are passionate about building automated, scalable data-quality solutions in a modern cloud environment, wed love to meet you.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Quality Assurance and TestingRole: Data / Big Data Testing EngineerEmployement Type: Full timeContact Details:
Company: Smartavya AnalyticaLocation(s): Pune
Keyskills: data testing BigQuery Power BI JSON Tableau data engineering SQL data quality Synapse XML Databricks Dataflow Python
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in