Senior Data Engineer @ ThoughtFocus

QUALIFICATIONS

• Bachelors or Masters in Computer Science, Information Systems, Statistics, or related field.
• 5+ years of experience in data engineering with strong software development foundations.
• 3+ years of hands-on experience with Azure Data Factory, ADLS Gen 2, Databricks (database/warehouse design), and SQL Server.
• Proficiency in Python, SQL, Spark
• Experience with ETL orchestration tools (Databricks Workflows, Airflow, Dagster, Prefect, etc.).
• Expertise in REST APIs, web services, and data quality validation.
• Strong analytical skills with a meticulous approach to data accuracy.

• Azure Data Stack (Databricks, SQL Server, Data Factory, ADLS Gen 2)
• Python programming
• Version Control (Git, Azure DevOps)
• Infrastructure as Code
• Power BI and PowerApps
• REST APIs and Web services

• Manage Azure Databricks, Azure SQL Server, Azure Data Factory, Power BI, and PowerApps environments, ensuring scalability and reliability.
• Develop and optimize data pipelines, implementing robust and fault-tolerant systems for data ingestion and processing.
• Establish and enforce data quality standards, leveraging validation checks and automated testing frameworks.
• Analyze data patterns, rigorously evaluating data assets to detect logical inconsistencies and anomalies.
• Document data models, pipelines, and dictionaries for both technical and non-technical stakeholders.
• Collaborate with stakeholders to understand analytical needs and design scalable, well-structured data solutions.

• You love working with data and enjoy building high-impact solutions.
• You have a meticulous eye for detail and proactively address data quality issues.
• You translate complex business needs into structured, scalable data models.
• You take pride in creating reliable, trustworthy data assets that drive decision-making