Data Engineer
- InfoVision Inc
- 5 - 7 years
- Pune
- 1 day ago
- Email to a friend
- Report this job
Job Description
Critical Skills to Possess:
- Advanced working knowledge and experience with relational and non-relational databases.
- Advanced working knowledge and experience with API data providers
- Experience building and optimizing Big Data pipelines, architectures, and datasets.
- Strong analytic skills related to working with structured and unstructured datasets.
- Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
- Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
- Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.
- Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
- Azure DevOps experience to deploy the data pipelines through CI/CD.
Preferred Qualifications:
- BS degree in Computer Science or Engineering or equivalent experience
Roles and Responsibilities
Roles and Responsibilities:
- You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
- You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
- You participate in early state design and feature definition activities.
- Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
- Responsible for creating reusable and scalable data pipelines.
- You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
- You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: InfoVision IncLocation(s): Pune
Keyskills: azure databricks python azure data lake data analysis data scala azure synapse event hub power bi azure data factory relational databases data engineering sql data bricks analytics spark data lake storage statistical modeling api big data etl communication skills
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in