Consultant - Data Engineer - Azure
- Skyleaf Consultants
- 3 to 5 Yrs
- Bengaluru
- 2 years ago
- Email to a friend
- Report this job
Job Description
Job Title: Consultant (Azure - Data Engineer)
Job Location: Bangalore
Job Overview: Consultants at AKIRA are responsible for assisting our clients with building, implementing and supporting end-to-end solutions. Being intricately involved with the project lead/delivery manager, they are tasked with designing, modeling, and executing data models to support end-users with analytics and reporting. Consultants must be proficient in designing ETL functions and building data pipelines between on-premise, cloud applications and various data sources.
Roles & Responsibilities
Will be responsible for onboarding tables to the data lake and building pipelines for data ingestion using Python/PySpark. Building data models and tables on Athena, which will be used for reporting. Create and maintain workflow/technical documents for all the development activities. Gather business requirements from business stakeholders and deliver a solution. Participate in weekly status meetings to provide updates to stakeholders and provide a strategic plan for upcoming tasks.
Specific skills required are:
Must have
Experience of working in solutions involving some of the Data Engineering related services of Azure like, ADF, Data lake, Databricks, ADW, AAS, Azure SQL DB, Azure functions and Data bricks.
Knowledge of batch and streaming data architectures
Experience using big data technologies (Hadoop, Hive, HBase, Spark etc.)
Strong knowledge of SQL (MSSQL or MySQL or PostgreSQL or Presto).
Demonstrated strength in ETL development, and data warehousing
Hands-on experience in using Python/PySpark for data engineering tasks.
Good knowledge of data lake optimization and partitioning.
Good knowledge of file formats like parquet, CSV and Hadoop file systems.
Good knowledge of cron job scheduling and debugging.
Good to have
ADF or any ETL, Visualization/reporting technology.
Experience in working in Linux environments, Snowflake.
Experience in working in Retail or FMCG.
Basic understanding of Ambari and Sqoop
Experience working in Alation
General Requirements
Bachelors or Masters Degree is imperative
2-6 Years of experience in the Data Engineering domain
Experience in all stages of DE project work (requirements and logical design, physical design, implementation, testing and deployment)
Excellent communication and interpersonal skills
Experience communicating with senior management as well as with colleagues from engineering, analytics, and business backgrounds
Capable of performing under minimal supervision, multi-tasking, meeting deadlines as an individual contributor, and coaching a team.
Company Introduction
AKIRA is a bootstrapped Data & Analytics Services company driven by technology excellence, consultative practices and focus on building technology agnostic customer solutions helping organizations realize business value through data. We have grown over 3 times in the past 2 years across business, headcount and number of clients we serve once we started focusing on growing up.
AKIRA is a growth engine, where we provide great opportunities to all our team members to extract as much learning and satisfaction for the work they deliver. We will double ourselves in the coming 6-9 months, and want to be a great place to work shortly.
Skills:
Data Engineering,Azure
Employement Category:
Employement Type: Full timeIndustry: Recruitment Services Role Category: IT Operations / EDP / MIS Functional Area: Not ApplicableRole/Responsibilies: Consultant - Data Engineer - AzureContact Details:
Company: Skyleaf ConsultantsLocation(s): Bengaluru
Keyskills: data engineering etl azure talend sql
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in