Data Engineer - Databricks, Snowflake, Fabric
- Usxi Group
- 5 - 9 years
- Chennai
- 22 days ago
- Email to a friend
- Report this job
Job Description
USXI is Looking for Big Data Developers that will work on the collecting, storing, processing, and analyzing of huge sets of data. The Data Developers must also have exceptional analytical skills, showing fluency in the use of tools such as MySQL and strong Python, Shell, Java, PHP, and T-SQL programming skills. The candidate must also be technologically adept, demonstrating strong computer skills. Additionally, you must be capable of developing databases using SSIS packages, T-SQL, MSSQL, and MySQL scripts.
The candidate will also have an ability to design, build, and maintain the businesss ETL pipeline and data warehouse. The candidate will also demonstrate expertise in data modeling and query performance tuning on SQL Server, MySQL, Redshift, Postgres or similar platforms.
Key responsibilities will include:
Develop and maintain data pipelines
Design and implement ETL processes
Hands on experience on Data Modeling Design conceptual, logical and physical data models with type 1 and type2 dimensions.
Platform Expertise: Leverage Microsoft Fabric, Snowflake, and Databricks to optimize data storage, transformation, and retrieval processes.
Knowledge to move the ETL code base from On-premise to Cloud Architecture
Understanding data lineage and governance for different data sources
Maintaining clean and consistent access to all our data sources
Hands on experience to deploy the code using CI/CD pipelines
Assemble large and complex data sets strategically to meet business requirements
Enable business users to bring data-driven insights into their business decisions through reports and dashboards
Required Qualifications:
Hands on experience in big data technologies including Scala or Spark (Azure Databricks preferable), Hadoop, Hive, HDFS.
Python, Java & SQL
Knowledge of Microsofts Azure Cloud
Experience and commitment to development and testing best practices.
DevOps experience with continuous integration/delivery best-practices, technologies and tools.
Experienced deploying Azure SQL Database, Azure Data Factory and well-acquainted with other Azure services including Azure Data Lake and Azure ML
Experience implementing REST API calls and authentication
Experienced working with agile project management methodologies
Computer Science Degree/Diploma
Microsoft Certified: DP203 - Azure Data Engineer Associate
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Usxi GroupLocation(s): Chennai
Keyskills: Snowflake Data Bricks Python SQL Airflow Pyspark ETL Fabric
Similar positions
Usxi Group
We are a Canadian based ITES company having more than a decade of services to Oil and natural gas industry Customers across the globe having offshore unit in Chennai.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in