Technical /Professional Skills (Please provide at least 3)
Databricks
Python / Scala / Spark / PySpark
SQL and RDBMS
Minimum three years of experience In data analytics field
Experience with Azure/AWS Databricks
Experience in building and optimizing data pipelines, architectures and data sets
Excellent experience in Scala or Python, PySpark and SQL
Ability to troubleshoot and optimize complex queries on the Spark platform
Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques
Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
Hands on experience in performance tuning and optimizing code running in Databricks environment
Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full time