Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Software Engineer (Pyspark/Python) @ Impetus Technologies

Home > Software Development

 Lead Software Engineer (Pyspark/Python)

Job Description

  • 5-7 years of good hands on exposure with Big Data technologies - pySpark (Data frame and SparkSQL), Hadoop, and Hive
  • Good hands on experience of python and Bash Scripts
  • Good understanding of SQL and data warehouse concepts
  • Strong analytical, problem-solving, data analysis and research skills
  • Demonstrable ability to think outside of the box and not be dependent on readily available tools
  • Excellent communication, presentation and interpersonal skills are a must
Good to have:
  • Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. IAM, Glue, EMR, RedShift, S3, Kinesis)
  • Orchestration with Airflow and Any job scheduler experience
  • Experience in migrating workload from on-premise to cloud and cloud to cloud migrations
  • Develop efficient ETL pipelines as per business requirements, following the development standards and best practices.
  • Perform integration testing of different created pipeline in AWS env.
  • Provide estimates for development, testing & deployments on different env.
  • Participate in code peer reviews to ensure our applications comply with best practices.
  • Create cost effective AWS pipeline with required AWS services i.e S3,IAM, Glue, EMR, Redshift etc.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Technical Lead
Employement Type: Full time

Contact Details:

Company: Impetus Technologies
Location(s): Noida, Gurugram

+ View Contactajax loader


Keyskills:   Data analysis Interpersonal skills development testing Analytical Integration testing Cloud big data AWS SQL Python

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Senior Embedded Software Engineer, Silicon Security

  • Google
  • 3 - 6 years
  • Bengaluru
  • 8 days ago
₹ Not Disclosed

Staff Engineer

  • Uplers
  • 8 - 10 years
  • Hyderabad
  • 15 hours ago
₹ Not Disclosed

Staff Engineer

  • Uplers
  • 8 - 10 years
  • Pune
  • 23 hours ago
₹ Not Disclosed

Staff Engineer

  • Uplers
  • 8 - 10 years
  • Chennai
  • 1 day ago
₹ Not Disclosed

Impetus Technologies

Impetus Technologies Impetus Technologies is a software products and services company focused on creating powerful and intelligent enterprises through deep data awareness, data integration and advanced data analytics. Our products and services are designed to empower the real-time data driven en...