Your browser does not support javascript! Please enable it, otherwise web will not work for you.

PySpark- Senior Developer @ Virtusa

Home > DBA / Data warehousing

 PySpark- Senior Developer

Job Description



 : Key responsibilities include the following:
  • Develop and maintain scalable data pipelines using  Pyspark  and proven experience as  developer with expertise in PySpark. 
  • Good to have knowledge on Ab Initio.
  • Experience with distributed computing and  parallel processing .
  • Proficiency in  SQL  and experience with database systems.
  • Collaborate with data engineers and data scientists to understand and fulfil data processing needs.
  • Optimize and troubleshoot existing PySpark applications for performance improvements.
  • Write clean, efficient, and well-documented code following best practices.
  • Participate in design and code reviews.
  • Develop and implement ETL processes to extract, transform, and load data.
  • Ensure data integrity and quality throughout the data lifecycle.
  • Stay current with the latest industry trends and technologies in big data and cloud computing
  • Job Classification

    Industry: Banking
    Functional Area / Department: Engineering - Software & QA
    Role Category: DBA / Data warehousing
    Role: ETL Developer
    Employement Type: Full time

    Contact Details:

    Company: Virtusa
    Location(s): Hyderabad

    + View Contactajax loader


    Keyskills:   ab initio pyspark sql spark etl hive python amazon redshift microsoft azure data warehousing emr nosql amazon ec2 java kafka linux mysql hadoop sqoop aws big data

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    Senior Software Engineer - C

    • Capgemini
    • 0 years
    • Hyderabad
    • 15 days ago
    ₹ Not Disclosed

    Senior Software Engineer - C

    • Capgemini
    • 0 years
    • Hyderabad
    • 15 days ago
    ₹ Not Disclosed

    Senior Software Engineer - C

    • Capgemini
    • 0 years
    • Hyderabad
    • 15 days ago
    ₹ Not Disclosed

    Senior Database Administrator

    • Akamai
    • 7 - 12 years
    • Bengaluru
    • 2 days ago
    ₹ Not Disclosed

    Virtusa

    Virtusa is a leading worldwide provider of information technology (IT) consulting and outsourcing services. We help accelerate business outcomes for Global 2000 businesses in banking and financial services, insurance, healthcare, telecommunications and media.