Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Data Engineering Analyst - Spark,Scala,Python @ Optum

Home > Software Development

 Senior Data Engineering Analyst - Spark,Scala,Python

Job Description


Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start  Caring. Connecting. Growing together.
  •    Primary Responsibilities 
  • Cloud Migration Planning and Execution:
  • Assist in developing and implementing strategies for migrating ETL processes to cloud platforms like Azure
  • Participate in assessing the current infrastructure and creating a detailed migration roadmap
  • ETL Development and Optimization:
  • Design, develop, and optimize DataStage ETL jobs for cloud environments
  • Ensure data integrity and performance during the migration process
  • Unix Scripting and Automation:
  • Utilize Unix shell scripting to automate data processing tasks and manage ETL workflows
  • Implement and maintain scripts for data extraction, transformation, and loading
  • Collaboration and Coordination:
  • Work closely with cloud architects, senior data engineers, and other stakeholders to ensure seamless integration and migration
  • Coordinate with IT security teams to ensure compliance with data privacy and security regulations
  • Technical Support and Troubleshooting:
  • Provide technical support during and after the migration to resolve any issues
  • Conduct testing and validation to ensure the accuracy and performance of migrated data
  • Documentation and Training:
  • Maintain comprehensive documentation of the migration process, including data mappings, ETL workflows, and system configurations
  • Assist in training team members and end-users on new cloud-based ETL processes and tools
  • Performance Monitoring and Optimization:
  • Monitor the performance of ETL processes in the cloud and make necessary adjustments to optimize efficiency
  • Implement best practices for cloud resource management and cost optimization
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
  •  Required Qualifications
  •  
  • Engineering graduate or equivalent experience
  • 3+ years of relevant Datastage development experience
  • 2+ years experience in development/coding on Spark/Scala or Python or Pyspark
  • 1+ years of experience working on Microsoft Azure Databricks
  • Relevant experience on Databases like Teradata, Snowflake
  • Hands-on development experience in UNIX scripting
  • Experience in working on data warehousing projects
  • Experience with Test Driven Development and Agile methodologies
  • Sound knowledge of SQL programming and SQL Query Skills
  • Proven ability to apply the knowledge of principles and techniques to solve technical problems and write code based on technical design
  • Proficient in learning & adopting new technologies and use them to execute the use cases for business problem solving
  • Exposure to job schedulers like Airflow and ability to create and modify DAGs
  • Proven solid Communication skills (written and Verbal)
  • Proven ability to understand the existing application codebase, perform impact analysis and update the code when required based on the business logic or for optimization
  • Proven exposure on DevOps methodology and creating CI/CD deployment pipeline
  • Proven excellent Analytical and Communication skills (Both Verbal and Written)
  • At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes an enterprise priority reflected in our mission.

    Job Classification

    Industry: Retail
    Functional Area / Department: Engineering - Software & QA
    Role Category: Software Development
    Role: Data Engineer
    Employement Type: Full time

    Contact Details:

    Company: Optum
    Location(s): Noida, Gurugram

    + View Contact

    Keyskills:   python pyspark sql spark sql programming azure databricks continuous integration snowflake scala datastage datastage administration airflow microsoft azure data warehousing ci/cd unix scripting tdd devops shell scripting etl unix agile methodology

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    Module Lead - SharePoint Migration Job

    • Yash Technologies
    • 6 - 11 years
    • Hyderabad
    • 16 hours ago
    ₹ Not Disclosed

    Banking - Scrum Master

    • Quinnox
    • 8 - 13 years
    • Bengaluru
    • 21 hours ago
    ₹ Not Disclosed

    Principal Data Engineer

    • Trellix
    • 10 - 15 years
    • Bengaluru
    • 1 day ago
    ₹ Not Disclosed

    Python + Data Engineer

    • Wissen Technology
    • 5 - 10 years
    • Mumbai
    • 1 day ago
    ₹ Not Disclosed

    Optum

    About: OptumInsight India Pvt Ltd, a UnitedHealth group company is a leading health services and innovation company dedicated to help make the health system work better for everyone. With more than 115,000 people worldwide, Optum combines technology, data and expertise to improve the delivery, ...

    IndigoJobs © 2025

    For enquiries: contact(at)indigojobs.in

    We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in