Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Data Engineer (databricks, Pyspark, Sql, Cloud Data Platforms) @ Synechron

Home > Software Development

 Senior Data Engineer (databricks, Pyspark, Sql, Cloud Data Platforms)

Job Description

Senior Data Engineer (Databricks, PySpark, SQL, Cloud Data Platforms, Data Pipelines)


Job Summary
Synechron is seeking a highly skilled and experienced Data Engineer to join our innovative analytics team in Bangalore. The primary purpose of this role is to design, develop, and maintain scalable data pipelines and architectures that empower data-driven decision making and advanced analytics initiatives. As a critical contributor within our data ecosystem, you will enable the organization to harness large, complex datasets efficiently, supporting strategic business objectives and ensuring high standards of data quality, security, and performance. Your expertise will directly contribute to building robust, efficient, and secure data solutions that drive business value across multiple domains.Software Required Software & Tools:

  • Databricks Platform (Hands-on experience with Databricks notebooks, clusters, and workflows)
  • PySpark (Proficient in developing and optimizing Spark jobs)
  • SQL (Advance proficiency in writing complex SQL queries and optimizing queries)
  • Data Orchestration Tools such as Apache Airflow or similar (Experience in scheduling and managing data workflows)
  • Cloud Data Platforms (Experience with cloud environments such as AWS, Azure, or Google Cloud)
  • Data Warehousing Solutions (Snowflake highly preferred)
    • Preferred Software & Tools:
  • Kafka or other streaming frameworks (e.g., Confluent, MQTT)
  • CI/CD tools for data pipelines (e.g., Jenkins, GitLab CI)
  • DevOps practices for data workflows
  • Programming LanguagesPython (Expert level), and familiarity with other languages like Java or Scala is advantageous
    • Overall Responsibilities
  • Architect, develop, and maintain scalable, resilient data pipelines and architectures supporting business analytics, reporting, and data science use cases.
  • Collaborate closely with data scientists, analysts, and cross-functional teams to gather requirements and deliver optimized data solutions aligned with organizational goals.
  • Ensure data quality, consistency, and security across all data workflows, adhering to best practices and compliance standards.
  • Optimize data processes for enhanced performance, reliability, and cost efficiency.
  • Integrate data from multiple sources, including cloud data services and streaming platforms, ensuring seamless data flow and transformation.
  • Lead efforts in performance tuning and troubleshooting data pipelines to resolve bottlenecks and improve throughput.
  • Stay up-to-date with emerging data engineering technologies and contribute to continuous improvement initiatives within the team.
    • Technical Skills (By Category)Programming Languages:
  • EssentialPython, SQL
  • PreferredScala, Java
    • Databases/Data Management:
  • EssentialData modeling, ETL/ELT processes, data warehousing (Snowflake experience highly preferred)
  • Preferred NoSQL databases, Hadoop ecosystem
    • Cloud Technologies:
  • EssentialExperience with cloud data services (AWS, Azure, GCP) and deployment of data pipelines in cloud environments
  • PreferredCloud native data tools and architecture design
    • Frameworks and Libraries:
  • EssentialPySpark, Spark SQL, Kafka, Airflow
  • PreferredStreaming frameworks, TensorFlow (for data prep)
    • Development Tools and Methodologies:
  • EssentialVersion control (Git), CI/CD pipelines, Agile methodologies
  • PreferredDevOps practices in data engineering, containerization (Docker, Kubernetes)
    • Security Protocols:
  • Familiarity with data security, encryption standards, and compliance best practices
    • Experience
  • Minimum of 8 years of professional experience in Data Engineering or related roles
  • Proven track record of designing and deploying large-scale data pipelines using Databricks, PySpark, and SQL
  • Practical experience in data modeling, data warehousing, and ETL/ELT workflows
  • Experience working with cloud data platforms and streaming data frameworks such as Kafka or equivalent
  • Demonstrated ability to work with cross-functional teams, translating business needs into technical solutions
  • Experience with data orchestration and automation tools is highly valued
  • Prior experience in implementing CI/CD pipelines or DevOps practices for data workflows (preferred)
    • Day-to-Day Activities
  • Design, develop, and troubleshoot data pipelines for ingestion, transformation, and storage of large datasets
  • Collaborate with data scientists and analysts to understand data requirements and optimize existing pipelines
  • Automate data workflows and improve pipeline efficiency through performance tuning and best practices
  • Conduct data quality audits and ensure data security protocols are followed
  • Manage and monitor data workflows, troubleshoot failures, and implement fixes proactively
  • Contribute to documentation, code reviews, and knowledge sharing within the team
  • Stay informed of evolving data engineering tools, techniques, and industry best practices, incorporating them into daily work processes
    • Qualifications
  • Bachelor's or Master's degree in Computer Science, Information Technology, or related field
  • Relevant certifications such as Databricks Certified Data Engineer, AWS Certified Data Analytics, or equivalent (preferred)
  • Continuous learning through courses, workshops, or industry conferences on data engineering and cloud technologies
    • Professional Competencies
  • Strong analytical and problem-solving skills with a focus on scalable solutions
  • Excellent communication skills to effectively collaborate with technical and non-technical stakeholders
  • Ability to prioritize tasks, manage time effectively, and deliver within tight deadlines
  • Demonstrated leadership in guiding team members and driving project success
  • Adaptability to evolving technological landscapes and innovative thinking
  • Commitment to data privacy, security, and ethical handling of information

    • Job Classification

    Industry: IT Services & Consulting
    Functional Area / Department: Engineering - Software & QA
    Role Category: Software Development
    Role: Data Engineer
    Employement Type: Full time

    Contact Details:

    Company: Synechron
    Location(s): Bengaluru

    + View Contact

    Keyskills:   Databricks Azure NoSQL databases GCP Hadoop ecosystem data warehousing AWS ELT processes

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    Software Engineer (with .NET experience)

    • Intellias
    • 5 - 10 years
    • Kolkata
    • 6 days ago
    ₹ Not Disclosed

    Senior Mainframe Developer

    • Cognizant
    • 4 - 9 years
    • Hyderabad
    • 8 days ago
    ₹ Not Disclosed

    Senior Backend Software Engineer

    • Intellias
    • 7 - 12 years
    • Kolkata
    • 17 days ago
    ₹ Not Disclosed

    Senior Backend Software Engineer

    • Intellias
    • 5 - 10 years
    • Kolkata
    • 25 days ago
    ₹ Not Disclosed

    Synechron

    Headquartered in New York and with 18 offices around the world, Synechron is helping global financial services and insurance companies embrace the most cutting-edge innovations to evolve their businesses. Synechron uniquely delivers these firms an end-to-end Digital, Consulting and Technology capabi...

    IndigoJobs © 2025

    For enquiries: contact(at)indigojobs.in

    We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in