Senior Software Engineer - Data Analytics & AI Solutions
- PubMatic
- 3 - 6 years
- Pune
- 27 days ago
- Email to a friend
- Report this job
Job Description
About the role
PubMatic is seeking Data Analytics-focused Senior Software Engineers with expertise in building and optimizing AI agents, including strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, with proficiency in programming languages such as Scala and Python. You will be responsible for developing advanced AI agents that enhance our data analytics capabilities, enabling our platform to handle complex information retrieval, contextual understanding, and adaptive interactions, ultimately improving our data-driven insights and analytical workflows.
What You'll Do
- Build, design, and implement our highly scalable, fault-tolerant big data platform to process terabytes of data and provide customers with in-depth analytics.
- Develop backend services using Java, REST APIs, JDBC, and AWS.
- Build and maintain Big Data pipelines using technologies like Spark, Hadoop, Kafka, and Snowflake.
- Architect and implement real-time data processing workflows and automation frameworks.
- Design and develop GenAI-powered agents for analytics, operations, and data enrichment use cases using frameworks like LangChain, LlamaIndex, or custom orchestration systems.
- Integrate LLMs (e.g., OpenAI, Claude, Mistral) into existing services for query understanding, summarization, and decision support.
- Manage end-to-end GenAI workflows including prompt engineering, fine-tuning, vector embeddings, and retrieval-augmented generation (RAG).
- Working closely with cross-functional teams on improving the availability and scalability of large data platforms and the functionality of PubMatic software.
- Participate in Agile/Scrum processes such as sprint planning, sprint retrospective, backlog grooming, user story management, and work item prioritization.
- Frequently discuss with product managers about the software features to include in the PubMatic Data Analytics platform.
- Support customer issues over email or JIRA (bug tracking system), provide updates, and patches to customers to fix the issues.
- Perform code and design reviews for code implemented by peers or as per the code review process.
We'd Love for You to Have
- Three to six years of coding experience in Java and backend development.
- Solid computer science fundamentals, including data structure and algorithm design, and creation of architectural specifications.
- Expertise in developing the Implementation of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews.
- Hands-on experience with Big Data tools and systems like Scala Spark, Kafka, Hadoop, and Snowflake.
- Proven expertise in building GenAI applications, including:
- LLM integration (OpenAI, Anthropic, Cohere, etc.)
- LangChain, or similar agent orchestration libraries
- Prompt engineering, embeddings, and retrieval-based generation (RAG)
- Experience in developing and deploying scalable, production-grade AI or data systems.
- Ability to lead end-to-end feature development and debug distributed systems.
- Experience in developing and delivering large-scale big data pipelines, real-time systems & data warehouses would be preferred.
- Demonstrated ability to achieve stretch goals in a very innovative and fast-paced environment.
- Demonstrated ability to learn new technologies quickly and independently.
- Excellent verbal and written communication skills, especially in technical communications.
- Strong interpersonal skills and a desire to work collaboratively.
Qualifications
- Should have a bachelor's degree in engineering (CS / IT) or equivalent degree from a well-known institute/university.
Apply to the link below:
https://pubmatic.com/job/?gh_jid=4692032***
Job Classification
Industry: Software ProductFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: PubMaticLocation(s): Pune
Keyskills: scala Hadoop Kafka Big Data Generative Artificial Intelligence Java Langchain LLM RAG OpenAI Spark Llamaindex Python
Similar positions
PubMatic
PubMatic is the automation solutions company for an open digital media industry. Featuring the leading omni - channel revenue automation platform for publishers and enterprise - grade programmatic tools for media buyers, PubMatic????s publisher - first approach enables advertisers to access premium ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in