AI Tester
- Infosys
- 3 - 8 years
- Hyderabad
- 27 days ago
- Email to a friend
- Report this job
Job Description
Job Title: AI Tester
Company Name: Infosys
Work Location:
Bangalore, Hyderabad, Chennai, Trivandrum, Pune, Noida, Gurgaon, Chandigarh
Contract Duration: 6 Months
Job Title: AI Tester
Work Location:
Bangalore, Hyderabad, Chennai, Trivandrum, Pune, Noida, Gurgaon, Chandigarh
Contract Duration: 6 Months
Notice Period: Immediate Joiner
Job Description:
We are seeking an experienced AI Tester with a strong background in testing AI systems, particularly those involving Large Language Models (LLMs). The ideal candidate should have hands-on experience in testing AI agent workflows, APIs, secure systems, and data pipelines.
Key Responsibilities:
- Understand and validate AI model implementations using LLMs, focusing on OpenAI, Azure OpenAI, or LangSmith.
- Test multi-agent workflows and agentic frameworks for effective AI agent collaboration.
- Apply prompt engineering techniques to assess and enhance model outputs.
- Implement and test Retrieval-Augmented Generation (RAG) workflows, managing vector databases.
- Validate integration of agent tools using Model Context Protocol (MCP).
- Monitor AI system performance using telemetry and observational tools to identify improvement areas.
- Collaborate with developers and data teams to test RESTful APIs supporting AI features.
- Test application security, focusing on OAuth2.x authentication and secure communication protocols.
- Ensure data integrity and accessibility in SQL databases (preferably SQL Server).
- Write test scripts and tools in Python and TypeScript; familiarity with C# is a plus.
Mandatory Skills:
- Experience with LLMs (OpenAI, Azure OpenAI, LangChain).
- Strong understanding of agentic AI frameworks and multi-agent systems.
- Skilled in prompt engineering for AI evaluation.
- Knowledge of RAG architecture and vector database integration.
- Proficiency with MCP, telemetry tools, and performance monitoring.
- Strong programming skills in Python, TypeScript; C# is a bonus.
- Experience testing REST APIs and handling OAuth2.x authentication.
- Hands-on with SQL Server or similar relational databases.
- Excellent problem-solving, debugging, and analytical skills.
- Strong communication and cross-functional collaboration abilities.
Good to Have:
- Experience with TFS, GitHub, or other version control systems.
- Understanding of framework design principles.
- Strong articulation skills and ability to communicate technical concepts clearly.
Job Description:
We are seeking an experienced AI Tester with a strong background in testing AI systems, particularly those involving Large Language Models (LLMs). The ideal candidate should have hands-on experience in testing AI agent workflows, APIs, secure systems, and data pipelines.
Key Responsibilities:
- Understand and validate AI model implementations using LLMs, focusing on OpenAI, Azure OpenAI, or LangSmith.
- Test multi-agent workflows and agentic frameworks for effective AI agent collaboration.
- Apply prompt engineering techniques to assess and enhance model outputs.
- Implement and test Retrieval-Augmented Generation (RAG) workflows, managing vector databases.
- Validate integration of agent tools using Model Context Protocol (MCP).
- Monitor AI system performance using telemetry and observational tools to identify improvement areas.
- Collaborate with developers and data teams to test RESTful APIs supporting AI features.
- Test application security, focusing on OAuth2.x authentication and secure communication protocols.
- Ensure data integrity and accessibility in SQL databases (preferably SQL Server).
- Write test scripts and tools in Python and TypeScript; familiarity with C# is a plus.
Mandatory Skills:
- Experience with LLMs (OpenAI, Azure OpenAI, LangChain).
- Strong understanding of agentic AI frameworks and multi-agent systems.
- Skilled in prompt engineering for AI evaluation.
- Knowledge of RAG architecture and vector database integration.
- Proficiency with MCP, telemetry tools, and performance monitoring.
- Strong programming skills in Python, TypeScript; C# is a bonus.
- Experience testing REST APIs and handling OAuth2.x authentication.
- Hands-on with SQL Server or similar relational databases.
- Excellent problem-solving, debugging, and analytical skills.
- Strong communication and cross-functional collaboration abilities.
Good to Have:
- Experience with TFS, GitHub, or other version control systems.
- Understanding of framework design principles.
- Strong articulation skills and ability to communicate technical concepts clearly.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: OtherRole Category: OtherRole: OtherEmployement Type: Full timeContact Details:
Company: InfosysLocation(s): Hyderabad
Keyskills: leverage Large Language Models LLMs AI Tester testing cutting-edge LangChain OpenAI Azure OpenAI AI solutions
Similar positions
Infosys
InnKey Infosystems Pvt Ltd, a renowned leader in Property Management Systems (PMS), which provides integrated cloud platform to several full-service hotels and chains both in India and abroad.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in