QA AI Engineer
- Icertis
- 4 - 9 years
- Pune
- 2 days ago
- Email to a friend
- Report this job
Job Description
Key Responsibilities:
- Strong software quality basics and aptitude
- Collaborate with Applied AI Engineers and Data Scientists to design and implement procedures to validate AI products on LLMs for accuracy, benchmarking, and functionality.
- Maintain detailed records of all validation activities, including test methods, results, and any issues encountered
- Evaluate test data to determine whether AI systems or processes have met validation criteria and identify areas for improvement
- Suggest tools and methodologies for efficient validation and benchmarking of AI products.
- Automate validation steps / tasks to improve efficiency in validation and benchmarking.
- Assist in creating sample datasets for benchmarking and functionality tests.
- Ensure the AI products meet the required standards and specifications.
- Provide insights and recommendations for improving AI product performance.
- Keep up-to-date with evolving industry standards, technological advancements, and best practices and new trends in AI validation
- Proven experience delivering high-quality outcomes in fast-paced, agile environments.
Qualifications:
- Bachelors degree in computer science, Engineering, Data Science, or a related field.
- 4 to 8 years of experience in AI Engineering, data science, AI validation or a related field.
- Strong Experience with validation and benchmarking of AI products.
- Good understanding of AI and machine learning concepts, particularly LLMs.
- Familiarity with tools and methodologies for AI validation and benchmarking.
- Excellent documentation and communication skills.
- Ability to work collaboratively in a team environment.
- Strong problem-solving skills and attention to detail.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Quality AssuranceRole Category: Quality Assurance - OtherRole: Quality Assurance - OtherEmployement Type: Full timeContact Details:
Company: IcertisLocation(s): Pune+ View Contact
Keyskills: QA AI Automation Testing Quality Assurance Engineering
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Icertis
Icertis, Inc. provides Equal Employment Opportunity to all employees and applicants for employment without regard to race, color, religion, gender identity or expression, sex, sexual orientation, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered v...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in