Freelance Python and Docker
- Hurix
- 5 - 10 years
- Mumbai
- 8 days ago
- Email to a friend
- Report this job
Job Description
Were hiring a Code Reviewer with deep Python expertise to review evaluations completed by
data annotators assessing AI-generated Python code responses. Your role is to ensure that
annotators follow strict quality guidelines related to instruction-following, factual correctness,
and code functionality.
Responsibilities
- Review and audit annotator evaluations of AI-generated Python code.
- Assess if the Python code follows the prompt instructions, is functionally correct, and secure.
- Validate code snippets using proof-of-work methodology, including Docker-based execution
environments when applicable.
- Identify inaccuracies in annotator ratings or explanations.
- Provide constructive feedback to maintain high annotation standards.
- Work within Project Atlas guidelines for evaluation integrity and consistency.
Required Qualifications
- 5 to 7+ years of experience in Python development, QA, or code review.
- Strong knowledge of Python syntax, debugging, edge cases, and testing.
- Comfortable using code execution environments and testing tools, including Docker containers
for environment isolation and reproducibility.
- Excellent written communication and documentation skills.
- Experience working with structured QA or annotation workflows.
- English proficiency at B2, C1, C2, or Native level.
Preferred Qualifications
- Experience in AI training, LLM evaluation, or model alignment.
- Familiarity with annotation platforms.
- Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.
- Working knowledge of Docker for replicating or reviewing complex code environments is a
plus.
Why Join Us?
Join a high-impact team working at the intersection of AI and software development. Your
Python expertise will directly influence the accuracy, safety, and clarity of AI-generated code.
This role offers remote flexibility, milestone-based delivery, and competitive compensation.
Job Classification
Industry: E-Learning / EdTechFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Software Development - OtherEmployement Type: Part timeContact Details:
Company: HurixLocation(s): Mumbai
Keyskills: Docker Azure Cloud Python Development Microsoft Azure AWS
Similar positions
Hurix
Hurix Systems Private Limited Hurix is a content and mobility solutions provider. We build, distribute and manage compelling and engaging digital content across traditional and new mobile platforms, formats and devices. As a leading solution provider, we provide an array of digital services, in...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in