Senior Code Reviewer (Python) – LLM Data Training

Job Title:

Employment Type:

Compensation:

OpenTrain AI assembles expert engineering teams that help top AI companies refine, test, and scale their models. We specialize in high-accuracy data labeling, quality assurance, and evaluation workflows—delivered entirely remotely.

We’re looking for a seasoned Python professional to audit evaluations of AI-generated code. You will review annotator assessments, verify code correctness and security, and provide concise feedback that directly improves large-language-model (LLM) performance.

• Examine annotator reviews of AI-produced Python solutions for instruction compliance, functional accuracy, and secure coding
• Re-run or unit-test snippets in Docker-based sandboxes to confirm “proof-of-work” results
• Identify and correct inaccuracies in annotator reasoning; deliver clear, constructive feedback
• Meet turnaround and quality targets within a rubric-driven workflow
• Collaborate asynchronously with OpenTrain AI leads to refine guidelines and address edge cases

• 5–7 + years

  professional experience in Python development, QA, or formal code review
• Expert knowledge of modern Python (≤ 3.12), testing frameworks (pytest/unittest), and profiling/debugging tools
• Demonstrated secure-coding mindset (e.g., injection, deserialization, race conditions)

• Basic Docker proficiency

  (build, run, exec, multi-stage images, volume mounts)
• Comfortable executing and validating code in sandboxed/containerized environments
• Experience with structured QA or annotation workflows (checklists, rubric-based scoring)

• Excellent written English

  (B2 CEFR or higher) for clear, actionable feedback
• Reliable remote setup: modern hardware, high-speed internet, ability to meet milestone deadlines
  

• Hands-on work with LLM evaluation, RLHF, or model-alignment pipelines
• Familiarity with data-labeling or annotation platforms (e.g., Labelbox, Scale AI)
• Proven record of mentoring developers on code quality and security best practices
  

• Competitive hourly rate paid promptly in USD
• Flexible remote schedule with milestone-based deliverables
• Chance to influence cutting-edge AI systems with your Python expertise
• Long-term project pipeline and opportunities for repeat engagements