Python Developer (Code Quality Auditor)

Job Title:

Experience:

Location:

Role Overview:

Python Code Quality Auditor

Key Responsibilities:

• Review and audit annotator evaluations of AI-generated Python code for accuracy and completeness.
• Assess whether Python code adheres to prompt instructions, is functionally correct, and secure.
• Validate and test code snippets using

  proof-of-work

  methodology and appropriate execution tools.
• Identify errors or inconsistencies in annotator ratings or written explanations.
• Provide clear, constructive feedback to help maintain annotation quality and accuracy.
• Ensure all audits are conducted within the

  Project Atlas

  guidelines and maintain evaluation integrity.
• Document issues and findings in a structured and communicative manner.

Required Qualifications:

• 5–8+ years of experience

  in Python development, code review, or QA.
• Strong understanding of

  Python syntax

  ,

  debugging techniques

  , and edge case handling.
• Proficiency with writing and executing test cases using modern testing tools (e.g., unittest, pytest).
• Experience working in structured

  QA

  , annotation, or review workflows.
• Comfortable using

  code execution environments

  (e.g., Jupyter, REPLs, cloud IDEs).
• Excellent

  written communication

  and

  documentation

  skills.

• English proficiency

  at B2, C1, C2, or native level (required for reading and writing clear feedback).

Preferred Skills (Nice to Have):

• Background in

  AI/ML

  , LLM evaluations, or prompt-based development.
• Experience with

  secure coding practices

  and code vulnerability analysis.
• Prior experience in

  technical annotation

  , content moderation, or crowdsourced QA platforms.