Java Developer Contract

Job Title: Tech Lead – Software Engineer (LLM Evaluation & Dataset Creation)

Location:

Employment Type:

Start Date:

Contract Duration:

Work Commitment:

• First Priority:

  40 hrs/week with PST overlap (No dual employment allowed)

• Second Priority:

  30 hrs/week with PST overlap

• Third Priority:

  20 hrs/week with PST overlap (Part-time/dual employment allowed)

About the Project:

LLM evaluation and training datasets

synthetic data generation with human-in-the-loop validation

The goal is to create datasets that span a variety of programming languages, complexity levels, and task types—pushing the boundaries of how LLMs interact with real-world code.

About the Role:

software engineers (Tech Lead level)

real-world development

Why Join This Project?

AI models interact with real-world software

AI-assisted software development

Day-to-Day Responsibilities:

• Analyze and triage GitHub issues from trending open-source repositories
• Set up and configure codebases with

  Docker

  , development environment automation, and dependency resolution
• Evaluate

  unit test coverage and quality

• Run and modify real-world codebases to assess

  LLM performance in bug-fixing scenarios

• Collaborate with AI researchers to identify and curate challenging coding tasks
• Contribute to

  repository selection

  , issue evaluation, and test scenario generation
• Option to lead and guide a team of junior engineers

Must-Have Skills & Experience:

• Minimum 5–7 years

  of professional software engineering experience
• At least

  3+ years of Java development experience

• Strong experience with

  Git

  ,

  Docker

  , and local development environments
• Ability to

  navigate, modify, and test complex open-source codebases

• Excellent problem-solving and debugging skills
• Comfortable working independently and collaborating in research-driven environments

Nice to Have:

• Previous involvement in

  LLM research or evaluation

  projects
• Contributions to

  open-source projects

• Experience in building or testing

  developer tools

  , code analyzers, or automation frameworks