Ruby Rail Developer-LLM Evaluation & Validation

YO IT Group

5 years

25 - 44 Lacs

India

Posted:1 day ago| Platform:

Apply

Skills Required

ruby developer evaluation software development analyze triage github trending code test design git docker pipeline testing research automation navigation

Work Mode

Remote

Job Type

Contractual

Job Description

Experience: 5 - 8 Years

Location: - Permanent Remote

Job Type: Contract

Duration of contract: 3 months

Commitment Required

Minimum 20 hours per week with some overlap with PST

Employment type: Contractor assignment (no medical/paid leave)

Must Have

Definition: These are non-negotiable requirements for the role. Candidates without these will not be considered.

5+ years of relevant software development experience.

Ruby - min 4+ yrs exp

What Does Day-to-day Look Like

Analyze and triage GitHub issues across trending open-source libraries.
Set up and configure code repositories, including Dockerization and environment setup.
Evaluating unit test coverage and quality.
Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Opportunities to lead a team of junior engineers to collaborate on projects.

Required Skills

Definition: These skills are essential and candidates must possess them to be successful in the role. Minimum 5+ years of overall experience
Strong experience with at least one of the following languages: Ruby
Proficiency with Git, Docker, and basic software pipeline setup.
Ability to understand and navigate complex codebases.
Comfortable running, modifying, and testing real-world projects locally.
Experience contributing to or evaluating open-source projects is a plus.

Nice To Have

Definition: These skills/experiences are not essential but would be beneficial and might give candidates an edge. Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.

Skills: codebase evaluation,codebase navigation,ruby rail,open-source contribution,ror,ruby,projects,docker,unit testing,ruby and rail,software,software pipeline setup,git,automation

More Jobs at YO IT Group

Growth Manager - B2B SaaS

Mumbai Metropolitan Region

4.0 - 8.0 yrs

Salary: Not disclosed

Sr Data Engineer -Snowflake/Dbt

Hyderabad, Telangana, India

3.0 - 10.0 yrs

Salary: Not disclosed

Data Engineering Manager

Hyderabad, Telangana, India

8.0 - 12.0 yrs

Salary: Not disclosed

Lead Data Engineering

Hyderabad, Telangana, India

7.0 - 7.0 yrs

Salary: Not disclosed

Data Engineering Lead

Hyderabad, Telangana, India

7.0 - 7.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Technical Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.