cover
Contract

Python Code Expert Evaluator for AI Training/ 23 hours ago

G2i Inc.
Attractive
Application ends: 2025-12-24

Quick Summary

This is a remote contract role focused on AI code evaluation, requiring a BS/MS/PhD in Computer Science and expert-level Python skills, including algorithms, data structures, and debugging. Responsibilities involve reviewing AI-generated code for technical accuracy, ensuring adherence to industry standards, and providing feedback to train AI systems. Candidates must have significant experience with LLMs, expert English writing skills, and strong fact-checking abilities. Prior Software Engineering experience is strongly preferred. Compensation is competitive and paid weekly.

About the Company

G2i connects subject-matter experts, students, and professionals with flexible, remote AI training work, including annotation, evaluation, fact-checking, and content review. We partner with leading AI teams, offering consistent, reliable compensation paid weekly upon approval.

Project Info

This remote project focuses on AI code evaluation. Responsibilities include reviewing AI-generated responses, assessing technical accuracy and best practices, and providing expert feedback to train AI systems for improved code generation. You will work across various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and adhere to industry standards.

Compensation

Compensation is competitive and determined based on education level, institution, and prior experience.

Hiring Profile

Required Qualifications:

  • BS, MS, or PhD with a significant focus on Computer Science.
  • Expertise in Python, including a firm grasp of algorithms, data structures, and debugging practices.
  • Expert-level English proficiency with excellent writing skills.
  • Expertise in fact-checking information using public sources across multiple domains.
  • Significant experience utilizing large language models (LLMs).
  • Strong analytical and structured thinking skills.
  • Ability to explain complex programming concepts clearly and accurately.

Preferred Qualifications:

  • Prior experience with RLHF annotation.
  • Prior Software Engineering work experience (strongly preferred).
  • Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R.

Share

G2i Inc.

G2i Inc.

  • Address
    Bayamón, Puerto Rico
View Profile
Your experience on this site will be improved by allowing cookies Cookie Policy