Python Developer / AI Coding Evaluator/ 2 weeks ago
Project Description
This project focuses on reviewing AI-generated code responses. Your role will involve evaluating the technical accuracy and adherence to best coding practices of these responses. You will provide expert feedback to train AI systems for improved code generation. The work spans various programming languages and coding challenges, ensuring AI outputs are functional, efficient, well-structured, and compliant with industry standards.
Compensation
Compensation is competitive and determined by your education level, institution, and prior experience.
Hiring Profile
- BS, MS, or PhD in Computer Science (required).
- Expertise in Python, with a deep understanding of algorithms, data structures, and debugging.
- Fluent in English (C1+) with excellent technical writing and communication skills.
- Skilled at fact-checking information across multiple public technical sources.
- Significant experience using Large Language Models (LLMs).
- Strong analytical and structured thinking abilities.
- Capable of explaining complex programming concepts clearly and accurately.
- (Preferred) Prior experience with RLHF annotation.
- (Strongly preferred) Prior Software Engineering experience.
- (Nice to have) Proficiency in additional languages: C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, or R.
Application & Onboarding Process
Apply via SME Careers using the link below.
- Qualification Exam (1–2 hours): Evaluates your domain expertise. Compensation is provided upon passing.
- Project Exam (1–2 hours): Tests your adherence to project guidelines and ability to produce Python-specific deliverables. Compensation is provided upon passing.
Commitment
- Minimum: 17–20 hours per week (mandatory)
- Preferred: 8 hours per day
Role Details
Fully remote role.
Application
Job ID must be included in the application process: PYTHON-25-601
Submit your application through the referral link below:
https://sme.careers/apply?referral=rp--dfaeff
Job Type
Contract
Pay
$60.00 - $70.00 per hour
Work Location
Remote