Language Model Reviewer Job at Scale AI, San Francisco, CA

b0kvRTBxZGptWnczZWhrOVZ2Umd1bXQw
  • Scale AI
  • San Francisco, CA

Job Description

About the job


- Employment Type: Remote (Part-Time)
- Location: Remote within one of the following countries: United States, United Kingdom, Canada, Ireland, Australia, or New Zealand.
- Compensation: Up to USD 18 per hour, depending on location, experience, scope of responsibilities, and performance.


About the Role
- This role focuses on reviewing language model outputs for accuracy, coherence, relevance, and quality across various prompts and applications in a fully remote environment.
- You will collaborate closely with the team to evaluate responses, identify errors, provide feedback, and help keep model review processes organized, outputs reliable, and improvement workflows efficient.


Key Responsibilities
- Assist with language model review-focused project tasks such as output evaluation, error annotation, quality scoring, response validation, data entry and maintenance, online research, basic analysis, operations support, AI-output review, documentation, and coordination.
- Review, organise, and update model review files and related information with a high level of accuracy and attention to detail.
- Communicate clearly with team members through written and verbal channels and provide timely updates on task status and progress.


Skills & Qualifications
- Strong command of written English and clear, professional communication skills.
- Comfort using digital tools such as email, spreadsheets, AI review platforms, project management or online productivity tools.
- Analytical mindset with strong attention to detail and accuracy.
- Ability to manage time, prioritise tasks, and work independently in a remote environment.
- Interest in language models, AI evaluation, output quality, or data-related work is helpful but not required; training and onboarding will be provided.


What We Offer
- 100% remote work within the listed countries, with flexible scheduling aligned to team needs and agreed time zones.
- Weekly payments via secure, compliant payment methods, with a clear and transparent compensation structure.
- Opportunities to build skills in research, content operations, data handling, model review, and AI-related workflows.
- A supportive work culture that encourages feedback, learning, and long-term professional growth.


- You must be legally authorised to work in the country where you are based.


We welcome applicants from all backgrounds and make hiring decisions based solely on qualifications, experience, and business needs, in line with applicable employment and anti-discrimination laws.


Apply now to be considered for this opportunity.

Job Tags

Hourly pay, Weekly pay, Part time, Remote work, Flexible hours,

Similar Jobs

STH

Junior Python Software Developer Job at STH

 ...successful application to this job by ensuring your CV and skills are a good match.Were looking for an experienced Junior Python Software Developer (no Interns), who also has experience in Django and PostGres.This position is onsite in our office in Melbourne, FL... 

Nannyauthority

Cook, Full Time, Housekeeper, Live In Summers, Live Out Job at Nannyauthority

Position: Cook, Full Time, Housekeeper, Live In Summers, Live OutLocation: Connecticut, Manhattan, New YorkA family, with homes on the Upper East Side and in Greenwich, CT, needs to hire for an experienced, child-friendly full-time Housekeeper/Cook. Responsibilities include... 

LanceSoft

Travel Nurse RN - Perioperative Job at LanceSoft

 ...Job Description LanceSoft is seeking a travel nurse RN Perioperative for a travel nursing job in Oklahoma City, Oklahoma. Job Description & Requirements ~ Specialty: Perioperative ~ Discipline: RN ~ Start Date: ASAP ~ Duration: 13 weeks ~40 hours per... 

Toppers Pizza - Onalaska

DAY SHIFT!Delivery DRIVERS - $15-$20/hour with tips Job at Toppers Pizza - Onalaska

 ...Description Approximate Hours for DAY SHIFT would be weekdays and weekends. Starting time would be 10:30AM, some days sooner. End...  ...heart and soul of our company, bringing Great Food and Memorable Experiences that friends and families connect over to our local communities... 

Impact Event Solutions

Event Coordinator Job at Impact Event Solutions

 ...Job Description Job Description Impact Event Solutions About Us: Impact Event Solutions is a dynamic startup redefining the...  ...that leave a lasting impact. We're seeking a talented Event Coordinator to join our team and help us elevate our brand and events to new...