Specialty
Who is hiring is shown to signed-in users. Create a free account to see the employer and apply.
The role
The company is hiring a Generalist Data Annotation Specialist to evaluate, rank and correct outputs from its language models on English-language text, image and structured data. It is a part-time contractor role for people in Canada, about 16 hours per week.
What you will do
- Rank and compare model outputs against project guidelines and write clear justifications
- Probe models adversarially to find failure modes and document reproducible cases
- Write prompts, responses and exemplars for training and evaluation datasets
- Help design grading rubrics and apply them consistently
- Label and correct text, image and structured data, and join calibration checks
- Report trends in model and agent quality to cross-functional partners
What they ask for
- 1+ years in AI data annotation, LLM evaluation, content moderation, research or a similar analytical role
- Experience applying detailed guidelines to ambiguous content with good judgment about tone and nuance
- Willingness to flag unclear edge cases instead of guessing
- Excellent written English and strong reading comprehension
- Comfort with annotation platforms and formats such as JSON, CSV/TSV, Markdown, XML and YAML
- Located in Canada, able to commit 16 hours per week, with your own laptop
- Ability to work independently in an asynchronous remote team
What they offer
- Part-time independent contractor role (16 hours per week)
- Fully remote
This is our own short reading of the posting. The full description, and anything that has changed since, is on the employer's careers page behind the apply button.