AI Evaluation & Annotation Reviewer (L3 - Advanced Level) - Italian (Canada)

Employer shown to signed-in membersNorth AmericaSenior8+ years experienceAI Evaluation

Specialty

AI Evaluation

Who is hiring is shown to signed-in users. Create a free account to see the employer and apply.

The role

The company is hiring Italian language professionals for a long-term AI evaluation and annotation project, with a minimum six-month commitment. The work is reviewing AI output and annotating language data on an 8-hour schedule tied to Pacific Time.

What you will do

  • Review AI-generated responses for clarity, accuracy, relevance and quality.
  • Annotate and label language content following detailed guidelines.
  • Write or evaluate prompts as assigned.
  • Find linguistic errors and dataset problems and give structured feedback.
  • Attend daily client meetings with camera on and submit daily work reports.

What they ask for

  • Professional fluency in Italian with strong written and spoken communication.
  • 8+ years of experience in localization, AI training or a related field.
  • Bachelor's in linguistics, languages or computer science, or equivalent experience.
  • Commit to at least six months and consecutive eight-hour shifts.
  • Available 8 AM to 5 PM PST, with daily client meetings between 10 AM and 12 PM PST.
  • Strong attention to detail and ability to follow changing guidelines.
  • Not open to residents of certain listed countries.

What they offer

  • Independent contractor role; only approved, logged hours are paid.
  • Project-specific training and ongoing feedback.

This is our own short reading of the posting. The full description, and anything that has changed since, is on the employer's careers page behind the apply button.

Similar remote jobs

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer28d ago

    Commercial Roofing Expert - Drone Imagery & AI Quality Review

    Data AnnotationImage & Video LabelingSenior3+ yrs experience

    • Commercial roofing
    • Drone imagery
    • Roof inspection
    • Quality assurance
    • Image annotation
    • +1
    Applicants: membersNorth AmericaUS

    Salary not listed

  • Likely 09:00–17:00 EDT (business hours where it hires)

    Sign up to see the employer2026-07-24

    Data Annotation Specialist, Generalist

    Data AnnotationAI EvaluationMid Level1+ yr experience

    • English
    • LLM evaluation
    • Preference ranking
    • Red teaming
    • JSON
    • +3
    Applicants: membersNorth AmericaCA

    CAD 30 / hour