Skip to content

Agentic & RL Envs

AI Developer Trace Task Auditor

Mercor logoMercor$70–$90/hrRemote in United StatesContractPosted 1mo ago
Apply on Mercor (opens the job details)Is Mercor legit? Pay and reviews

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

About the role

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools - judging correctness, workflow soundness, and reasoning - and provide clear, rubric-based written feedback.

Basic Qualifications

  • 3+ years professional software development
  • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar)
  • Strong code-reading and debugging skills across full-stack or backend systems
  • Ability to evaluate multi-step coding trajectories for correctness and best practice

Preferred Qualifications

  • Experience with Kiro or Amazon CodeCatalyst
  • Prior work evaluating or grading AI-generated code
  • Contributions to developer tooling

Where you can work

This role is 100% remote, for applicants located in United States.

From Mercor's job posting, checked Oct 18, 2026.

Apply on Mercor (opens the job details)

About Mercor

Premium expert network: physicians, lawyers, engineers, PhDs.

How it pays: Weekly via Stripe (1099 contractors).

Mercor jobs with full postings Every open Mercor role Read the full Mercor review

Similar open roles

Some links on AITraining.jobs are referral links. If you sign up through one, AITraining.jobs may earn a commission at no extra cost to you. It never changes what a platform pays you.

An experienced engineer?

One profile for every AI training platform. Companies ask us for people with a specific language, country or credential: add yours once, and when a role fits, we introduce you, only with your yes. Free.

Create my profile

Get new Mercor roles by email

We check the Mercor job board daily and email you its newest roles each week, plus similar paid roles elsewhere. Free, unsubscribe anytime.