Skip to content
Learn/Agentic Tasks & RL Environments

Contribute expertise

Agentic Tasks & RL Environments

Build and grade the interactive tasks and RL environments that agentic AI trains against.

High barrier to entryStart in a few weeks (assessment-gated, expertise required)$35–$90/hrlive typical
Ready for the numbers? See what agentic & RL envs pays, which platforms hire for it, and live open roles.

What it is

Modern AI models are increasingly trained to act, not just answer: they use tools, take multiple steps, and complete real tasks. Teaching them this needs more than rating two responses. Someone has to build the interactive task itself, define what a correct outcome looks like, and judge the model's whole chain of steps. That work is agentic evaluation and reinforcement-learning (RL) environment design, the fastest-growing and among the best-paid kinds of AI-training work in 2026. You construct a realistic task with a clear, checkable goal (a 'grader' or verifiable reward), then review how an AI agent attempts it: where its reasoning went wrong, which tool call was misused, whether it recovered. It rewards people who can decompose a real problem and specify exactly what 'done correctly' means.

What you actually do

  • Design a realistic multi-step task an AI agent must complete (book a trip, debug a repo, work through a clinical case), with a clearly defined success condition
  • Write the 'grader' or verifiable reward: the automatic or rubric-based check that decides whether the agent actually succeeded
  • Review an agent's full trajectory, the sequence of reasoning steps and tool calls, and annotate where it deviated from a sound plan
  • Author reference reasoning traces: worked, step-by-step solutions that show the model how an expert thinks through the problem
  • Judge tool use: was the right tool called, with the right arguments, in the right order, and did the agent recover from an error
  • Package the task as a sandboxed environment the lab can run the model against repeatedly, and iterate on it as the model improves

What a real task looks like

Build a coding RL environment

You take a real bug in an open-source repo, write a task ('make the failing test pass without breaking the others'), and set the grader to the test suite itself. An AI agent then attempts it in a sandbox; the environment automatically scores each attempt as pass or fail, giving the model a verifiable reward to learn from.

Annotate an agent trajectory

You are shown a transcript of an AI agent trying to answer a research question using web search and a calculator. You mark the exact step where it trusted a wrong source, note that its final tool call used stale data, and rate whether its recovery attempt was reasonable, so the model learns which intermediate decisions mattered.

Write an expert reasoning trace

For a hard tax question, you write out the full professional reasoning: which rule applies, why the obvious answer is wrong, and the correct calculation, step by step. The model trains on your trace to reason like a practitioner, not just to produce a final number.

Is it right for you?

People who can take a real, messy task and pin down exactly what a correct outcome is, then judge a machine's attempt at it fairly. It suits software engineers, quantitative professionals, and domain experts (law, medicine, finance, science) who are comfortable being precise about correctness. Unlike generalist rating, this work genuinely requires expertise or strong technical judgment, which is why it sits at the top of the pay scale. A background in the domain you are designing tasks for matters more than any labeling experience.

This is a good fit if

  • You can break a real problem into steps and state precisely what 'done correctly' means
  • You have real depth in a domain (a programming language, a science, a profession) you could set expert-level tasks in
  • You can judge a multi-step process, not just a final answer, and explain where it went wrong
  • You are comfortable with the idea of a verifiable, checkable reward rather than a subjective score

What you need

  • Genuine expertise or strong technical judgment in at least one domain (coding, STEM, or a licensed profession)
  • Comfort reading and reasoning about multi-step processes and tool use
  • Reliable computer and internet; some coding environments need basic familiarity with a terminal or a repo
  • Willingness to pass a demanding, skill-based assessment before paid work

Skills that help

Problem decomposition and task designDefining verifiable success criteria (graders, rubrics, test cases)Step-by-step reasoning and clear written explanationDomain expertise (coding, math, science, or a profession)Judging process, not just outcomesPrecision about correctness and edge cases

How to get started

  1. 1Get strong in one domain first: the highest-paid environment and reasoning work assumes real coding, quantitative, or professional expertise
  2. 2Create profiles on the expert networks that run this work (the platforms doing RL environments, agent evaluation, and reasoning-trace projects for frontier labs)
  3. 3Highlight the specific domains you can set expert-level tasks in, and any experience writing tests, rubrics, or worked solutions
  4. 4Expect a rigorous, skill-based assessment: these projects screen hard because the work needs genuine judgment, not volume
  5. 5Start with reasoning-trace or trajectory-annotation projects (a lower on-ramp than full environment engineering), then move up to designing environments and graders
  6. 6Treat correctness as the product: clear, checkable success criteria and honest step-level judgment are what get you invited to higher-paid queues

Common misconceptions

Myth: This is just the next name for data labeling.

Reality: It is the opposite end of the market. Commodity labeling is being automated away; designing tasks, graders, and reasoning traces needs real expertise and is priced accordingly, with expert hourly work running high and the largest per-task environment builds commissioned into the hundreds of thousands of dollars, up to about $300,000 for a full product replica.

Myth: You need to be a machine-learning researcher.

Reality: You need deep expertise in a domain and the ability to specify correctness, not to train models yourself. A strong software engineer, a physicist, or a practicing lawyer can do this work; the labs supply the training machinery.

Myth: There is always one objective right answer.

Reality: Part of the skill is deciding what 'correct' even means for a messy task and encoding it as a checkable reward. Designing that success condition well is the hard, valued part of the job.

What it pays

Agentic & RL Envs work typically pays $35–$90/hr today, with a live median of $50 an hour across the 50 open roles that state a rate.

The complete guide

Everything about agentic & RL envs work

Written by Yuma Heymans, Founder & CEO of AITraining.jobs.

Founder and CEO of AITraining.jobs and co-founder of the AI recruitment platform HeroHunt.ai, based in San Francisco, with years spent mapping how AI-training and data work is sourced, staffed, and paid.

X Published 2026-07-29

The 2026 frontier of AI-training work: what building agentic tasks and reinforcement-learning environments really is, what it pays, and how to get in when you are not a machine-learning researcher.

For most of the last decade, "training AI" meant labeling data, and then, more recently, reading two chatbot answers and picking the better one. In 2026 the center of gravity has moved somewhere newcomers rarely hear about: the frontier labs are now spending the bulk of their human-data budgets on people who build the interactive tasks and reinforcement-learning (RL) environments that agentic models learn to act inside. The pay reflects it. Software engineers who build these environments are quoted in the $70 to $160 an hour range on marketplaces like Mercor, domain experts authoring the reasoning behind them command $75 to $300 an hour, and single authored tasks change hands between vendors and labs for $200 to $2,000 each. At the extreme, the startup Mechanize reportedly offered $500,000 salaries to engineers who do nothing but build environments.

This guide is the honest, first-principles version. It explains what an RL environment actually is (in plain language, from the ground up), what the day-to-day work looks like, why humans are paid to do it when the whole point is to train machines, who is hiring, what it really pays across a very wide distribution, the genuine barrier to entry, and the single most open on-ramp in the entire field: a public bounty program that lets anyone in the world build a portfolio a lab can see. If you want to compare this against the rest of the AI-training pay landscape before committing, you should, because this is skilled work, not a click-from-home gig, and aiming at the wrong rung is why capable people conclude it "does not work."

Contents

  1. What agentic tasks and RL environments actually are
  2. RLVR: the shift from preference to proof
  3. What you do day to day: the four roles inside the category
  4. Why this human work exists at all (first principles)
  5. Who it is for, and the honest barrier to entry
  6. The skills that matter, and how to build them
  7. Who is hiring in 2026, compared
  8. What it really pays: per task, per hour, and by tier
  9. How to get started and land your first paid task
  10. Misconceptions that cost people money
  11. The RL-environment bottleneck and the 2026 outlook
  12. A decision framework

1. What Agentic Tasks and RL Environments Actually Are

Start with the simplest possible picture, because the jargon hides something concrete. Modern AI models are increasingly trained to act rather than just answer. They run code, click through applications, search files, call tools, and complete tasks that take many steps. Teaching a model to act well requires a fundamentally different kind of human input than showing it two finished answers and asking which is nicer.

According to Epoch AI's authoritative FAQ on the subject, an RL environment has exactly three parts. First, a set of actions the model is allowed to take: run a shell command, click a button, edit a file, query a database. Second, the surrounding state that determines what those actions do: a file system, a running application, a set of environment variables, a simulated version of some real software. Third, a grader that looks at the model's attempt and scores it. The model tries the task, the grader hands back a number, and that number is used to update the model's weights so it repeats what worked and drops what did not. One founder building these described the job to TechCrunch as "creating a very boring video game": a small, rule-bound world with a clear win condition and no entertainment value whatsoever.

That comparison is worth sitting with, because it captures the mental model precisely. A video game defines what the player can do, what the world does in response, and how you win. An RL environment does the same three things for an AI agent. The difference is that the "player" is a model being trained, and "winning" has to be defined so rigorously that a piece of code can judge it automatically, thousands of times, without a human in the loop for each attempt. Designing that win condition, so it is both meaningful and impossible to cheat, is the entire craft.

The reason this matters so much in 2026 is that static text is no longer the binding input. A model can read the whole internet, but reading does not teach it to fix a bug across five files, book a trip through a flaky website, or navigate a company's expense system. Those are behaviors, and behaviors are learned by attempting a task and being scored on the outcome. That is what an environment provides, and it is why Epoch reports that RL is now the dominant use of frontier training data, with roughly 10 to 20 times more demand than benchmarking or supervised fine-tuning.

2. RLVR: The Shift from Preference to Proof

To understand why this work is paid so differently from older AI-training jobs, you have to understand the technical shift underneath it, and it is genuinely simple once stated plainly.

Classic reinforcement learning from human feedback (RLHF) trains a learned reward model. A person reads two model answers and picks the better one. Do that tens of thousands of times and you can train a second model to imitate that human taste, then use that second model as the reward signal for the main model. It works, but it has a structural weakness: the reward is a prediction of what a human would like, and a sufficiently clever model can learn to produce things that score well with the reward model without actually being good. The reward model can be gamed, because it is itself a fallible model of preference.

The 2026 paradigm is RLVR, reinforcement learning with verifiable rewards. Here the reward is not a learned guess. It is a deterministic check. The model earns a reward only when its output passes an automated, objective test: the unit tests pass, the math answer equals the known answer, the database ends in exactly the correct state. As Appen explains, the reward is computed, not predicted. The advantage, spelled out by the Ultralytics glossary, is that there is no learned reward model to hack, because a deterministic verifier cannot be flattered. Two plus two either equals four or it does not.

RLVR started in the domains where "correct" is cleanly checkable: mathematics, coding, and formal logic. In 2026 it is being pushed hard into agent workflows, tool use, computer use, and messy enterprise tasks, where, as Daily Dose of DS notes, writing a trustworthy verifier is far harder. How do you deterministically check that an agent "handled the customer refund correctly" when the correct handling depends on context, policy, and judgment? Answering that question well, encoding fuzzy correctness into a check a machine can run, is exactly the human skill the labs are paying a premium for. The cleaner the domain, the more the work can be automated; the messier and more expert the domain, the more valuable the human who can pin down what "correct" even means.

3. What You Do Day to Day: The Four Roles Inside the Category

"Building environments" sounds like it requires you to be a systems engineer, and for the top tier it does. But the category is a ladder, not a single job, and there is a genuine on-ramp lower down. Per Epoch and the Wing Venture Capital market analysis, contributors design tasks, write the reference solution, specify the reward signal, containerize the environment, and, in some cases, grade the model's attempts and QA the whole thing against cheating. Those responsibilities map onto four recognizable roles.

RoleWhat you actually produceBarrier to entry
Trajectory annotatorReview a transcript of an agent's attempt and mark exactly where its reasoning or tool use went wrongLowest: careful judgment plus some domain familiarity
Reasoning-trace authorWrite the full expert reasoning for a hard problem, step by step, as a worked target the model learns fromReal domain expertise (a lawyer, physician, quant, senior engineer)
Grader / rubric authorDefine the checkable success condition, the exact rule that decides pass or failThe core craft of RLVR; needs precision about correctness
Environment builderConstruct the full runnable task and the sandbox the model attempts it inHighest: engineering-heavy, and the source of the largest per-task pay

Let me make each concrete, because the abstract description hides how different they feel in practice.

A trajectory annotator is handed a transcript: an agent trying to answer a research question using web search and a calculator, say. You read the whole chain and mark the exact step where it trusted a bad source, note that its final tool call used stale data, and rate whether its recovery attempt was reasonable. You are not building anything; you are teaching the model which intermediate decisions mattered. This is the most accessible entry point, and the natural bridge from RLHF and preference rating, because it is still judgment work, just applied to a process instead of a finished answer.

A reasoning-trace author writes the gold-standard thinking. For a hard tax question, you write out the full professional reasoning: which rule applies, why the obvious answer is wrong, and the correct calculation, step by step. The model trains on your trace to reason like a practitioner rather than to pattern-match a final number. This role is gated entirely by genuine expertise, which is why a practicing lawyer or physician can earn top rates here without writing a line of code.

A grader author writes the rule that decides everything. This is deceptively hard. For a coding task the grader might be the test suite itself. For an agentic customer-service task, it might be a checklist of state changes plus a rubric for tone. Getting this right, and getting it robust against a model that will actively try to cheat, is the heart of the work.

An environment builder does all of the above and wraps it in runnable software: a containerized sandbox the model can act inside, repeatedly, at scale. This is the engineering-heavy tier and the source of the largest per-task commissions. To see how it fits together, here is one built end to end.

You take a real bug in an open-source repository. You write the task: "make the failing test pass without breaking the others." You set the grader to the existing test suite, so pass or fail is decided by code, not opinion. You containerize the repo so an agent can check out the code, edit files, and run the tests in isolation. Then you tune the difficulty until the model succeeds on roughly one attempt in fifty, because labs generally want tasks with a 2 to 3 percent pass rate: a task the model never solves is broken or infeasible, and one it always solves teaches nothing. Finally, and this is the part beginners skip, you attack your own grader. Can the model make the test pass by deleting it? By hard-coding the expected output? By weakening an assertion? Closing those loopholes is the actual craft, and it is why a well-built environment is worth far more to a lab than a raw bug report.

Two more examples show the range beyond code. In an enterprise-workflow environment, you might simulate a company's expense system: the agent has to read a messy receipt, categorize it against a policy, file it in the right cost center, and flag anything over a threshold for approval. The grader checks the final state of the simulated system (was the expense filed correctly, was the right approval triggered) plus a rubric for the edge cases the policy leaves ambiguous. This is the fastest-growing domain precisely because the correct answer depends on business rules a model does not inherently know, which is why Epoch names enterprise workflows the major growth area and why frontier models still fail more than 40 percent of these simulated workplace tasks. In a clinical-reasoning environment, a physician designs a case: presenting symptoms, the tests available, and a correct diagnostic pathway, then writes the grader as a rubric over the agent's reasoning (did it order the right tests in a sensible sequence, did it avoid a dangerous shortcut). The physician writes no code; the entire value is the medical judgment encoded into what counts as correct.

4. Why This Human Work Exists at All (First Principles)

It is worth reasoning from the ground up about why a lab pays a human to build a training sandbox for a machine, because the answer tells you which parts of the job are durable and which are being automated away.

The naive expectation is that if AI is getting better at coding and reasoning, it should build its own environments and cut the human out. Some of that is happening: routine, cleanly-checkable environments (basic math, simple coding katas) are increasingly generated automatically, and that is a real thing the automation absorbs. But the automation has a structural blind spot, and it is the same blind spot in every corner of AI training. A model is good at producing variations on patterns it has seen. It is bad at three specific things: judging whether a fuzzy outcome is actually correct in a domain it does not deeply understand, inventing a genuinely novel task that stresses a capability no existing environment covers, and noticing when its own grader can be gamed. Those three failures are exactly where the human sits.

The single most-cited quality criterion in Epoch's survey of environment founders is robustness against reward hacking, and this is the first-principles reason the human work is durable. A reward function is just code, and code can contain a subtle mistake that quietly rewards the wrong behavior for an entire training run before anyone notices. As Daily Dose of DS puts it, you often cannot tell whether a reward function measures what you think it measures until after training, when the model has already exploited the gap. Catching that requires an adversarial human imagination: someone who thinks like the model that is trying to cheat and closes the loophole before it is exploited. Automation is bad at auditing its own incentives.

There is a second first-principles reason, and it is about meaning. The frontier of demand has moved to enterprise workflows: expense reports, spreadsheets, CRM navigation, multi-tab office tasks. What counts as "handling this correctly" in a real business process is downstream of human meaning: policy, intent, and consequence. A model can attempt the task ten thousand times, but it cannot reliably tell you which outcome a real finance team would accept, or design the task so it reflects how the work is actually done. That judgment requires someone who understands the domain, which is why the same logic that pays a physician to write clinical-reasoning traces also underlies well-paid law, medicine, and finance work more broadly. The human is there for the part that is irreducibly about human meaning and human incentives, and that part is getting larger, not smaller, as the easy environments get automated.

There is a third reason, quieter but decisive: quality at scale is itself a human problem. A lab does not need one environment; it needs thousands, each meaningful, each hard in a different way, each resistant to being gamed, and all of them maintained as the model improves and starts finding new loopholes. Epoch's founders name maintaining quality while scaling as the number-one bottleneck, and it is not one that automation removes, because the failure mode of automated environment generation is subtle sameness and exploitable checks, exactly the things a careful human catches. The scarce input is not raw environments; it is good environments produced reliably, which is a labor problem dressed up as a technical one. That is the structural reason the headcount keeps rising even as the tooling gets better.

5. Who It Is For, and the Honest Barrier to Entry

Let me be direct about who thrives here, because the marketing around "AI training jobs" blurs a real two-tier structure, and conflating the tiers is the most common and most costly mistake applicants make.

This is, for the premium roles, genuinely skilled work. Unlike generalist rating, it requires expertise or strong technical judgment, which is exactly why it sits at the top of the pay scale. But "expertise" comes in two flavors, and they open different doors.

The first door is engineering. If you can write Python, build a containerized environment with Docker, and author a unit-test-style grader that resists cheating, you can build environments in coding and general-purpose domains without any credential at all. The Prime Intellect bounty program is open to anyone in the world, so a strong self-taught engineer in any country can build a public environment and get paid for it. No PhD, no resume, just demonstrated software skill and a clean, hack-resistant grader.

The second door is domain credentials. If you are a practicing physician, a lawyer, a financial analyst, or an advanced-STEM specialist, you are valuable for a different reason: you can define what "correct" means in a domain the engineers cannot. PhDs and grad students are described as the highest-paid tier by a wide margin, and machine-learning literacy helps but is not required, because the labs supply the training machinery. What they cannot supply is your judgment.

Here is who each rung actually suits:

  • Software engineers who like turning fuzzy problems into precise specs: aim straight at environment building and grader authoring, and use the open bounty hub as your portfolio.
  • Quantitative and STEM professionals (data scientists, physicists, mathematicians): reasoning-trace authoring and grader design in your field pay a premium, and your instinct for defining correctness transfers directly.
  • Licensed domain experts (medicine, law, finance): you are the scarcest input on the market for domain-specific tasks; lead with the credential, not with generalist labeling.
  • Careful generalists with strong judgment but no code or credential: start with trajectory annotation as an on-ramp, build domain depth deliberately, and treat this as the direction to grow toward rather than a job you can start at the top of today.

The reason this breakdown matters more than a generic "here is who should apply" is that it tells you which application to submit and what to emphasize. A physician who applies as a generalist and accepts $25 an hour has thrown away a credential worth $150 to $300 an hour. A strong engineer who waits for a credential they do not need has ignored a door that is already open. Aim at the rung your background actually fits.

6. The Skills That Matter, and How to Build Them

The skill stack for well-paid environment work is specific, and the encouraging part is that the engineering half is buildable without any formal program, because the field accepts artifacts over credentials.

In rough order of leverage:

  • Problem decomposition and task design. The ability to take a messy real task and break it into a precise, self-contained problem with a clear success condition. This is the meta-skill under everything else.
  • Defining verifiable success criteria. Writing graders, rubrics, and test cases that capture what "done correctly" means. This is the craft at the heart of RLVR, and the single most valuable thing you can demonstrate.
  • Verifier debugging and adversarial testing. Because a reward function is just code, you have to test it against a model that is actively trying to cheat, and confirm after the fact that it measured what you intended. Engineers who can do this are exactly what the labs are short of.
  • Containerization and tooling literacy. Python plus Docker plus the ability to wire up a sandbox the model can act inside. The environment-builder listings assume real software engineering.
  • Domain expertise. Where you have it, this outranks everything for pay, because it is the scarcest input and cannot be faked.

To turn that list into a plan, the highest-return move is unusually concrete: build one real environment and publish it. Prime Intellect ships an open-source library called verifiers and a trainer called prime-rl, plus documentation for building environments with built-in reward functions. Pick a task you understand deeply, write it as an environment with a clean grader, and submit it to the Environments Hub. You will learn the craft by doing it, you may earn a $1,000 to $5,000-plus bounty, and, most importantly, you will have a public artifact that proves you can do the work. Three deep, well-built environments beat any paragraph asserting you are good at this, because the field is meritocratic about checkable evidence. If your background is engineering, the same tooling literacy is shared with coding and software evaluation work, which is another route in and a good complement.

When you build that first environment, make it demonstrate the three things a reviewer actually looks for, in this order: that your grader measures the real goal and not a convenient proxy, that you tried to break your own grader and closed the holes you found, and that the task sits in the useful difficulty band (hard enough to be informative, solvable often enough to train on). A tidy repository with a clear README, a reproducible container, and a short note on the reward-hacking attempts you defended against will read as senior even from someone with no formal title, because it shows exactly the judgment the job is about. That single artifact does more for an application than a decade of asserting you understand reinforcement learning, and it is the fastest way to convert curiosity into an offer.

7. Who Is Hiring in 2026, Compared

The buyers are the frontier labs (Anthropic, OpenAI, Google, Meta, xAI) and a growing set of product companies. Some, such as Cursor, build in-house; others partner with labs on replicas of their own software so a model can learn to operate it (Epoch names Salesforce, Slack, Shopify, and Stripe among them). But you do not contract with the labs directly. You go through the human-data vendors, and they occupy very different tiers, so match yourself to the tier rather than applying everywhere.

A July 2026 industry tally counts more than 50 companies selling data and RL environments to labs, roughly $8.5 billion in combined annual revenue and about $100 billion in combined valuation, with more than 75 percent concentrated in four players: Scale, Surge, Mercor, and Handshake. Treat those aggregate figures as an analyst estimate rather than an audited number. For the vendors' own numbers, AIData.Broker, which we also maintain, tracks the newest revenue figure each data vendor has published and the disclosed funding raised by data companies per quarter, each with its source. The vendor-level detail below is what actually matters for where you apply.

VendorStatus and specialty (mid-2026)Best for
MercorPivoted into RL environments and expert data; $10B valuation, acquired RL-environment specialist Sepal AIEngineers and credentialed experts; clear rate tiers
Surge AIBootstrapped, built a dedicated RL-environments team; ships the EnterpriseBench workplace simulationEnterprise-workflow and coding environments
Prime IntellectOpen Environments Hub with 2,500+ community environments and a worldwide bounty programAnyone building a public portfolio
TuringRepositioned around AGI; built a 10,000+ Python-task RLEF datasetCoding and reasoning environments
Handshake AIReached ~$1B annualized AI-training revenue, one of the big fourBroad expert recruiting
Micro1Grew to ~$200M annualized in 2026 on the back of an AI recruiterFast application, engineering tracks
Invisible TechnologiesRaised ~$100M for RL gyms and "mirror worlds"Operations-style agentic environments
AlignerrContributor marketplace over Labelbox; ~$15 to $125/hr reportedAccessible on-ramp

Two names deserve a closer look because they define the poles of the market. Scale AI, working through its Outlier brand, is the cautionary tale: after Meta took a large stake in mid-2025, rival labs cut contracts, and the company laid off about 14 percent of staff, with its CEO now guiding 2026 revenue to just over $1 billion, down from about $2 billion in 2025. That decline is the single clearest illustration of money leaving static labeling. At the other pole, Prime Intellect is the open door: it deliberately publishes environments as open-source and crowdsourced more than 400 frontier environments in about two months through bounties and a residency, precisely because it argues closed, expensive environments are the reason open models fall behind. Beyond these, newer pure-play entrants named by Wing include Bespoke, Applied Compute, and Cognition, and HUD.ai is another route to publish environments to labs.

8. What It Really Pays: Per Task, Per Hour, and by Tier

Pay in this category comes in two very different currencies, and confusing them is how people either undersell their work or believe a headline that is really an enterprise contract price. There is what the lab pays the vendor per task, and there is what the vendor pays you per hour.

On the per-task side, Epoch AI reports that individual expert-authored tasks run $200 to $2,000 each, with a rare, very hard one reaching $20,000. A website replica costs on the order of $20,000, and a complex product replica, such as a Slack clone, can reach $300,000. Exclusive deals cost roughly four to five times a non-exclusive one, and full lab contracts are often six to seven figures per quarter. These are vendor prices, not your paycheck, but they explain why the hourly rates are high: the underlying artifact is genuinely valuable. The chart below shows the ladder of what a lab pays for an authored task versus a full build.

What Labs Pay per RL Task or Build (2026)
Reported price to the vendor, USD (log-scale ladder)

On the hourly side, the distribution is wide, and knowing where you fall on it is the most useful thing you can do before applying. Mercor's own rate guide puts the national-average AI-trainer rate at about $31 an hour, with expert and credentialed work at $75 to $200-plus, and its CEO stated the platform's average pay rate "surpassed $100 an hour". Software engineers building RL environments sit roughly in the $70 to $160 an hour band. Domain experts commonly earn $75 to $200-plus, with the top medical, legal, and finance tiers reported at $150 to $300-plus on longer commitments.

TierTypical hourly rateWho it is
Entry / basic labeling$12 to $25/hrNo specific credential; not the environment work itself
Mid-level specialized$25 to $53/hrCoders and specialists in training
Environment-engineering SWE$70 to $160/hrBuilding and containerizing environments
Expert / credentialed$75 to $200+/hrPhD, MD, JD, senior engineer authoring and verifying tasks
Top medical / legal / finance$150 to $300+/hrCredentialed specialists on longer engagements

Rates as reported by platforms and third-party trackers in 2026. Actual offers vary by project, domain, commitment, and your location.

The chart below shows the same reality visually: pay rises steeply with skill and credentials, and the gap between generic labeling and expert environment work is roughly ten-fold. That gap is the entire opportunity, and it means the return on building a genuine skill or attaching a credential dwarfs the return on simply logging more hours at the bottom.

Hourly Pay by Tier in Agentic and RL-Environment Work (2026)
Midpoint of reported range, USD per hour

A realistic engagement looks like this: the expert marketplaces quote environment work at 15 to 25 hours a week, flexible up to 40, on contracts of at least a quarter. A credentialed engineer holding steady expert-tier work at, say, $110 an hour for 20 hours a week grosses about $2,200 in a full week, though the volume is lumpy and the effective rate sits below the headline once ramp-up and unpaid calibration are counted. Bounty work behaves differently again: a single strong environment can pay $1,000 to $5,000-plus as a one-off, which makes it a portfolio investment as much as an income stream. And at the very top, the $500,000 salaries Mechanize reportedly offered are the ceiling of the distribution, not its median. Plan around the expert band, and treat the headline numbers as the ceiling they are.

9. How to Get Started and Land Your First Paid Task

There is a repeatable path in, and following it in order matters, because each step produces the evidence the next step needs. Unlike most premium work, this category has a door that requires no application at all, and using it first is the single highest-leverage move a newcomer can make.

  1. Build a public environment on Prime Intellect first. The Environments Hub and Bounty Program let you build and publish an environment using the open-source verifiers library, earn a bounty, and create a public artifact a lab can inspect. This is your portfolio, your training, and your credential all at once, and it is open worldwide. HUD.ai is a second route to publish environments to labs.
  2. Apply to the expert marketplaces with that artifact in hand. Mercor uses an AI-vetted interview; Surge AI, Handshake AI, Turing, Micro1, and Alignerr all recruit for this work. Domain-specialist networks such as Deccan AI and Pareto AI recruit for reasoning traces and rubrics specifically.
  3. Expect a real screen. A technical or coding assessment for engineering roles, credential verification for domain experts, then trial tasks. Contracts typically run at least a quarter, part-time or full-time.
  4. Lead with the right portfolio signal. For engineers, that is a published environment plus demonstrated Python, containerization, and a grader that resists reward hacking. For domain experts, it is the credential plus a sample reasoning trace that shows how you decompose a hard problem in your field.
  5. Start at the on-ramp if you are new. Trajectory annotation and reasoning-trace projects have a lower barrier than full environment engineering; use them to build a track record, then move up into graders and environments.

The reason to front-load the free, public work is leverage. Reviewers on these platforms have seen ten thousand confident paragraphs and almost no verifiable evidence, so a published environment with a clean, hack-resistant grader is worth more than any claim.

A word on the money mechanics, because they catch people out. Almost all of this is independent-contractor work: platforms pay per task or per hour, usually on a weekly or bi-weekly cycle, and no tax is withheld for you. In the US that means self-employment tax on top of ordinary income tax, quarterly estimated payments if you expect to owe, and a real benefit to tracking deductible costs (a capable computer, your internet, a home-office portion). Outside the US the same principle holds under local rules: you declare and pay, and the platform withholds nothing. Task volume is also lumpy by nature, arriving in project waves that can pause without warning, which is the single strongest argument for running two or three platforms at once and cashing out regularly rather than letting a balance accumulate on any one of them. Going in with a spreadsheet and a set-aside percentage from your first paid task is the difference between a clean tax season and a scramble. To keep a live pulse on what is hiring and what it pays as you build, AITraining.jobs aggregates current agentic and RL-environment roles and posted rates, and you can browse the live openings to see where the demand is this week.

10. Misconceptions That Cost People Money

Every misconception in this field maps to a specific mistake in how people spend their time, so it is worth naming them precisely.

  • "It is just the next word for labeling." No. Commodity labeling is being automated and its rates are falling, while designing tasks, graders, and reasoning traces is priced at $200 to $2,000 per task and $75 to $300-plus an hour. It is the opposite end of the same market, and treating it as labeling leads people to accept generalist rates for expert work.
  • "You need a PhD." Only for the credentialed tracks. Domain specialists command $150 to $300-plus an hour, but strong software engineers without a PhD are in high demand to build environments, and the Prime Intellect bounties are open to anyone. Waiting for a credential you do not need is a mistake.
  • "The work is drying up because AI is getting better." Not this category. Static labeling is contracting ( Scale's 2026 revenue roughly halving) while RL environments are the growth area, with Anthropic alone discussing $1 billion-plus a year. Investing your months in the tasks the agents are absorbing is the error; investing them here is the move.
  • "AI will just build its own environments, so why start?" That is Mechanize's long-term thesis, and some easy environments are already automated. But 2026 demand for human-built environments is rising, not falling, because the bottleneck is quality at scale, not availability of tooling. The durable part is the human judgment layer: novel task design, domain-grounded correctness, and anti-cheat verification.
  • "The pay is $500,000." That figure is the top of a very wide distribution. The median AI-trainer rate is about $31 an hour, and entry labeling is $12 to $25. Anchor on the expert band you can realistically reach, not the headline.

11. The RL-Environment Bottleneck and the 2026 Outlook

The macro picture explains why this is a good bet, not just a good paycheck. Frontier labs are spending heavily on environments because they are the binding constraint on the next capability jump. Models are being trained to act, and acting well is learned by attempting verifiable tasks, not by reading more text. Epoch reports that RL is now the dominant use of frontier training data, roughly 10 to 20 times the demand of benchmarking or supervised fine-tuning, and that enterprise-workflow environments are the fastest-growing domain within it.

How far is there to go? The clearest single number is the capability gap the environments exist to close. On Surge AI's EnterpriseBench, a simulated startup, frontier models currently solve only about 30 percent of enterprise agentic tasks and fail more than 40 percent of simulated workplace tasks. That gap is the demand. Every point of it that the labs want to close requires more, better, harder environments, which requires more people who can build and verify them.

The Agentic Capability Gap Driving Environment Demand
Share of enterprise agentic tasks frontier models handle (Surge EnterpriseBench)

The stated "number one bottleneck," in Epoch's words, is maintaining quality while scaling: keeping contractors motivated, verifying environments, and QA-ing them against reward hacking. That is a human-labor problem, and it is why demand for skilled people is rising even as tooling improves. The market structure is consolidating around it: Wing predicts the roughly 20 seed-to-Series-A RL-environment startups will narrow to 3 to 5 leaders by 2030, with continued lab in-sourcing and rising demand for people who can build and verify environments, especially in coding (widely called the "holy grail" vertical) and messy enterprise workflows.

The through-line of every section above is the same one the people building this market keep returning to. Yuma Heymans (@yumahey), founder and CEO of AITraining.jobs and co-founder of the AI recruitment platform HeroHunt.ai, watches this demand flow through the platform's live listings from San Francisco, and the pattern he keeps naming is that as models get better at acting, verified human judgment about what "correct" means gets more valuable, not less, which is why the agentic and RL-environment roles are the fastest-growing and best-paid lane on the board.

12. A Decision Framework

So should you do this, and if so, how? Reason it from your own starting point rather than from the average.

If you are a software engineer, this is one of the highest-return uses of your spare hours available in 2026. Build one environment on Prime Intellect's bounty program, publish it with a clean grader you have tried to break yourself, and apply to Mercor and Turing with it as evidence. Expect the $70 to $160 band and aim to specialize toward the domains that pay most.

If you are a licensed domain expert (medicine, law, finance) or an advanced-STEM specialist, lead with the credential, apply to Mercor and the domain-specialist networks, and target the $150 to $300 band rather than accepting generalist rates. Your judgment about correctness is the scarcest input on the market; do not sell it as labeling.

If you are a careful generalist with neither code nor a credential yet, do not spam the premium platforms and get rejected. Start at the on-ramp with trajectory annotation and reasoning-trace work, build genuine depth in one domain, and treat this as the direction to grow toward. The category rewards patience with a steep pay curve once you are on the specialist side of it.

In every case: build checkable artifacts before you need them, because in a field this meritocratic, a published environment beats every confident claim; run more than one platform to smooth out lumpy task volume; and compare your realistic effective earnings against adjacent lanes like coding evaluation and domain-expert work before you specialize. The work is real, the pay is real, and the demand is being pulled up by the simple fact that teaching machines to act requires humans who can define, and defend, what acting correctly means.

This guide reflects publicly reported platform rates, market estimates, vendor statuses, and program terms as of July 2026. Pay ranges, valuations, task prices, platform access rules, and funding figures change frequently, and several figures cited here are reported or estimated rather than audited, so verify the current numbers on each platform or program before you rely on them. Nothing here is financial, tax, or legal advice.

Frequently asked questions

What is an RL environment in AI training?

It is a self-contained, runnable task with a clear success check that an AI agent can attempt over and over. You define the task, the tools the agent may use, and the 'grader' that automatically decides whether an attempt succeeded. The model learns from that verifiable reward. Building these environments is a distinct, well-paid role that barely existed two years ago and is now central to how frontier models are trained.

Do I need to know how to code to do this work?

For coding environments, yes, real software skill is required. But agentic and reasoning work spans every expert domain: a doctor can design clinical-reasoning tasks, a lawyer can write legal reasoning traces, a financial analyst can build valuation tasks. The common requirement is genuine domain expertise and the ability to define what a correct outcome is, not coding specifically.

Why does this pay more than rating AI answers?

Because it cannot be done by volume or by generalists. Designing a good task, specifying a verifiable reward, and judging a full multi-step trajectory takes real expertise and careful thought, so the labs pay a steep premium. Expert hourly rates run high, and the largest bespoke environment builds are commissioned into the hundreds of thousands of dollars: about $300,000 for a replica of a complex product like Slack.

How is this different from RLHF and preference rating?

Classic RLHF asks you to compare finished answers and pick the better one. Agentic and RL-environment work asks you to build the task, define success, and evaluate the model's entire process of solving it, including its tool use and intermediate reasoning. It is a step up in both skill and pay, and it is where a growing share of AI-training spend is going.