The Market for Coding & Software Evaluation Work

Method and definitions

The public job boards of the AI training platforms this site tracks, read every day. Apply clicks are made on AITraining.jobs; full descriptions come from the platforms whose boards publish them. Every figure is computed by one database query over the window shown, the same query for the live report and for every edition. Each figure states its sample beneath it.

Kind of work

Each role is classified from its title and description into one of the twelve kinds of AI training work this site tracks; this report counts the roles classified as Coding & Software Evaluation.

Fixed panel

The platforms already tracked when the weekly series opens. The index follows their open roles, so a platform added later (such as OpenTrain AI and Welo Data in September 2026) never reads as growth.

Index

The panel's average open roles in a week, divided by the same in the base week, times 100; shown beside the same index for all AI training work on the same platforms.

Open role

A role listed by a given day and still in its platform's feed that day.

New listing

A role that first appeared during the window on a platform already tracked before that week. A platform's first week in this dataset is its back catalogue and is not counted as new.

Removed listing

A role that left its platform's feed during the window.

Days listed

From a removed role's listing date to the last day it was seen in its feed. A median needs at least 10 removed roles.

HHI

Herfindahl-Hirschman Index: the sum of every platform's squared percentage share of open roles, 0 to 10,000. Under 1,500 unconcentrated, 1,500 to 2,500 moderately, above 2,500 highly concentrated.

Advertised pay

The hourly figure a posting states (the middle of a stated range). Medians need at least 8 roles stating a rate; the middle half runs from the 25th to the 75th percentile.

Clicks per open role a week

Apply clicks on AITraining.jobs on a specific role, divided by the days the roles were open, times 7.

Demand index

Clicks per open role a week divided by the same rate across every role on the site. Above 1, the roles draw more applicants than the average role.

Listing age

When a role was listed relative to the window's first day: during the window, up to 4 weeks before it, 4 to 12 weeks before or longer. The listing date is the job board's posting date, or else the first day the role appeared in the feed.

Location rule

Read from each posting's location text and, where that names no country, from what the posting's own description states: open worldwide, worldwide except listed countries, only listed countries, or no rule stated.

Open to a country

A role is open to residents of a country if it is open worldwide, its list names the country, or its exclusion list does not. The 20 countries compared are the same in every report of the series.

Window

Live: the last 28 complete days, in UTC, and the last twelve complete ISO weeks (from the week of 3 Aug 2026 at the earliest) for the weekly series. Edition: one calendar month, in UTC, and its weeks.

What this data cannot tell you

• Platforms that recruit without a public job board are not counted. Several large ones invite workers to projects directly.
• A listing is not a hire. Some platforms keep evergreen roles open for months, and some post one listing per language or country.
• Apply clicks measure interest among the people who use AITraining.jobs, and what is shown first gets clicked more. Clicks are never published by platform.
• Full descriptions are published by a few platforms only, so the requirements figure describes their roles and appears only when at least 10 roles of this kind are described.
• A kind of work with few open roles gives figures that move with a handful of postings: rows on too little data are marked as a small sample.

How the job feeds are read and roles are classified: site methodology. How fresh, complete and consistent the data is, checked every day: data quality and coverage.

Editions

The live report covers the last 28 complete days and changes every day. Each complete month is also published as an edition, frozen two days after the month ends, so a figure you cite from an edition never moves.

• Live dataLast 28 complete days, recomputed daily
• September 2026 editionFrozen 10 Oct 2026
• August 2026 editionFrozen 10 Oct 2026

Cite and reuse

Free to quote, chart and republish under CC BY 4.0 with a link to this page. Live figures change daily: cite a monthly edition for numbers that will read the same later, or keep the access date.

@misc{aitrainingjobs_coding_ai_training_market_live,
  author = {{AITraining.jobs}},
  title = {The Market for Coding & Software Evaluation Work (live data, 20 Sep 2026 to 17 Oct 2026)},
  year = {2026},
  howpublished = {\url{https://www.aitraining.run/research/coding-ai-training-market}},
  note = {Accessed 18 Oct 2026},
}

More research

The same figures for every other kind of work:

• AI Evaluation & Rating (RLHF) market
• Math & STEM market
• Law, Medicine & Finance market
• Agentic Tasks & RL Environments market
• Data Annotation & Labeling market
• Robotics & Physical-AI Data market
• Multilingual & Localization market
• Transcription, Audio & Speech market
• Writing & Content market
• Red-Teaming & AI Safety market
• Research Studies & Surveys market

• Which AI Labs Are Hiring for Human DataWhich AI labs are hiring for the teams that buy, run and evaluate human data, and for what roles?Read the report
• Who Is Buying AI Training DataWhich AI labs and data vendors have people whose job is to source, license or acquire training data right now?Read the report
• Where Human-Data Vendors Are BuildingHow fast are the human-data vendors hiring their own staff, and for which functions?Read the report
• What AI Labs Pay for Human DataWhat do AI labs spend on human data, what do vendors bill, what do the experts receive, and what do RL environments and tasks cost?Read the report
• What AI Labs Are BuyingWhich kinds of training data are in rising demand, and which are cooling?Read the report
• AI Training Data Licensing DealsWho has licensed content and data to which AI companies, on what terms and for how much?Read the report
• The State of AI Training PayWhat does AI training work pay, by kind of work and by platform?Read the report

All 78 research reports