Expert data from verified professionals.

Post-training data and model evaluations, created by practising professionals from across Europe. Two independent readers grade every item, and every delivery includes a quality report.

A physician in scrubs evaluating on a laptop in a hospital office at night
Physician · Hamburg
Identity
Licence
Domain test

Expert data for post-training and evaluation.

01

SFT data

Prompts and reference answers written by practising professionals.

02

Preference data

Pairwise comparisons with a written rationale.

03

Rubrics and gold answers

Grading criteria and reference answers for your evaluators and LLM judges.

04

Model evaluations

Expert grades on your model outputs, with a documented error analysis.

05

RL tasks

Domain tasks with verifiable checks for your environments.

Billed per expert hour, per item or as a fixed-price project.

Discuss pricing
A software engineer at a standing desk in a bright open-plan officeSoftware engineer · Rotterdam
DeliveryExample
RL tasks, software engineering
LanguageEnglish
Tasks600
Readers per task2
FormatJSONL

Accepted after review

Graded against your rubric, with a written rationale.

Each reader scores the item, records the reasoning and cites the rule that applies. The record is delivered with the data, as JSON or CSV in your schema.

An employment lawyer reading on a laptop in a glass-walled meeting roomEmployment lawyer · Berlin
Evaluation recordExample
Employment law · Germany · German
Prompt

Is a post-contractual non-compete clause binding on an employee if no compensation is agreed?

Model response

Yes. The clause is binding as long as it does not exceed two years.

Legal accuracyNot met
Cites the governing provisionNot met
ClarityMet
Reader 1 · Employment lawyer, Berlin2 of 5
Reader 2 · Employment lawyer, Hamburg2 of 5
Rationale

Without compensation of at least half of the last contractual pay for each year of the restriction, the clause does not bind the employee (§ 74 (2) HGB).

Grades agree. Item accepted.

Two independent readers on every item.

Reader 12 of 5 2 of 5Reader 2 4 of 5Reader 2 Senior reviewer Accepted Resolved

The grades match and the item is accepted: 382 of 400 items in this example batch.

The grades differ. A senior reviewer decides, and the case is listed in the quality report: 18 of 400 items in this example batch.

Every delivery includes a quality report with these figures, per batch and per expert.

96.4%Accuracy on gold items
0.86Agreement between readers, Cohen’s kappa
1.5%Errors found in review
4.5%Items reworked
Example quality report, 400 items

Verified professionals, working in your language.

Our experts already learn and look for work on StudySmarter and Talents. We select them by field, language and jurisdiction, verify identity and licence, and brief them on your task.

40millionlearners on StudySmarter
20millionprofessionals a month on Talents
A tax adviser in her office, listening
Tax adviser · MunichLicence checked
A pharmacist in a white coat in the back office of a pharmacy
Pharmacist · MilanLicence checked
A civil engineer with a tablet in a site office
Civil engineer · WarsawLicence checked
A financial analyst by a canal-house window
Financial analyst · AmsterdamDegree checked
A molecular biologist in a university laboratory
Biologist · CopenhagenDoctorate checked

Need another field? We find the experts on our platforms.

From scoping to regular delivery.

Request a pilotOur team reviews every request.

Scoping

Field, language, task and volume, agreed in one call.

Panel

Anonymised expert profiles for your approval.

Pilot

A paid pilot batch with a quality report.

Delivery

Regular batches, two readers on every item.

EU data protection by default.

EUProcessing and storage

Data is processed and stored in the EU.

0Model training

Client data is never used to train models.

NDAAccess

Named experts under NDA, with access per project.

Art. 28Data processing agreement

Under Art. 28 GDPR, for every project.

Frequently asked questions.

Further questions: hello@vaialabs.ai

When can a panel start?

The start date is agreed in the scoping call, once field, language and volume are defined. The experts are already registered on our platforms.

Can the experts work in our tools?

Yes. They work in your annotation tool or environment, or in ours.

Who owns the data?

You do. Delivered data is not reused for other clients.

How is the use of AI tools by experts controlled?

Each project has a policy on AI tools, and all work is logged. A breach ends the expert’s work on the project.

Can you work alongside our current vendor?

Yes. A pilot can cover a field or a language that your current vendor does not.

Human expertise, built into AI.

Request a pilot

Request a pilot

Tell us about your project. Our team reviews every request and replies by email.

Your email app opens with the request to hello@vaialabs.ai. We use your details only to answer it, see the privacy policy.