C5R CORP.

Assign structures from NMR

Instrument analysis6 tasks
Task space

Identify small-molecule samples from raw proton and carbon NMR data.

Different molecules can share the same formula but have different structures and properties, so matching the formula alone is not enough to confirm a product’s identity. NMR signals depend on the chemical environment around each hydrogen or carbon atom. Their positions and splitting patterns provide clues about nearby atoms and bonds, helping chemists distinguish candidate structures and check whether they made the intended compound.

Agents process the raw measurements and compare the resulting spectra with twelve candidate structures for each sample. They use the NMR evidence to assign probabilities to each candidate and to the possibility that none matches.

Scoring

Correctly identify all six samples with the highest-ranked answer, including NONE when no candidate structure matches.

RESULTS

Identify small-molecule samples from raw proton and carbon NMR data.
ModelPass@1Cost ($)Model/API inference cost only, averaged per task attempt. Lab and labor costs are not reported. Repeats are averaged using the same task and family weights as scores.
Claude Fable 5.1xhigh29.2%$22.68
Grok 4.6xhigh0.0%$2.44
Claude Opus 5xhigh0.0%$17.13
GPT–5.6 Solxhigh0.0%$2.51
GPT–6 Astraxhigh0.0%$5.67
Gemini 3.8 Flashhigh0.0%$2.05
0%50%100%

Whiskers show ±1 standard error from repeats.

Model trajectories

One example per model.

Run grading

Fail
MeasurementRecorded resultOutcome
Wells correctly assigned66.7 %× Fail

Pass condition: Correctly identify all six samples with the highest-ranked answer, including NONE when no candidate structure matches.

Assign structures from NMRClaude Opus 5 xhigh
Run gradingFail
00:0000:01

Model activity

Model transcript

Loading transcript…