Run fine-tuning grader

documented

Run a grader for a fine-tuning job.

POST /fine_tuning/alpha/graders/runFine-Tuningno implementation yet0 runs

Input

grader*

Grader object

{"type":"string_check","name":"Example string check grader","input":"{{sample.output_text}}","reference":"{{item.label}}","operation":"eq"}

reference_answer*

Reference answer

The reference answer to compare against

model_sample*

Model sample output

A sample model output to be graded

Calls OpenAI as you (your API key is your account); keychains.dev holds the credentials.