Skip to content
GenLM Eval
schema
Initializing search
GitHub
GenLM Eval
GitHub
Home
API Reference
API Reference
genlm
genlm
eval
eval
core
core
dataset
evaluator
model
runner
domains
domains
ds1000
ds1000
_forkserver_worker
ds1000
forkserver
runtime_no_error_potential
utils
goal_inference
goal_inference
goal_inference
goal_potential
json_schema
json_schema
dataset
evaluator
livecodebench
livecodebench
capture
fetch
harness
livecodebench
prompts
public_test_potential
runtime_execution
runtime_no_error_potential
vendored
vendored
testing_util
livecodebench_multilingual
livecodebench_multilingual
capture
dataset
evaluator
executor
mbpp_agnostic
prompts
vendored
vendored
testing_plang
molecular_synthesis
pattern_matching
spider
spider
spider
spider_eval
spider_eval
content_encoder
dialogue
evaluation
evaluator
paths
process_sql
schema
schema
Table of contents
schema
utils
table_column_potential
util
Cookbook
Cookbook
Overview
Supported Domains
Supported Domains
Pattern Matching
Text to SQL (Spider)
Molecular Synthesis
DS-1000
LiveCodeBench
Multilingual LiveCodeBench
Goal Inference
Custom Domains
Evaluate Models Using Custom Constraints
Table of contents
schema
schema
genlm.eval.domains.spider.spider_eval.schema