External pipelines · RISE project catalogue
Aviary (FutureHouse)
A gymnasium for defining custom language-agent environments (arXiv:2412.21154), with pre-built environments for math, general knowledge, biological sequences, scientific literature search, and protein stability. Aviary is **evaluation infrastructure** for RISE systems, not a RISE pipeline itself — but it is directly relevant because it defines tasks against which RISE pipelines can be measured.
Where it sits
left: what it builds on · right: what builds on it · pale: exampleContributed by FutureHouse
How studies reach it
No published study reaches it yet.
Disciplines it reaches
No study reaches it yet.
Solid: published studies. Light: examples.
Computed from the records on this site: what each study, template and specialist names as used, which study extends which, and who contributed what. 0 studies in total.
What it does
Provides a standardized environment-and-agent abstraction (paired with the LDP language-decision-process library) for benchmarking agentic systems on scientific tasks. Lowers the cost of producing comparable evaluations across pipelines.
- Focus
- end-to-end
- Inputs
- task-specification
- Outputs
- agent-trajectories, evaluation-metrics
- Architecture
- tool-use, artifact-versioning
- Maintained by
- FutureHouse
- Started
- 2024
Description
Data model- Discipline
- General
- Method family
- not specified
- Design
- not specified
- Research stage
- Data analysisLiterature discovery
- Contributors
- FutureHouse
- Usage
- not used in published research yet
- Source
- RISE project catalogue · projects/landscape · @4c17bae
- Record
- pipeline:aviary · JSON
Solid tags are declared by the source or mapped from its terms; dashed tags are inferred by a published rule. Hover a tag for its provenance.
Bring it into the standard
A pipeline built outside E2ER can meet the standard by describing its steps as a template, attaching the floor of checks and publishing evaluation records. Its authors keep ownership and credit.