./generation contains scripts for generating answers or samples with models (API or local models).

./models contains scg.py which has classes for our basic algorithms.

Environment Setup

# dependencies
uv sync

Run a task

To run a task with iid datasets:

uv run ./scripts/run_all.sh

or

source .venv/bin/activate
./scripts/run_all.sh

Datasets

This repository contains four iid datasets along with LLMs:

• data/nq/gpt3.5
• data/nq/llama3.1-8B
• data/triviaqa/gpt3.5
• data/triviaqa/llama3.1-8B

Also, to simulate adaptive dialog environments:

• data/dialog/squad