llm-lab

This project provides working sample implementations of several use cases involving Large Language Models.

How to use

Using UV (Preferred)

We've provided pyproject.toml file that defines all the dependencies required in the project

1. Open terminal in the project folder.
2. uv --version (if not installed then install it)
3. uv sync (Syncs dependencies and create a .venv folder)
4. Click on Select Kernel and set to .venv shown in the options. (Each time you open a jupyter notebook)

Using Ananconda

We've also provided anaconda environment configuration with the project.

1. Goto anaconda prompt
2. Create environment> conda env create -f environment.yml
3. Activate environment> conda activate llm-lab
4. Open in jupyter lab or your favorite IDE> jupyter lab
5. Make sure to create and save .env file in the project root folder. Save the keys such as OPENAI_API_KEY=

Summarization

1. Summarizing a web page
2. Summarizing news stories from a news aggregator
3. Summarizing a Youtube video