Skip to content

ashworks1706/llm-from-scratch

Repository files navigation

llm-from-scratch

A small, educational codebase and notebook that implements and documents core concepts behind large language models (LLMs) from first principles. This repository collects notes, math derivations, and simple implementations so you can learn the building blocks of modern LLMs and experiment with training & inference.

This repo is intended for learning and research — not a production LLM.

What you'll find here

  • tutorial.ipynb — the core learning notebook with notes, math, and runnable code.
  • explanability/ — supporting code that documents explainability concepts used in the repo.

About

A theoretical and practical deep dive into Large Language Models and their applications on Deep learning from scratch.

Topics

Resources

License

Stars

Watchers

Forks