reviewbot

A code review agent that can review PRs

┌────────────────┐                ┌──────────────────────────────┐           ┌──────────────┐
│   VSC          │                │  Your Backend                │           │ LLM provider │
│                ├---[webhook]--->│  (Flask/FastAPI)             ├--[API]--->│     API      │
│  MR/PR Created │                │                              │           │              │
└────────────────┘                │  /webhook                    │           └──────────────┘
                                  │  endpoint                    │
                                  │                              │
                                  │  1. Parse event              │
                                  │  2. Fetch diff               │
┌────────────────┐                │  3. Apply external knowledge │
│   VSC          │                │  4. Run code review agent    │
│  MR/PR Comment │<--[comment]----┤  5. Format reply             │
└────────────────┘                │  6. Post comment             │
                                  └──────────────────────────────┘

Features

• Self-hosted
• Support many LLM providers: OpenAI, Claude, non-official providers, etc. (Can be extended)
• Support many mainstream VCS: GitHub, GitLab, DevOps, etc. (Can be extended)
• Support many code review agents: Simple, Advanced, LangChain, etc. (Can be extended)
• Can be integrate external knowledge base.

TODO

• ✅ Complete data models
• ✅ Complete vcs integrations
• ✅ Complete code review agent
• ✅ Complete backend (endpoint, health check, logging, etc.)
• ✅ Test (parse events, fetch diff, run code review agent, format reply, post comment)
• ⏳ Queue processing
• Enhance code review agent

Structure

reviewbot/                    # Project root  
├── src/
│   ├── core/                 # Domain logic and shared components
│   ├── vcs/                  # All VCS provider integrations isolated
│   ├── agent/                # Code review agent
│   └── config/               # Configuration management
├── misc/                     # Experimental/
├──backend/                   # API layer
│    ├── __init__.py
│    ├── app.py               # FastAPI app
│    ├── webhooks/            # Webhook handlers
│    │  ├── github.py
│    │  └── gitlab.py
│    ├── routes/              # API endpoints
│    └── middleware/          # Auth, logging, etc.
├── tests/
├── docs/                     # Documentation
├── scripts/                  # Utility scripts
├── requirements.txt
├── README.md
└── .env.example
└── Makefile                  # Development commands

Quickstart

source .venv/bin/activate
uvicorn backend.app:app --reload --host 0.0.0.0 --port 8000

References

https://mypy-lang.org/

https://docs.python.org/3/library/abc.html

https://docs.python.org/3/library/typing.html

https://docs.pydantic.dev/latest/

https://github.com/openai/openai-python

https://github.com/anthropics/anthropic-sdk-python

https://github.com/langchain-ai/langchain

https://docs.gitlab.com/

https://docs.github.com/en

https://learn.microsoft.com/en-us/azure/devops/cross-service/end-to-end-traceability?view=azure-devops