python-ai-extension-server

Python Server to use local LLMs

Table of Contents

• Installation
• Usage
• Features
• Contributing
• License

Installation

To install the necessary dependencies, run:

pip install -r requirements.txt

Usage

To start the server, use the following command:

python main.py

Features

• Supports multiple local LLMs
• Easy to integrate with other applications
• High performance and low latency

Contributing

Contributions are welcome! Please fork the repository and submit a pull request.

License

This project is licensed under the GNU License.