Skip to content
/ polish-rag Public

Rag build specifically for Polish language. By default it uses Bielik 11b-8bit. All of those components (llm, embeddings model and reranker) are meant to be self hosted. It is meant to be self hosted

License

MIT license
0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

Kurdzik/polish-rag

BranchesTags

Repository files navigation

Local RAG PL

Project that enables for local deployment of full rag backend that performs especially well in Polish language

Tech stack

All services are hosted with openai-compatibile api therefore we can connect to them using unified connectors

  • Base llm - Bielik 11b 8bit
  • Embeding model - snowflake-arctic-embed-l-v2.0
  • Reranker - sdadas/polish-reranker-bge-v2

Databases

  • Vector database - Qdrant
  • Fuzzy search db - Elasticsearch
  • App database - Postgres

Default tracer - Opik

TODO

  • Implement Active Directory login
  • Implement Auth middleware and JWT generation
  • Implement Basic chat view as a native component of the app

About

Rag build specifically for Polish language. By default it uses Bielik 11b-8bit. All of those components (llm, embeddings model and reranker) are meant to be self hosted. It is meant to be self hosted

Topics

elasticsearch self-hosted rag qdrant llm vllm bielik

Resources

Readme

License

MIT license
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published