Skip to content

Conversation

@mmailhos
Copy link
Owner

@mmailhos mmailhos commented Oct 24, 2025

This PR adds support for metadata alongside vectors. It helps store arbitrary data (tags, K:V pairs) along with the indexable text.

@mmailhos
Copy link
Owner Author

This PR also introduces a breaking change: the POST /vector is no longer supported.
Reasons:

  1. Consistency: All embeddings are generated by the same model and normalization pipeline, ensuring vectors live in a coherent semantic space.
  2. Simplicity: Clients only send text — no need to manage model versions, dimensions, or preprocessing — making integration trivial and error-free. (DX improvement)
  3. Security: Prevents injection of arbitrary or adversarial vectors that could corrupt search results or break similarity guarantees.

@mmailhos mmailhos marked this pull request as ready for review October 24, 2025 04:27
@mmailhos
Copy link
Owner Author

Side note: I'll also be looking at some memory optimisations in sub-sequent PRs (prevent keeping multiple copies, or preventing repeated cloning).

@mmailhos mmailhos merged commit f04b460 into main Oct 24, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants