feat: add FTMS (File/Text Management System)#8
Open
modpunk wants to merge 9 commits intoopenagen:mainfrom
Open
feat: add FTMS (File/Text Management System)#8modpunk wants to merge 9 commits intoopenagen:mainfrom
modpunk wants to merge 9 commits intoopenagen:mainfrom
Conversation
Defines architecture for file upload, storage, text extraction, AI-powered media description, and FTS5 full-text search indexing. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Detailed step-by-step plan covering config, schema, storage, index, extraction, description, gateway routes, web UI, and proxy changes. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
…s-util, duplicate chat fn, bin ftms module)
|
Thanks for contributing to ZeroClaw. For faster review, please ensure:
See |
PR intake checks found warnings (non-blocking)Fast safe checks found advisory issues. CI lint/test/build gates still enforce merge quality.
Action items:
Run logs: https://github.com/openagen/zeroclaw/actions/runs/22280116181 Detected blocking line issues (sample):
Detected advisory line issues (sample):
|
Collaborator
|
Thanks for contributing to ZeroClaw.
|
|
Hi @modpunk, friendly automation nudge from PR hygiene. This PR has had no new commits for 53h and still needs an update before merge:
Recommended next steps
Maintainers: apply |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
src/ftms/): file upload, storage, SQLite FTS5 indexing, text extraction, and media description/upload,/files,/files/search,/files/{id},/files/{id}/download) with configurable body limit for uploadsFtmsConfigwithenabled,max_upload_size_mb,storage_dir,auto_describeoptionsArchitecture
Files are stored at
~/.zeroclaw/files/YYYY/MM/DD/{uuid}.{ext}with metadata + full-text content indexed in SQLite FTS5. Text is auto-extracted from text/JSON/XML/PDF files; images get base64 data-URI descriptions. Search uses FTS5 ranking with optional MIME type and date filters.New files
src/ftms/mod.rs— FtmsService orchestratorsrc/ftms/schema.rs— FileRecord, FileMetadata, FileSearchResult, FileListResponsesrc/ftms/storage.rs— Date-organized file storagesrc/ftms/index.rs— SQLite FTS5 index with content-sync triggerssrc/ftms/extract.rs— Text extraction (UTF-8, PDF)src/ftms/describe.rs— Media description (image base64, audio/video metadata)Test plan
🤖 Generated with Claude Code