feat(cli) Fallback to primary language name when tree_sitter_language_pack won't find a parser for 'hybrid' lexer language names (like 'javascript+genshitext')#138

Merged

Davidyz merged 8 commits intoDavidyz:mainfrom

May 21, 2025

Commits on May 21, 2025

feat(treesitter): Handle lexers from pygments.lexers.templates modules (lexers with '+' in their language names) when looking up parsers

Jufralice
authored and
Davidyz
committed
Add tests to cover my fix for the

Jufralice
authored and
Davidyz
committed
feat(chunking): Add filetype_map config option

Jufralice
authored and
Davidyz
committed
test(chunking): Add more tests for the chunker when using the filetype_map

Jufralice
authored and
Davidyz
committed
test(chunking): forgot to assign the emptyness of chunks

Jufralice
authored and
Davidyz
committed
(test) chunker. add yet another test to get full coverage

Jufralice
authored and
Davidyz
committed
Re-raise original exceptions (`re.error`, `LookupError`) with added notes instead of raising a new ValueError. This preserves the original exception type and traceback for better debugging.

Jufralice
authored and
Davidyz
committed
test(chunking): Correct test to expect LookupError instead of generic Exception

Jufralice
authored and
Davidyz
committed