Skip to content

[BUG] StringChunker doesn't handle multi-line text. #146

@Davidyz

Description

@Davidyz

As discussed in #145 , this causes trouble to the line range computation when StringChunker is being used as a fallback chunker for the TreeSitterChunker. A \n based text-counting method (and/or a start_pos when the chunker is initialised) should be implemented so that it produces correctly computed start and end position.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions