Skip to content

Out of memory #13

@gsvijayraajaa

Description

@gsvijayraajaa

I am trying to index a huge CSV file (~35GB). I have kept the --docs-per-chunk as 500 and --bytes-per-chunk to 100000. But then the RAM gets filled up as and when the csv file is continuously read. Any thoughts on the same?

I am working on a 16GB RAM machine with 4 core processor.

Regards,
Vijay Raajaa G S

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions