Skip to content

Enourmous memory usage on example with word counting #122

@uhrb

Description

@uhrb

Hi!
I just tried to run your example from https://github.com/MSRCCS/Prajna/wiki/C%23-Examples#the-first-prajna-c-example-walk-through

My text file is about 10Mb. I not expected to see memory usage about 2Gb to calculate words in this file. Yea, there may be little overhead, but can you actually tell how i can tune memory usage?
I can see from one of the issues, that you use memory cache 1Gb per node, but i cannot see any possibility, how do i can configure cache size, or even maybe use my own cache (for example, out of application memory).
One more thing i can see, node count not correspond to cache usage (for 2 or 3 nodes, i have 2Gb, for 4 nodes - 3Gb). Seems to be, node allocate memory only when it use it, but it is not clear right now for me. Could you please explain?

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions