High CPU usage when pull large models #100
Description
When pull model with default arguments, modctl‘s CPU usage is very high. Every core provides only 100M/s writing performance.
golang pprof top:
File: modctl-debug
Type: cpu
Time: Mar 3, 2025 at 8:12pm (CST)
Duration: 30.13s, Total samples = 159.72s (530.13%)
Entering interactive mode (type "help" for commands, "o" for options)
(pprof) top
Showing nodes accounting for 153.26s, 95.96% of 159.72s total
Dropped 239 nodes (cum <= 0.80s)
Showing top 10 nodes out of 52
flat flat% sum% cum cum%
122.63s 76.78% 76.78% 122.63s 76.78% crypto/sha256.block
24.82s 15.54% 92.32% 24.82s 15.54% internal/runtime/syscall.Syscall6
2.07s 1.30% 93.61% 6.50s 4.07% runtime.stealWork
1.96s 1.23% 94.84% 1.96s 1.23% runtime.(*randomEnum).next (inline)
1.05s 0.66% 95.50% 1.05s 0.66% runtime.usleep
0.24s 0.15% 95.65% 1.08s 0.68% runtime.selectgo
0.18s 0.11% 95.76% 1.57s 0.98% runtime.runqgrab
0.15s 0.094% 95.86% 0.88s 0.55% runtime.netpoll
0.08s 0.05% 95.91% 8.24s 5.16% runtime.findRunnable
0.08s 0.05% 95.96% 8.68s 5.43% runtime.schedule
svg:
profile.svg