Build BenchmarkSuite only once per CLI run #1527

Job	Run time
benchmark-run-once	1m 33s
benchmark-graph	51s
test (head)	1m 24s
test (truffleruby)	56s
test (ruby)	55s
benchmark-ractor (head)	12m 12s
benchmark-default (head)	10m 55s
benchmark-default (ruby)	10m 58s
benchmark-ractor (ruby)	12m 45s
benchmark-default (truffleruby)	13m 41s
benchmark-ractor-only (head)	46s
benchmark-ractor-only (ruby)	51s
all-tests	2s
	1h 7m 49s

Provide feedback