Commit e8622e1
[CELEBORN-2061] Introduce metrics to count the amount of data flushed into different storage types
Added metrics for the amount of data written to different storage types, including Local, HDFS, OSS, and S3
Currently, there is a lack of data volume written to each storage, and it is impossible to monitor the size and speed of writing.
no
Cluster Test
Closes #3362 from TheodoreLx/add-flush-count-metric.
Authored-by: TheodoreLx <1548069580@qq.com >
Signed-off-by: SteNicholas <programgeek@163.com>1 parent b92820c commit e8622e1
File tree
4 files changed
+1755
-888
lines changed- assets/grafana
- worker/src/main/scala/org/apache/celeborn/service/deploy/worker
- storage
4 files changed
+1755
-888
lines changed
0 commit comments