Feature/tf modernization cleanup#250

Closed

FileSystemGuy wants to merge 193 commits intoTF_Modernizationfrom

feature/tf-modernization-cleanup

Commits on Feb 19, 2026

Refactor BenchmarkRun to use data contract pattern

claude
authored and
FileSystemGuy
committed
Add comprehensive pytest-based unit testing framework

claude
authored and
FileSystemGuy
committed
Increase test coverage to 74% with additional unit tests

claude
authored and
FileSystemGuy
committed
Add initial KV Cache benchmark implementation for MLPerf Storage v3

hazemawadalla
authored and
FileSystemGuy
committed
feat: Replace legacy spillover logic with Waterfall LRU architecture

hazemawadalla
authored and
FileSystemGuy
committed
Fix two runtime errors in RAG-enabled benchmark mode

hazemawadalla
authored and
FileSystemGuy
committed
Add detailed README.md for running the different invocations of kv-cache.py

hazemawadalla
authored and
FileSystemGuy
committed
fix: line endings from dos2unix; increase cpu memory to 4GB for mlperf invocation

hazemawadalla
authored and
FileSystemGuy
committed
Update MLperf v3 KV cache proposal.md to recommend using a minimum of 4G of DRAM to reduce Queue contention and unrealistic read amplification

hazemawadalla
authored and
FileSystemGuy
committed
Add storage throughput metric, ShareGPT integration, LMCache validation suite, and production tooling for MLPerf Storage v3

hazemawadalla
authored and
FileSystemGuy
committed
Update MLPerf v3 submission guidelines with discovery test validation

hazemawadalla
authored and
FileSystemGuy
committed
Improve test suite with HTML reporting and flexible tier assertions

hazemawadalla
authored and
FileSystemGuy
committed
Add pytest-html dependency for HTML test reports

hazemawadalla
authored and
FileSystemGuy
committed
Add unit test HTML report showing all 112 tests passing

hazemawadalla
authored and
FileSystemGuy
committed
Update NVMe Bandwidth specification to 14,000 MB/s

hazemawadalla
authored and
FileSystemGuy
committed
Fix KV cache size per token values in discovery doc

hazemawadalla
authored and
FileSystemGuy
committed
Fix system_info metadata fallback for ClusterInformation

claude
authored and
FileSystemGuy
committed
Add .gitignore for Python cache and common artifacts

claude
authored and
FileSystemGuy
committed
Add implementation plan for MPI-based cluster information collection

claude
authored and
FileSystemGuy
committed
Implement Phase 1: MPI-based cluster information collector

claude
authored and
FileSystemGuy
committed
Implement Phase 2: Extend HostInfo and ClusterInformation data classes

claude
authored and
FileSystemGuy
committed
Implement Phase 3: Integrate cluster collection with Benchmark classes

claude
authored and
FileSystemGuy
committed
Fix mpi4py import error handling in MPI collector script

claude
authored and
FileSystemGuy
committed
Add comprehensive code improvement plan

claude
authored and
FileSystemGuy
committed
Enhance code improvement plan with refactored phases

claude
authored and
FileSystemGuy
committed
Implement Phase 1: Foundation - Interfaces and Abstractions

claude
authored and
FileSystemGuy
committed
Implement Phase 2: Modular Rules Engine

claude
authored and
FileSystemGuy
committed
Implement Phase 3: CLI Refactoring and Benchmark Registry

claude
authored and
FileSystemGuy
committed
Implement Phase 4: Test Infrastructure Enhancement

claude
authored and
FileSystemGuy
committed
Implement Phase 5: Documentation and Type Annotations

claude
authored and
FileSystemGuy
committed
Implement Phase 6: KV Cache Benchmark Integration

claude
authored and
FileSystemGuy
committed
Implement Phase 7: Reporting System Refactoring

claude
authored and
FileSystemGuy
committed
Implement Phase 8: Error Handling and User Messaging

claude
authored and
FileSystemGuy
committed
Add fail-fast dependency validation and fix initialization bugs

authored and
FileSystemGuy
committed
Fix unhashable RunID bug in report generator

authored and
FileSystemGuy
committed
Update CLAUDE.md with test environment directories and examples

authored and
FileSystemGuy
committed
docs: map existing codebase structure

authored and
FileSystemGuy
committed
docs: initialize project

authored and
FileSystemGuy
committed
chore: add project config

authored and
FileSystemGuy
committed
docs: define v3.0 requirements

authored and
FileSystemGuy
committed
docs: create roadmap (10 phases)

authored and
FileSystemGuy
committed
docs(phase-1): research package management foundation

wvaske
authored and
FileSystemGuy
committed
docs(01): create phase plan for Package Management Foundation

authored and
FileSystemGuy
committed
docs: revise Plan 01-05 to address benchmark integration gap

authored and
FileSystemGuy
committed
feat(01-02): add uv CPU-only index configuration

wvaske
authored and
FileSystemGuy
committed
feat(01-02): add packaging dependency for version parsing

wvaske
authored and
FileSystemGuy
committed
feat(01-01): create lockfile module structure with data models

wvaske
authored and
FileSystemGuy
committed
docs(01-02): complete CPU-only PyTorch configuration plan

wvaske
authored and
FileSystemGuy
committed
docs(01-01): complete lockfile module foundation plan

wvaske
authored and
FileSystemGuy
committed
feat(01-03): implement lockfile generator module

wvaske
authored and
FileSystemGuy
committed
feat(01-04): create lockfile validator module

wvaske
authored and
FileSystemGuy
committed
feat(01-03): update lockfile module exports for generator

wvaske
authored and
FileSystemGuy
committed
docs(01-03): complete lockfile generator plan

wvaske
authored and
FileSystemGuy
committed
docs(01-04): complete runtime version validation plan

wvaske
authored and
FileSystemGuy
committed
feat(01-05): add lockfile CLI argument builder

wvaske
authored and
FileSystemGuy
committed
feat(01-05): integrate lockfile subcommand into CLI

wvaske
authored and
FileSystemGuy
committed
feat(01-05): add lockfile command handler to main

wvaske
authored and
FileSystemGuy
committed
feat(01-05): add --verify-lockfile flag to benchmark commands

wvaske
authored and
FileSystemGuy
committed
docs(01-05): complete CLI integration plan - Phase 1 complete

wvaske
authored and
FileSystemGuy
committed
docs: mark Phase 1 complete in roadmap

authored and
FileSystemGuy
committed
docs(phase-2): research environment validation and fail-fast patterns

authored and
FileSystemGuy
committed
docs(02): create phase plan for Environment Validation and Fail-Fast

authored and
FileSystemGuy
committed
fix(02): revise plans based on checker feedback

authored and
FileSystemGuy
committed
feat(02-01): add environment module with OS detection and install hints

wvaske
authored and
FileSystemGuy
committed
test(02-01): add unit tests for environment module

wvaske
authored and
FileSystemGuy
committed
docs(02-01): complete environment detection plan

wvaske
authored and
FileSystemGuy
committed
feat(02-03): add ValidationIssue dataclass and SSH validators

wvaske
authored and
FileSystemGuy
committed
feat(02-02): Add OS-aware dependency checking with install hints

authored and
FileSystemGuy
committed
test(02-03): add comprehensive tests for validators

wvaske
authored and
FileSystemGuy
committed
docs(02-02): complete Executable Checking Module plan

authored and
FileSystemGuy
committed
docs(02-03): complete SSH validation and issue collection plan

wvaske
authored and
FileSystemGuy
committed
feat(02-04): add comprehensive fail-fast environment validator

wvaske
authored and
FileSystemGuy
committed
test(02-04): add comprehensive tests for validate_benchmark_environment

wvaske
authored and
FileSystemGuy
committed
docs(02-04): complete pre-run validation orchestration plan

wvaske
authored and
FileSystemGuy
committed
feat(02-05): integrate fail-fast validation into main.py

authored and
FileSystemGuy
committed
feat(02-05): add _validate_environment hook to Benchmark base class

authored and
FileSystemGuy
committed
test(02-05): add tests for benchmark validation integration

authored and
FileSystemGuy
committed
docs(02-05): complete fail-fast validation integration plan

authored and
FileSystemGuy
committed
docs(02): complete environment validation and fail-fast phase

wvaske
authored and
FileSystemGuy
committed
docs(03): research KV Cache benchmark integration phase

authored and
FileSystemGuy
committed
docs(03): create phase plan for KV Cache benchmark integration

authored and
FileSystemGuy
committed
feat(03-01): add distributed execution arguments to KV cache CLI

authored and
FileSystemGuy
committed
test(03-01): add unit tests for KV cache CLI arguments

authored and
FileSystemGuy
committed
docs(03-01): complete KV cache distributed CLI plan

authored and
FileSystemGuy
committed
feat(03-02): add MPI execution support to KVCacheBenchmark

authored and
FileSystemGuy
committed
test(03-02): add unit tests for KVCacheBenchmark MPI execution

authored and
FileSystemGuy
committed
docs(03-02): complete MPI execution support plan

authored and
FileSystemGuy
committed
feat(03-03): enhance KV cache metadata for history integration

wvaske
authored and
FileSystemGuy
committed
test(03-03): add metadata tests for history integration

wvaske
authored and
FileSystemGuy
committed
docs(03-03): complete metadata and history integration plan

wvaske
authored and
FileSystemGuy
committed
docs(03): complete KV Cache Benchmark Integration phase

authored and
FileSystemGuy
committed
docs(04): research VectorDB benchmark integration phase

authored and
FileSystemGuy
committed
docs(04): create phase plan for VectorDB benchmark integration

authored and
FileSystemGuy
committed
fix(04): revise 04-02 plan based on checker feedback

authored and
FileSystemGuy
committed
feat(04-01): rename vectordb run-search to run for CLI consistency

authored and
FileSystemGuy
committed
feat(04-02): add metadata property to VectorDBBenchmark

wvaske
authored and
FileSystemGuy
committed
feat(04-02): add write_metadata calls to execute_run and execute_datagen

wvaske
authored and
FileSystemGuy
committed
test(04-01): update vectordb CLI tests for run command rename

authored and
FileSystemGuy
committed
docs(04-01): complete VectorDB CLI rename plan

authored and
FileSystemGuy
committed
docs(04-02): complete VectorDB metadata integration plan

wvaske
authored and
FileSystemGuy
committed
test(04-03): add VectorDB CLI argument parsing tests

wvaske
authored and
FileSystemGuy
committed
test(04-03): add VectorDB benchmark class tests

wvaske
authored and
FileSystemGuy
committed
docs(04-03): complete VectorDB verification and integration plan

wvaske
authored and
FileSystemGuy
committed
docs(04): complete VectorDB Benchmark Integration phase

authored and
FileSystemGuy
committed
docs(05): research phase domain

wvaske
authored and
FileSystemGuy
committed
docs(05): create phase plan for benchmark validation pipeline

authored and
FileSystemGuy
committed
feat(05-01): add VectorDBRunRulesChecker class

wvaske
authored and
FileSystemGuy
committed
feat(05-01): export VectorDBRunRulesChecker from run_checkers

wvaske
authored and
FileSystemGuy
committed
feat(05-01): export VectorDBRunRulesChecker from rules package

wvaske
authored and
FileSystemGuy
committed
feat(05-02): route kv_cache and vector_database in BenchmarkVerifier

wvaske
authored and
FileSystemGuy
committed
feat(05-02): add VECTORDB_REQUIREMENTS to ClosedRequirementsFormatter

wvaske
authored and
FileSystemGuy
committed
docs(05-01): complete VectorDBRunRulesChecker plan

wvaske
authored and
FileSystemGuy
committed
docs(05-02): complete BenchmarkVerifier routing plan

wvaske
authored and
FileSystemGuy
committed
test(05-03): add VectorDBRunRulesChecker unit tests

wvaske
authored and
FileSystemGuy
committed
docs(05-03): complete VectorDB rules checker tests plan

wvaske
authored and
FileSystemGuy
committed
docs(05): complete Benchmark Validation Pipeline Integration phase

authored and
FileSystemGuy
committed
docs(06): research SSH-based host collection phase

authored and
FileSystemGuy
committed
docs(06): create phase plan for SSH-Based Host Collection

authored and
FileSystemGuy
committed
feat(06-01): add MountInfo, CgroupInfo dataclasses and /proc parsers

wvaske
authored and
FileSystemGuy
committed
feat(06-01): update collect_local_system_info with vmstat, mounts, cgroups

wvaske
authored and
FileSystemGuy
committed
test(06-01): add unit tests for cluster_collector parsers

wvaske
authored and
FileSystemGuy
committed
docs(06-01): complete /proc parsers plan

wvaske
authored and
FileSystemGuy
committed
feat(06-02): implement SSHClusterCollector class

authored and
FileSystemGuy
committed
test(06-02): add unit tests for SSHClusterCollector

authored and
FileSystemGuy
committed
docs(06-02): complete SSHClusterCollector implementation plan

authored and
FileSystemGuy
committed
feat(06-03): add ClusterSnapshots dataclass for start/end collection

wvaske
authored and
FileSystemGuy
committed
feat(06-03): integrate SSH collection into benchmark base class

wvaske
authored and
FileSystemGuy
committed
test(06-03): add tests for collection method selection and snapshots

wvaske
authored and
FileSystemGuy
committed
docs(06-03): complete benchmark base integration plan

wvaske
authored and
FileSystemGuy
committed
docs(06): complete SSH-Based Host Collection phase

authored and
FileSystemGuy
committed
docs(07): research time-series host data collection phase

authored and
FileSystemGuy
committed
docs(07): create phase plan

authored and
FileSystemGuy
committed
fix(07): revise plans based on checker feedback

authored and
FileSystemGuy
committed
feat(07-01): add TimeSeriesSample and TimeSeriesData dataclasses

wvaske
authored and
FileSystemGuy
committed
feat(07-01): add collect_timeseries_sample and TimeSeriesCollector

wvaske
authored and
FileSystemGuy
committed
test(07-01): add unit tests for time-series collection

wvaske
authored and
FileSystemGuy
committed
docs(07-01): complete core time-series infrastructure plan

wvaske
authored and
FileSystemGuy
committed
feat(07-02): add MultiHostTimeSeriesCollector for parallel multi-host collection

wvaske
authored and
FileSystemGuy
committed
test(07-02): add unit tests for MultiHostTimeSeriesCollector

wvaske
authored and
FileSystemGuy
committed
docs(07-02): complete multi-host time-series collection plan

wvaske
authored and
FileSystemGuy
committed
feat(07-03): add time-series CLI arguments to all benchmark parsers

authored and
FileSystemGuy
committed
feat(07-03): integrate time-series collection into Benchmark base class

authored and
FileSystemGuy
committed
test(07-03): add unit tests for time-series benchmark integration

authored and
FileSystemGuy
committed
docs(07-03): complete benchmark time-series integration plan

authored and
FileSystemGuy
committed
docs(07): complete Time-Series Host Data Collection phase

authored and
FileSystemGuy
committed
docs(08): research phase domain for new training models

wvaske
authored and
FileSystemGuy
committed
docs(08): create phase plan for new training models

authored and
FileSystemGuy
committed
fix(08): revise plans based on checker feedback

authored and
FileSystemGuy
committed
feat(08-01): add DLRM, RETINANET, FLUX model constants

wvaske
authored and
FileSystemGuy
committed
feat(08-01): add DLRM workload configurations

wvaske
authored and
FileSystemGuy
committed
feat(08-01): add RetinaNet workload configurations

wvaske
authored and
FileSystemGuy
committed
feat(08-01): add Flux workload configurations

wvaske
authored and
FileSystemGuy
committed
docs(08-01): complete new training model configurations plan

wvaske
authored and
FileSystemGuy
committed
feat(08-02): add model validation rules for new training models

wvaske
authored and
FileSystemGuy
committed
test(08-02): add unit tests for new training model validation

wvaske
authored and
FileSystemGuy
committed
docs(08-02): complete validation rules for new training models plan

wvaske
authored and
FileSystemGuy
committed
docs(08): complete New Training Models phase

authored and
FileSystemGuy
committed
docs(09): research DLIO parquet format support

authored and
FileSystemGuy
committed
docs(09): create phase plan for DLIO parquet support

authored and
FileSystemGuy
committed
fix(09): revise plans based on checker feedback

authored and
FileSystemGuy
committed
docs(09-01): complete DLIO parquet format implementation plan

authored and
FileSystemGuy
committed
feat(09-02): add DLRM parquet configuration files

authored and
FileSystemGuy
committed
test(09-02): add unit tests for parquet format validation

authored and
FileSystemGuy
committed
docs(09-02): complete parquet workload configuration plan

authored and
FileSystemGuy
committed
docs(09): complete DLIO Parquet Support phase

authored and
FileSystemGuy
committed
docs(10): research phase domain for progress indication

authored and
FileSystemGuy
committed
docs(10): create phase plan

authored and
FileSystemGuy
committed
fix(10): revise plans based on checker feedback

authored and
FileSystemGuy
committed
feat(10-01): add Rich dependency and create progress module

wvaske
authored and
FileSystemGuy
committed
test(10-01): add unit tests for progress module

wvaske
authored and
FileSystemGuy
committed
docs(10-01): complete progress indication foundation plan

wvaske
authored and
FileSystemGuy
committed
feat(10-02): add stage indicators to benchmark run() method

wvaske
authored and
FileSystemGuy
committed
feat(10-02): add spinners to cluster collection methods

wvaske
authored and
FileSystemGuy
committed
feat(10-03): add progress indication to main.py validation operations

authored and
FileSystemGuy
committed
test(10-02): add unit tests for progress integration in base.py

wvaske
authored and
FileSystemGuy
committed
docs(10-02): complete benchmark progress integration plan

wvaske
authored and
FileSystemGuy
committed
docs(10-03): complete main.py progress integration plan

wvaske
authored and
FileSystemGuy
committed
docs(10): complete Progress Indication phase

wvaske
authored and
FileSystemGuy
committed
docs(11): research phase domain

authored and
FileSystemGuy
committed
docs(11): create phase plan for comprehensive parquet support

authored and
FileSystemGuy
committed
feat(11-03): update DLIO dependency to wvaske fork with parquet support

authored and
FileSystemGuy
committed
docs(11-03): complete DLIO fork dependency plan

authored and
FileSystemGuy
committed
docs(11-01): complete parquet config and enum extensions plan

authored and
FileSystemGuy
committed
docs(11-02): complete Parquet Reader/Generator Rewrite plan

authored and
FileSystemGuy
committed
docs(11): complete Comprehensive Parquet Support phase

authored and
FileSystemGuy
committed
chore: add UAT docs, phase context, and uv lockfile

authored and
FileSystemGuy
committed
feat: update DLRM parquet configs with schema-driven columns

authored and
FileSystemGuy
committed
chore: update test params and fix file permissions

authored and
FileSystemGuy
committed
Updated config files for v3 workloads

wvaske
authored and
FileSystemGuy
committed
Remove unused imports and ShareGPT dataset loader
FileSystemGuy
committed
Revise KV Cache Benchmark script for MLPerf updates
FileSystemGuy
committed
Revise README for KV Cache benchmark implementation
FileSystemGuy
committed
Enhance KV cache benchmark with ShareGPT integration
FileSystemGuy
committed