feat(persistence): Add JDBC persistence layer for Iceberg metrics reporting (#3337)#3385

Open

obelix74 wants to merge 68 commits intoapache:mainfrom

obelix74:feat-3337-rest-catalog-metrics-table-merged

Commits on Feb 5, 2026

feat(metrics): Add MetricsPersistence SPI for backend-agnostic metrics storage
Anand Kumar Sankaran
committed
refactor(metrics): Remove ambient context fields from SPI records
Anand Kumar Sankaran
committed
refactor(metrics): Replace offset-based pagination with PageToken pattern
Anand Kumar Sankaran
committed
Review comments
Anand Kumar Sankaran
committed
Review comments
Anand Kumar Sankaran
committed
refactor: Remove TableIdentifier and catalogName from SPI records
Anand Kumar Sankaran
committed
refactor: Use List<String> for namespace instead of dot-separated string
Anand Kumar Sankaran
committed
refactor: Use tableId instead of tableName in metrics records
Anand Kumar Sankaran
committed
refactor: Remove namespace from MetricsQueryCriteria
Anand Kumar Sankaran
committed
Add schema-v4.sql for metrics tables (#3337)
Anand Kumar Sankaran
committed
Merged main
Anand Kumar Sankaran
committed
refactor: Update metrics schema to match SPI changes
Anand Kumar Sankaran
committed
refactor: Change table_name to table_id in metrics schema
Anand Kumar Sankaran
committed
feat(events): Enable metrics event emission in reportMetrics()
Anand Kumar Sankaran
committed
feat(events): Add metrics persistence handler for AFTER_REPORT_METRICS events
Anand Kumar Sankaran
committed
feat(persistence): Add database schema and model classes for metrics (PR#3)
Anand Kumar Sankaran
committed
feat(persistence): Add JDBC persistence implementation for metrics (PR#4)
Anand Kumar Sankaran
committed
feat(reporting): Add metrics reporters infrastructure (PR#5)
Anand Kumar Sankaran
committed
feat(cleanup): Add metrics cleanup service and documentation (PR#6)
Anand Kumar Sankaran
committed
test(integration): Update InMemoryBufferEventListenerIntegrationTest for metrics events
Anand Kumar Sankaran
committed
Fix failing InMemoryBufferEventListenerIntegrationTest by enabling ENABLE_METRICS_EVENT_EMISSION feature flag
Anand Kumar Sankaran
committed
feat: Add backward-compatible metrics processing system
Anand Kumar Sankaran
committed
refactor: Replace event-based metrics with MetricsProcessor interface
Anand Kumar Sankaran
committed
Removed internal document
Anand Kumar Sankaran
committed
docs: Update CHANGELOG for metrics processor configuration
Anand Kumar Sankaran
committed
SpotlessApply
Anand Kumar Sankaran
committed
Review comments
Anand Kumar Sankaran
committed
Review comments
Anand Kumar Sankaran
committed
Added a service producer for SpanContext
Anand Kumar Sankaran
committed
Review comments.
Anand Kumar Sankaran
committed
refactor: Remove PR2 files (MetricsProcessor framework) from PR1 branch
Anand Kumar Sankaran
committed
Add schema version checks to metrics persistence methods
Anand Kumar Sankaran
committed
Apply spotless formatting
Anand Kumar Sankaran
committed
Add tests for schema version < 4 graceful degradation
Anand Kumar Sankaran
committed
Remove query indexes, keep only retention cleanup index
Anand Kumar Sankaran
committed
Add realm_id to PRIMARY KEY and roles junction tables
Anand Kumar Sankaran
committed
Fix code review issues: transaction support, role validation, and role loading
Anand Kumar Sankaran
committed
Integrate MetricsPersistence SPI with JDBC implementation
Anand Kumar Sankaran
committed
Add unit tests for SpiModelConverter
Anand Kumar Sankaran
committed
fix: Replace AttributeMap with EventAttributeMap and apply spotless fixes
Anand Kumar Sankaran
committed
feat: Add PersistingMetricsReporter to connect REST API to MetricsPersistence SPI
Anand Kumar Sankaran
committed
test: Add unit tests for PersistingMetricsReporter
Anand Kumar Sankaran
committed
fix: Restore eventAttributeMap for proper TABLE_METADATA event handling
Anand Kumar Sankaran
committed
refactor: Update JDBC layer to match SPI changes
Anand Kumar Sankaran
committed
refactor: Update JDBC layer to use tableId instead of tableName
Anand Kumar Sankaran
committed
fix: Apply tableId schema changes and update tests
Anand Kumar Sankaran
committed
refactor: Remove namespace from JDBC query methods
Anand Kumar Sankaran
committed
fix: Update PersistingMetricsReporter to use tableId and namespace API
Anand Kumar Sankaran
committed
fix: Update PersistingMetricsReporterTest for new tableId/namespace API
Anand Kumar Sankaran
committed
fix: address code review correctness issues
Anand Kumar Sankaran
committed
feat: Add separate metrics schema with --include-metrics bootstrap option
Anand Kumar Sankaran
committed
chore: Sync with feat-3337-metrics-persistence-spi and feat-3337-schema-v4 branches
Anand Kumar Sankaran
committed

Commits on Feb 6, 2026

refactor: Denormalize principal roles into JSON array column
Anand Kumar Sankaran
committed
Merge feat-3337-schema-v4: Denormalize principal roles into JSON array
Anand Kumar Sankaran
committed
refactor: Remove metrics event types
Anand Kumar Sankaran
committed
refactor: Decouple MetricsPersistence from MetaStoreManagerFactory
Anand Kumar Sankaran
committed
test: Add unit tests for principal_role_ids in metrics report models
Anand Kumar Sankaran
committed
style: Apply spotless formatting
Anand Kumar Sankaran
committed
test: Add tests for --include-metrics bootstrap option
Anand Kumar Sankaran
committed
refactor: Remove schema-v4 version fixes (moved to separate PR)
Anand Kumar Sankaran
committed
refactor: Remove principal_role_ids from metrics schema
Anand Kumar Sankaran
committed
refactor: Remove principal_role_ids from model classes and tests
Anand Kumar Sankaran
committed
refactor: Move metrics methods to JdbcMetricsPersistence and wire to CDI
Anand Kumar Sankaran
committed
refactor: Remove namespace from JDBC metrics implementation
Anand Kumar Sankaran
committed
Fix failing tests
Anand Kumar Sankaran
committed
refactor: Address PR review comments for MetricsPersistence
Anand Kumar Sankaran
committed

Commits on Feb 7, 2026

feat: Implement separate MetricsSchemaBootstrap SPI handler
Anand Kumar Sankaran
committed
Add unit tests for BootstrapMetricsCommand
Anand Kumar Sankaran
committed