Skip to main content

Tiered Storage

Thermocline separates operational writes (hot tier) from long-term cold storage execution, with federated query merge when data spans both.

Policy Commands

Policy command surface in gateway:

  • thermoclineSetPolicy
  • thermoclineGetPolicy
  • thermoclineListPolicies
  • thermoclineDeletePolicy
  • thermoclineValidatePolicy

Runtime Components

  • Controller: archival/backup/lifecycle orchestration
  • Coordinator: tier routing and merge
  • Storage Engine: hot persistence and canonical semantics
  • Query Engine: cold object-store execution

Source of Truth

  • services/gateway/src/proxy/handler/policy.rs
  • services/coordinator/internal/server/server_find.go
  • services/controller/internal/grpc/lifecycle_service.go
  • services/storage-engine/src/tiered/mod.rs
  • services/query-engine/src/grpc/service.rs

Verification

Use both topologies before production:

make e2e-single
make e2e-local-cluster