Expand description
ModelDims — model-shape descriptor threaded through every layer’s
forward signature. Lives in spark-storage because the high-speed-
swap orchestrator was the original consumer, but the type itself
has no GPU state and must remain compilable on macOS / no-cuda
builds where the swap orchestrator isn’t reachable.
Structs§
- Model
Dims - Per-call dimensions describing the model the orchestrator serves.