pub struct HighSpeedSwapConfig {
pub dir: PathBuf,
pub bytes: u64,
pub resident_blocks: u32,
pub rank: u32,
pub qd: u32,
pub graph: bool,
pub projection_seed: u64,
}Fields§
§dir: PathBuf--high-speed-swap-dir: directory where per-layer KV files live.
bytes: u64--high-speed-swap-bytes: total disk budget; the layout fails fast
if the budget can’t fit num_layers × bytes_per_layer.
resident_blocks: u32--high-speed-swap-resident-blocks: HBM scratch slot count. The
scratch pool allocates exactly this many slots × per-slot bytes.
rank: u32--high-speed-swap-rank: predictor low-rank dimension.
qd: u32--high-speed-swap-qd: io_uring submission queue depth. Phase-3
shows QD=8 reaches 3.4 GB/s on this hardware (random 64 KiB).
graph: bool--high-speed-swap-graph: capture the per-layer body in a CUDA
graph and replay (Phase 4).
projection_seed: u64Predictor seed; when omitted in CLI we’d error rather than default.
Implementations§
Trait Implementations§
Source§impl Clone for HighSpeedSwapConfig
impl Clone for HighSpeedSwapConfig
Source§fn clone(&self) -> HighSpeedSwapConfig
fn clone(&self) -> HighSpeedSwapConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for HighSpeedSwapConfig
impl Debug for HighSpeedSwapConfig
Source§impl<'de> Deserialize<'de> for HighSpeedSwapConfig
impl<'de> Deserialize<'de> for HighSpeedSwapConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for HighSpeedSwapConfig
impl RefUnwindSafe for HighSpeedSwapConfig
impl Send for HighSpeedSwapConfig
impl Sync for HighSpeedSwapConfig
impl Unpin for HighSpeedSwapConfig
impl UnwindSafe for HighSpeedSwapConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more