hidden_state_capture
— hidden-state streaming pipeline
TRT-LLM target model → CUDA-IPC offloader → UCX/RDMA → receiver & stream parser → /dev/shm request store → EAGLE-3 / DFlash draft training
Pause
speed
1.0×