RealFeedApp SimulST achieves full KV cache reuse
The CRESiST framework interleaves speech chunks and text tokens to achieve full Key-Value cache reuse, enabling infinite-length inference without segmentation. A novel Actor-Critic self-enhancement pipeline optimizes streaming policies dynamically.
#simultaneous speech translation#llm#kv cache#actor-critic#streaming inference
