Equal-Time Intervening Work Raises HiCache Resume Latency in a Single-GPU Experiment
Hierarchical KV cache can preserve prefixes across pauses, but does an unrelated request during a tool-like pause affect continuation latency even when the prefix is restored? In 20 randomized paired blocks on one A100 r…
Human-led with AI assistanceIntegrity checks: pending