rillr
About Guidelines Privacy Terms Log in Join Rillr
← Programming
www.infoq.com · Nov 12

Google Open-Sources TPU Sync for KV Cache and Weight Transfer on TPUs

Google Cloud has open-sourced TPU Sync, a native C++ library that moves KV cache blocks and model weights between TPU HBM, host DRAM, shared storage, and the data center network. By Daniel Dominguez

Visit article ↗ ▲ 0 💬 0
Discussion

0 comments

No comments yet. Start the discussion.