Rohan Paul@rohanpaul_ai有人在 16×GB10 集群上跑起了完整的 Kimi K3，平均 20+tps（llama-benchy 连贯语料），峰值 38tps，预填充 750tps。 用的是 MikroTik Switch CRS804-4DDQ，配 4×400 转 4×100gbit 分支线缆，跑在 dspark 上。 ---- reddit.com/r/LocalLLaMA/comments/1vfl525/kimi_k3_full_model_running_on_16x_gb10_cluster_at/
Somebody is running Kimi K3 full on 16x GB10 cluster at 20+tps average (llama-benchy coherent corpus) 38tps peak, 750tps prefill.
on a MikroTik Switch CRS804-4DDQ with 4x 400-to-4x100gbit breakout cables running with dspark
----
reddit .com/r/LocalLLaMA/comments/1vfl525/kimi_k3_full_model_running_on_16x_gb10_cluster_at/
来源：Rohan Paul · x.com
有人在 16×GB10 集群上跑起了完整的 Kimi K3，平均 20+tps（llama-benchy 连贯语料），峰值 38tps，预填充 750tps。 用的是 MikroTik Switch CRS804-4DDQ，配 4×400 转 4×100gbit 分支线缆，跑在 dspark 上。 ---- reddit.com/r/LocalLLaMA/comments/1vfl525/kimi_k3_full_model_running_on_16x_gb10_cluster_at/
Somebody is running Kimi K3 full on 16x GB10 cluster at 20+tps average (llama-benchy coherent corpus) 38tps peak, 750tps prefill.
on a MikroTik Switch CRS804-4DDQ with 4x 400-to-4x100gbit breakout cables running with dspark
----
reddit .com/r/LocalLLaMA/comments/1vfl525/kimi_k3_full_model_running_on_16x_gb10_cluster_at/
来源：Rohan Paul· x.com