Newsora
Tom's Hardware11/21 20:00 · 6m ago

Homelabber’s second-gen Optane build uses two RTX 3090s to run 2.8-trillion-parameter Kimi AI model at 3.11 tokens per second

A Reddit homelabber’s Optane PMem 200 server now runs Moonshot AI’s Kimi K3 at 3.11 tokens/s with two RTX 3090s and a RAM drive.

Aggregator site: only the publisher's summary is shown here. Read the full story at the source.
Read full story →