muttled

Founder of https://coinpress.cc

Posts

• Show HN: Made a batching LLM API for a project. Mistral 200 tk/s on RTX 3090
  by muttledon 12/26/23, 7:52 PMwith 0 comments