048

neta:studio_ai:news_show:048

A September open-source inference project called Paddock is building a native Rust server for open models across NVIDIA hardware and Apple Silicon, with OpenAI- and Anthropic-compatible APIs and support for several model formats and quantization schemes.