Local AI Archives - AIFinitee

DwarfStar Strikes Again: Mac Studio M3 Ultra runs Qwen 3.8 Flash Next Q4 at 810 t/s Prefill

Qwen 3.8 Flash Next Q4 on a 96 GB M3 Ultra Mac Studio: 810 t/s prefill flat to 200k context, 53–61 t/s decode, 89.2 GB resident — and the wired limit to raise.

Benchmarking, ds4, Engram, LLM Inference, Local AI, Mac Studio, Quantization, Qwen

Aimee, the AIFinitee chibi mascot, reads a fairy-tale storybook and says Once Upon... while a cheerful chibi onion wearing round glasses replies A Time - a playful nod to engram lookup memory.

Primer

Once Upon a Time: DeepSeek V4.1-Flash and Qwen3.8-Flash-Next – What the hekk is an Engram?!

Two of the most interesting open-model releases of the quarter just landed, and they share a spec-sheet line that has a lot to do with benchmarks - but ignores the…

DeepSeek, Engram, Local AI, local LLM, Qwen, Strix Halo

MiniMax

MiniMax H3: Your guide to proper prompting for better videos

As much as cloud remains a dominant option for the casual consumer, it is worth to remember that AI (LLM or units of compute) are also units of Intellect. Ownership…

LLM Inference, Local AI, Strix Halo

GLM 5.2 at 4-bit with MTP on Mac Studio — featured banner

Apple Silicon

GLM 5.2 at 4-Bit With MTP: The Easiest Way In

And the 512GB Mac Studio that Apple just stopped selling. Apple discontinued the 512GB Mac Studio. Not the chip — the M3 Ultra is still on the shelf — but…

GLM, LLM Inference, Local AI, Mac Studio, Quantization

DeepSeek V4 Flash Q2 running on Strix Halo 128GB — featured banner

AMD Distributed Inference

Running DeepSeek V4 Flash Q2 on Strix Halo 128GB

AIfinitee believes in local compute as an alternative to cloud and that the most capable open models should be runnable on hardware you actually own. This post is the recipe for…

Cluster Computing, DeepSeek, LLM Inference, Local AI, Quantization, Strix Halo

ComfyUI artwork generated on AMD Ryzen AI MAX 96GB — featured banner

AMD Distributed Inference

ComfyUI on AMD Ryzen AI MAX: 96 GB Unified Memory vs 16 GB NVIDIA

At AIFinitee, we have spent months benchmarking LLM inference on our dual-node AMD Ryzen AI MAX 395+ cluster. We have measured tokens per second across MiniMax-M2 and Qwen3.5-397B. We have…

ComfyUI, LLM Inference, Local AI, Strix Halo

Speed versus smarts: choosing the right local model size — featured banner

AMD Distributed Inference

Speed vs. Smarts: When Bigger Models Win for Local AI Coding

At AIFinitee, we've spent months chasing tokens per second. Our two-node AMD Ryzen AI MAX cluster hits 17-20 tok/s with MiniMax-M2. Our Linux-vs-Windows benchmarks showed how your OS quietly taxes…

Benchmarking, LLM Inference, Local AI, Strix Halo

Linux vs Windows for LLM inference — featured banner

AMD Distributed Inference

Linux vs Windows for LLM Inference: More Tokens/Second on Linux

Same GPU, different OS = different performance. See why Linux delivers 5-30% more tokens/sec than Windows across NVIDIA, AMD, and Intel GPUs.

Benchmarking, Linux, LLM Inference, Local AI, Strix Halo

AMD Distributed Inference MiniMax

Strix Halo Cluster

One of the beliefs we hold at AIfinitee is that LLMs will only get bigger. Bigger LLMs will mean more memory for usage in either cloud compute or local compute.…

Benchmarking, Cluster Computing, LLM Inference, Local AI, Strix Halo