Posted inAMD Distributed Inference MiniMax Strix Halo Cluster One of the beliefs we hold at AIfinitee is that LLMs will only get bigger. Bigger LLMs will mean more memory for usage in either cloud compute or local compute.… Tags: Benchmarking, Cluster Computing, LLM Inference, Local AI, Strix Halo
