(To the anti-AI people: please feel free to ignore/skip this post.)

New blog post! A few people have asked me how I run AI/LLM tools (ollama and llama.cpp) in my Talos Kubernetes cluster, so I decided to give it a proper explanation. This is quite a long and complex post, but I hope it's useful for someone.

#HomeLab #TalosLinux #Framework #ollama #llamacpp #AI #LLM #AMD #StrixHalo @homelab

mteixeira.wordpress.com/2025/1…

Running ollama and llama.cpp on Talos Linux on an AMD Strix Halo CPU

For about two months I’ve been running ollama and llama.cpp on a Talos Linux Kubernetes cluster, on top of a desktop PC with the AMD Strix Halo CPU (AMD Ryzen AI Max+ 395). This blog post is …

^{I do what I can}