How much local LLM can you run on an AMD Strix Halo with 128GB memory? I managed to fit DeepSeek v4 Flash 284B and Gemma 4 E2B on GPU, Whisper and Qwen3.5 4B on NPU. #strixhalo #amd #deepseek #llamastash

LlamaStash v0.0.5 is out 🦙 New: named launch presets. Tune a model's launch knobs once, name them, reuse them, per-model or per-arch. They live in plain config.yaml, so you can hand-edit, comment, and commit them to your dotfiles. llamastash.dev

LlamaStash v0.0.4 is out 🦙 - Auto launch is now the default: llama.cpp's --fit sizes context and GPU offload. - A browser UI on a stable port - Anthropic Messages API support. llamastash.dev

KDash 2.0 is out. The Kubernetes terminal dashboard now does more than watch. - Delete, edit, scale, restart, cordon, port-forward, all from the TUI - Action menu with confirm prompts - New themes + live switching Built in Rust 🦀 github.com/kdash-rs/kdash #Kubernetes #Rust #k8s #DevOps

On benchmarks: spawning llama-server unmodified means the wrapper better not be slow. Three platforms (AMD APU, Mac, NVIDIA), 4 model sizes: LlamaStash ≡ raw llama-server within ≤1% on every cell. Ollama is 41-72% slower decode on AMD APU. RAG prefill is catastrophic. Numbers ↓

What you get out of the box: • llamastash init: detects your hardware, installs llama-server, downloads a fitting GGUF, smoke-launches it • TUI with vim nav, chat, embed, rerank tabs • CLI with --json contract and documented exit codes • Multi-model concurrency with daemon-on-demand

Today I'm releasing LlamaStash 0.0.2: a zero-overhead, terminal-native launcher for llama.cpp. One Rust binary that's a TUI, a CLI, a daemon, and an OpenAI-compatible proxy. Demo below 🧵

KDash 1.0.0 is out 🎉 A big milestone for the terminal UI dashboard for Kubernetes. - direct shell into containers - A Troubleshoot tab - inline filter across views - aggregate logs for workloads - custom themes Release notes: github.com/kdash-rs/kda... #Kubernetes #DevOps #Rust

A perfect circle jerk 😂

Join me next week at #WeAreDevelopers to Delay the AI Overlords: How OAuth and OpenFGA Can Keep Your AI Agents from Going Rogue #auth0 #AI #security

New version of JWT-UI released. Check it out github.com/jwt-rs/jwt-u...