Local-First AI Development: Sovereignty, Silicon, and the Private Dev Loop

Room 12Wed 28 Oct • 11:10–12:10AI & AgentsIntermediate
"Run it locally" used to mean a hobby project on a spare GPU. In 2026 it means something else. Teams in regulated industries, sovereign-cloud jurisdictions, and IP-sensitive shops are quietly building real development workflows around models they host themselves, because shipping source code, prompts, and customer data to a frontier API is no longer a decision they get to make. The question stopped being whether to do this and started being how to do it without buying the wrong hardware, picking the wrong model, or building something slower than what you replaced. This session walks the three pillars in the title. Sovereignty covers the actual drivers: protecting source code and proprietary prompts, satisfying data residency rules, reducing vendor exposure, and keeping the AI bill predictable. Silicon is where Brian shares results from testing across a wide range of local hardware, from older NVIDIA cards through the RTX 6000 Pro Blackwell, modren Apple Silicon, AMD systems with NPUs, and Windows on ARM. You'll see where each platform earns its price tag and where the marketing doesn't survive contact with a real workload. The private dev loop is where it gets practical: picking models for code, chat, embeddings, and agent workflows; hosting them with Foundry Local, Ollama, or standard OpenAI-compatible endpoints from .NET; and wiring it all into the way your team already works. Brian also covers the part most talks skip: when local is the wrong answer, when a hybrid pattern wins, and how to tell the difference before you've spent the budget.

About the speaker

Brian Randell

Brian A. Randell has been building software solutions for almost 40 years. He's the co-author of Essential DevOps and as a Partner at MCW Technologies, he educates teams on Microsoft technologies via writing and training—both in-person and on-demand. He’s been a consultant for companies small and large, worldwide, including Fortune 100 companies like Microsoft. Brian took a four year break from consulting and worked at GitHub as a Staff Developer Advocate but is back building AI-enabled solutions. Brian is a passionate software craftsman who still enjoys coding as he helps teams to improve their processes from idea to release. He was a Microsoft MVP for 17 years and has co-authored books, written magazine articles, and more. When not working, Brian enjoys spending time with his wife, two children, dog, and extended family.