{"id":189,"date":"2025-05-26T12:19:00","date_gmt":"2025-05-26T11:19:00","guid":{"rendered":"https:\/\/www.bweissman.de\/?p=189"},"modified":"2025-07-04T12:25:32","modified_gmt":"2025-07-04T11:25:32","slug":"anthony-and-ben-talk-about-sql-server-2025-episode-2-running-local-llms-with-ollama","status":"publish","type":"post","link":"https:\/\/www.bweissman.de\/index.php\/2025\/05\/26\/anthony-and-ben-talk-about-sql-server-2025-episode-2-running-local-llms-with-ollama\/","title":{"rendered":"Anthony and Ben talk about SQL Server 2025 \u2013 Episode 2: Running Local LLMs with Ollama"},"content":{"rendered":"\n<p>In this episode, Ben and Anthony demonstrate how to integrate <strong>Ollama<\/strong>, a local LLM runtime, directly into your SQL Server workflows.<\/p>\n\n\n\n<p><strong>What\u2019s Inside:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Full setup of Ollama with Docker and local REST access<\/li>\n\n\n\n<li>SQL Server calls out to the Ollama API using <code>sp_invoke_external_rest_api<\/code><\/li>\n\n\n\n<li>Real-world use cases: text generation, summarization, classification<\/li>\n\n\n\n<li>Security and latency benefits of keeping everything on-prem<\/li>\n<\/ul>\n\n\n\n<p>\ud83d\udd17 <a class=\"\" href=\"https:\/\/www.youtube.com\/watch?v=e6cQ9kc6_1o\">Watch on YouTube<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this episode, Ben and Anthony demonstrate how to integrate Ollama, a local LLM runtime, directly into your SQL Server workflows. What\u2019s Inside: \ud83d\udd17 Watch on YouTube<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-189","post","type-post","status-publish","format-standard","hentry","category-uncategorized","entry"],"_links":{"self":[{"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/posts\/189","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/comments?post=189"}],"version-history":[{"count":1,"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/posts\/189\/revisions"}],"predecessor-version":[{"id":190,"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/posts\/189\/revisions\/190"}],"wp:attachment":[{"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/media?parent=189"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/categories?post=189"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.bweissman.de\/index.php\/wp-json\/wp\/v2\/tags?post=189"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}