Brendon Co

Brendon Co

Originally from Singapore. Brendon is an expert UI expert at Standard Chartered and published multiple books in amazon and leanpub. In his free time, he writes about Model Context Protocol server for PostgreSQL, Remix starterkit, Micro Frontend book and sell UI components.
On-Premise Open-Source LLMs with Ollama & FastAPI
TechLead Conf London 2025: Adopting AI in Orgs EditionTechLead Conf London 2025: Adopting AI in Orgs Edition
Nov 20, 15:00
On-Premise Open-Source LLMs with Ollama & FastAPI
Workshop
This workshop introduces how to use open-source LLMs on-premise for enhanced data control, privacy, and cost efficiency. It highlights Ollama for simplified LLM management (downloading, running models offline) and FastAPI for efficient local hosting, enabling fast API development and seamless integration. This combined approach offers superior security, regulatory compliance, and customization compared to cloud-based solutions.
Register