Ask both where the system runs and what it can access or do. Local is a location, not a security guarantee.
What is a local model?
A local model runs inference—the processing that produces a response—on hardware you control. Some models publish downloadable weights, the learned numerical parameters used by the runtime. Downloadable weights do not mean every model has the same commercial license.
Your computer sets practical limits
Model size, memory, processor and graphics hardware affect which tasks run well and how quickly. A smaller model may be useful for a defined task but struggle with another. Include hardware, electricity, maintenance and support in the cost comparison.
A local app can still use the internet
Cloud models, web search, extensions and other features can send information outside your computer. For example, Ollama documents a local-only setting that disables its cloud features. Test the actual chosen configuration rather than assuming the application name tells you where everything goes.
Cybersecurity extends beyond the model
Updates, vulnerable dependencies, exposed network services, stolen credentials and excessive file access still matter. A locally running assistant connected to email can still cause harm through that connection. Keep network exposure and permissions limited and maintain backups and recovery instructions.
Choose local for a defined reason
Consider offline use, control of processing location or a well-scoped task. Compare real quality and speed with alternatives. Hybrid setups need explicit rules so information is not silently sent to an unapproved provider when a local step fails.
List every part of the proposed setup: model, app, search, files and connectors. Mark which parts require a network connection and what information each receives.
Go to the source
Further reading from the organizations and documentation behind these explanations. Reviewed 9 November 2026; product features and prices can change.
Ollama: local-only and cloud configuration ↗NIST: small-business cybersecurity resources ↗Qwen: model concepts ↗Want help applying this?
Bring a real task. We can discuss evaluation, setup or a practical learning session.
See how we can helpRead next: Guardrails, permissions and your say-so →