#ollama

#ollama

AI isn't going anywhere, and everyone knows that by now. People around the world are using AI for just about any reason or task that you can imagine. I know people who consider the AI chatbots to be friends. I also know people who look at AI as a tool for research. And then there are those who use AI to write correspondence and other types of documents.

Ollama provides a framework that makes it possible to run large language models locally, on a desktop machine or server. Cisco decided to research it because, in the words of Senior Incident Response Architect Dr. Giannis Tziakouris, Ollama has "gained popularity for its ease of use and local deployment capabilities." Talos researchers used the Shodan scanning tool to find unsecured Ollama servers, and spotted over 1,100, around 20 percent of which are "actively hosting models susceptible to unauthorized access."