You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: advanced/models/ollama.mdx
+58-45Lines changed: 58 additions & 45 deletions
Original file line number
Diff line number
Diff line change
@@ -6,59 +6,72 @@ description: 'Learn how to install Ollama models in Shinkai'
6
6
**Ollama** is an innovative Al platform designed to democratize access to large language models (LLMs) by allowing users to run these models locally on their machines.
7
7
This capability enhances privacy and control over data, as it mitigates concerns associated with cloud-based solutions.
8
8
9
-
<Note>Note that all AI models in Shinkai are powered by Ollama. Before installing Ollama models manually, check the available models list for quick installation.</Note>
Go to [Ollama](https://ollama.com/) > Create your account > Download Ollama to your device > Install it.
27
-
28
-
</Step>
29
-
<Steptitle="Check if the model is available for quick installation">
30
-
In Ollama's website, open your **user's dropdown menu** in the upper-right corner > Click [Settings](https://ollama.com/settings/keys) > Select `Ollama Keys`.
31
-
32
-
Click the `Add Ollama Public Key` button > Generate your key.
33
-
34
-
<Tip>If you have a password app, like 1Password, it can generate the key automatically for you and save it to your keychain.</Tip>
35
-
36
-

37
-
13
+
<Steptitle="Check if model is available for quick installation">
14
+
<Note>Note that all AI models in Shinkai are powered by Ollama. Before installing Ollama models manually, check the available models list for quick installation.</Note>
You can also check in your terminal the installed models in your device:
20
+
21
+
```Bash
22
+
$ ollama ls
23
+
NAME ID SIZE MODIFIED
24
+
bespoke-minicheck:7b 66607904c165 4.7 GB 4 hours ago
25
+
aya:8b 7ef8c4942023 4.8 GB 4 hours ago
26
+
llama3.1:8b-instruct-q4_1 e129e608a752 5.1 GB 3 days ago
27
+
snowflake-arctic-embed:xs bf75350e1752 45 MB 3 days ago
28
+
```
29
+
<Tip>If the model cannot be found in the quick installation list, proceed to step 2. </Tip>
38
30
</Step>
39
-
<Steptitle="Run the model you want to import">
40
-
Browse the models' library in Ollama > Select the one you'd like to use in Shinkai > Choose the [parameters](/advanced/custom-ai) of the model (*i.e., 2b, 8b, etc.*)
41
-
42
-

31
+
<Steptitle="Pull new model from Ollama">
32
+
Go to Ollama, and browse the model you want to install.
33
+
Copy the code `ollama run <model>` and paste it in your terminal.
0 commit comments