|
@@ -9,13 +9,13 @@ To get started right away, run the following command, making sure to use the cor
|
|
|
### Unix-based systems (Linux, macOS, etc.):
|
|
### Unix-based systems (Linux, macOS, etc.):
|
|
|
|
|
|
|
|
```bash
|
|
```bash
|
|
|
-./llama-embedding -m ./path/to/model --log-disable -p "Hello World!" 2>/dev/null
|
|
|
|
|
|
|
+./llama-embedding -m ./path/to/model --pooling mean --log-disable -p "Hello World!" 2>/dev/null
|
|
|
```
|
|
```
|
|
|
|
|
|
|
|
### Windows:
|
|
### Windows:
|
|
|
|
|
|
|
|
```powershell
|
|
```powershell
|
|
|
-llama-embedding.exe -m ./path/to/model --log-disable -p "Hello World!" 2>$null
|
|
|
|
|
|
|
+llama-embedding.exe -m ./path/to/model --pooling mean --log-disable -p "Hello World!" 2>$null
|
|
|
```
|
|
```
|
|
|
|
|
|
|
|
The above command will output space-separated float values.
|
|
The above command will output space-separated float values.
|
|
@@ -50,11 +50,11 @@ The above command will output space-separated float values.
|
|
|
### Unix-based systems (Linux, macOS, etc.):
|
|
### Unix-based systems (Linux, macOS, etc.):
|
|
|
|
|
|
|
|
```bash
|
|
```bash
|
|
|
-./embedding -p 'Castle<#sep#>Stronghold<#sep#>Dog<#sep#>Cat' --embd-separator '<#sep#>' --embd-normalize 2 --embd-output-format '' -m './path/to/model.gguf' --n-gpu-layers 99 --log-disable 2>/dev/null
|
|
|
|
|
|
|
+./llama-embedding -p 'Castle<#sep#>Stronghold<#sep#>Dog<#sep#>Cat' --pooling mean --embd-separator '<#sep#>' --embd-normalize 2 --embd-output-format '' -m './path/to/model.gguf' --n-gpu-layers 99 --log-disable 2>/dev/null
|
|
|
```
|
|
```
|
|
|
|
|
|
|
|
### Windows:
|
|
### Windows:
|
|
|
|
|
|
|
|
```powershell
|
|
```powershell
|
|
|
-embedding.exe -p 'Castle<#sep#>Stronghold<#sep#>Dog<#sep#>Cat' --embd-separator '<#sep#>' --embd-normalize 2 --embd-output-format '' -m './path/to/model.gguf' --n-gpu-layers 99 --log-disable 2>/dev/null
|
|
|
|
|
|
|
+llama-embedding.exe -p 'Castle<#sep#>Stronghold<#sep#>Dog<#sep#>Cat' --pooling mean --embd-separator '<#sep#>' --embd-normalize 2 --embd-output-format '' -m './path/to/model.gguf' --n-gpu-layers 99 --log-disable 2>/dev/null
|
|
|
```
|
|
```
|