Startseite Erkunden Hilfe
Anmelden
cturan
/
llama.cpp
Mirror von https://github.com/cturan/llama.cpp
1
0
Fork 0
Dateien Issues 0 Wiki
Struktur: 291f2b6913
Branches Tags
llama.cpp
/
models
/
ggml-vocab-pixtral.gguf.inp

ggml-vocab-pixtral.gguf.inp 1.9 KB
Verlauf Originalformat

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112 
  1. ied 4 ½ months
    2. 

  2. __ggml_vocab_test__
    3. 

  3. Führer
    4. 

  4. __ggml_vocab_test__
    5. 

  5. 

  6. __ggml_vocab_test__
    7. 

  7.  
    8. 

  8. __ggml_vocab_test__
    9. 

  9.   
    10. 

  10. __ggml_vocab_test__
    11. 

  11.    
    12. 

  12. __ggml_vocab_test__
    13. 

  13. 	
    14. 

  14. __ggml_vocab_test__
    15. 

  15. 

  16. 

  17. __ggml_vocab_test__
    18. 

  18. 

  19. 

  20. 

  21. __ggml_vocab_test__
    22. 

  22. 

  23. 

  24. 

  25. 

  26. __ggml_vocab_test__
    27. 

  27. 	
    28. 

  28. 

  29. __ggml_vocab_test__
    30. 

  30. Hello world
    31. 

  31. __ggml_vocab_test__
    32. 

  32.  Hello world
    33. 

  33. __ggml_vocab_test__
    34. 

  34. Hello World
    35. 

  35. __ggml_vocab_test__
    36. 

  36.  Hello World
    37. 

  37. __ggml_vocab_test__
    38. 

  38.  Hello World!
    39. 

  39. __ggml_vocab_test__
    40. 

  40. Hello, world!
    41. 

  41. __ggml_vocab_test__
    42. 

  42.  Hello, world!
    43. 

  43. __ggml_vocab_test__
    44. 

  44.  this is 🦙.cpp
    45. 

  45. __ggml_vocab_test__
    46. 

  46. w048 7tuijk dsdfhu
    47. 

  47. __ggml_vocab_test__
    48. 

  48. нещо на Български
    49. 

  49. __ggml_vocab_test__
    50. 

  50. កាន់តែពិសេសអាចខលចេញ
    51. 

  51. __ggml_vocab_test__
    52. 

  52. 🚀 (normal) 😶‍🌫️ (multiple emojis concatenated) ✅ (only emoji that has its own token)
    53. 

  53. __ggml_vocab_test__
    54. 

  54. Hello
    55. 

  55. __ggml_vocab_test__
    56. 

  56.  Hello
    57. 

  57. __ggml_vocab_test__
    58. 

  58.   Hello
    59. 

  59. __ggml_vocab_test__
    60. 

  60.    Hello
    61. 

  61. __ggml_vocab_test__
    62. 

  62.     Hello
    63. 

  63. __ggml_vocab_test__
    64. 

  64.     Hello
    65. 

  65.     Hello
    66. 

  66. __ggml_vocab_test__
    67. 

  67.  (
    68. 

  68. __ggml_vocab_test__
    69. 

  69. 

  70.  =
    71. 

  71. __ggml_vocab_test__
    72. 

  72. ' era
    73. 

  73. __ggml_vocab_test__
    74. 

  74. Hello, y'all! How are you 😁 ?我想在apple工作1314151天～
    75. 

  75. __ggml_vocab_test__
    76. 

  76. !!!!!!
    77. 

  77. __ggml_vocab_test__
    78. 

  78. 3
    79. 

  79. __ggml_vocab_test__
    80. 

  80. 33
    81. 

  81. __ggml_vocab_test__
    82. 

  82. 333
    83. 

  83. __ggml_vocab_test__
    84. 

  84. 3333
    85. 

  85. __ggml_vocab_test__
    86. 

  86. 33333
    87. 

  87. __ggml_vocab_test__
    88. 

  88. 333333
    89. 

  89. __ggml_vocab_test__
    90. 

  90. 3333333
    91. 

  91. __ggml_vocab_test__
    92. 

  92. 33333333
    93. 

  93. __ggml_vocab_test__
    94. 

  94. 333333333
    95. 

  95. __ggml_vocab_test__
    96. 

  96. Cửa Việt
    97. 

  97. __ggml_vocab_test__
    98. 

  98.  discards
    99. 

  99. __ggml_vocab_test__
    100. 

  100. 

  101.  
    102. 

  102. 

  103.  
    104. 

  104. 

  105. 

  106.  	 		 	
    107. 

  107.   
    108. 

  108.    
    109. 

  109.     
    110. 

  110.      
    111. 

  111. 🚀 (normal) 😶‍🌫️ (multiple emojis concatenated) ✅ 🦙🦙 3 33 333 3333 33333 333333 3333333 33333333 3.3 3..3 3...3 កាន់តែពិសេសអាច😁 ?我想在apple工作1314151天～ ------======= нещо на Български ''''''```````""""......!!!!!!?????? I've been 'told he's there, 'RE you sure? 'M not sure I'll make it, 'D you like some tea? We'Ve a'lL
    112. 

  112. __ggml_vocab_test__
    113.