ggml-vocab-starcoder.gguf.inp 1.7 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102
  1. __ggml_vocab_test__
  2. __ggml_vocab_test__
  3. __ggml_vocab_test__
  4. __ggml_vocab_test__
  5. __ggml_vocab_test__
  6. __ggml_vocab_test__
  7. __ggml_vocab_test__
  8. __ggml_vocab_test__
  9. __ggml_vocab_test__
  10. Hello world
  11. __ggml_vocab_test__
  12. Hello world
  13. __ggml_vocab_test__
  14. Hello World
  15. __ggml_vocab_test__
  16. Hello World
  17. __ggml_vocab_test__
  18. Hello World!
  19. __ggml_vocab_test__
  20. Hello, world!
  21. __ggml_vocab_test__
  22. Hello, world!
  23. __ggml_vocab_test__
  24. this is 🦙.cpp
  25. __ggml_vocab_test__
  26. w048 7tuijk dsdfhu
  27. __ggml_vocab_test__
  28. нещо на Български
  29. __ggml_vocab_test__
  30. កាន់តែពិសេសអាចខលចេញ
  31. __ggml_vocab_test__
  32. 🚀 (normal) 😶‍🌫️ (multiple emojis concatenated) ✅ (only emoji that has its own token)
  33. __ggml_vocab_test__
  34. Hello
  35. __ggml_vocab_test__
  36. Hello
  37. __ggml_vocab_test__
  38. Hello
  39. __ggml_vocab_test__
  40. Hello
  41. __ggml_vocab_test__
  42. Hello
  43. __ggml_vocab_test__
  44. Hello
  45. Hello
  46. __ggml_vocab_test__
  47. (
  48. __ggml_vocab_test__
  49. =
  50. __ggml_vocab_test__
  51. ' era
  52. __ggml_vocab_test__
  53. Hello, y'all! How are you 😁 ?我想在apple工作1314151天~
  54. __ggml_vocab_test__
  55. 3
  56. __ggml_vocab_test__
  57. 33
  58. __ggml_vocab_test__
  59. 333
  60. __ggml_vocab_test__
  61. 3333
  62. __ggml_vocab_test__
  63. 33333
  64. __ggml_vocab_test__
  65. 333333
  66. __ggml_vocab_test__
  67. 3333333
  68. __ggml_vocab_test__
  69. 33333333
  70. __ggml_vocab_test__
  71. 333333333
  72. __ggml_vocab_test__
  73. 🚀 (normal) 😶‍🌫️ (multiple emojis concatenated) ✅ 🦙🦙 3 33 333 3333 33333 333333 3333333 33333333 3.3 3..3 3...3 កាន់តែពិសេសអាច😁 ?我想在apple工作1314151天~ ------======= нещо на Български ''''''```````""""......!!!!!!?????? I've been 'told he's there, 'RE you sure? 'M not sure I'll make it, 'D you like some tea? We'Ve a'lL
  74. __ggml_vocab_test__