Tencent Hunyuan-Large
(github.com/Tencent)
With the rapid development of artificial intelligence technology, large language models (LLMs) have made significant progress in fields such as natural language processing, computer vision, and scientific tasks.
With the rapid development of artificial intelligence technology, large language models (LLMs) have made significant progress in fields such as natural language processing, computer vision, and scientific tasks.
Show HN: Byte-Pair Encoding tokenizer for training LLMs on large datasets
(github.com/jmaczan)
Byte-Pair Encoding tokenizer for large language models that can be trained on arbitrarily huge datasets
Byte-Pair Encoding tokenizer for large language models that can be trained on arbitrarily huge datasets
Lish Shell
(github.com/nibbula)
This repository has been archived by the owner on Sep 25, 2024. It is now read-only.
This repository has been archived by the owner on Sep 25, 2024. It is now read-only.