Tag: RWKV Project

Eagle 7B : Soaring past Transformers with 1 Trillion Tokens Across 100+ Languages (RWKV-v5)

The RWKV Project recently announced the release of the RWKV-v5 Eagle 7B language model, which is a 7.52B parameter model licensed under the Apache 2.0 license. The model showcases significant multi-lingual performance improvements across 23 languages, with particularly noteworthy advancements in common sense reasoning and world knowledge benchmarks. Additionally, the new model demonstrates a substantial […]

©2023 The Horizon