Home United States USA — China What Should You Know About Yi-34B?

What Should You Know About Yi-34B?

70
0
SHARE

Here’s more about some models coming out of the Chinese economy.
If you’re not familiar with that cluster of letters and numbers, you’re not alone – most people don’t immediately recognize this moniker for one of the most powerful new models to hit the AI world. No, it’s not a new virus. It’s AI.
As with so much of what we’re seeing these days, context is everything.
If you get behind the name, and into the origin of the model, you start to see more about what’s going on internationally, as leaders work toward industry innovations that are going to have a big impact on our world.What’s Under the Hood?
The Yi series of models is made with 6-bit and 34-bit LLMs, which are both open source. There’s a sequence length of 4K, in a 34-billion parameter large training model that outperforms the 70 billion Llama 2 other Meta designs. A smaller 6-billion parameter model is also available.Behind the Project
The company itself, 01.AI, is brand-new, having been founded this year by someone named Kai-Fu Lee.
Lee is a Taiwanese businessman who was educated in the United States, and has experience at Apple, Microsoft and Google.
After his involvement in business, he moved back across the world, relinquished his American citizenship and created a large venture capital fund while also innovating new products.Quotable Notes
So who is this person who has so much experience with the AI frontier?
Let’s look at some of what Lee has said publicly about the industry.

Continue reading...