The Falcon Has Landed! Welcome to the Era of Falcon 40B
Changing the game: How Falcon 40B’s is going to disrupt the AI industry
This is huge.
Falcon 40B is the most powerful open source language model to date. And it is now available for commercial use, completely royalty-free!
Something OpenAI might not like that much, maybe? :)
In this post we’ll check out
- why this is a game-changer for the AI industry,
- what is unique about Falcon 40B,
- and how you can test the new open-source language model yourself.
Why Is This A Game-Changer?
First of all: it’s 100% open source 🥳
- Remarkably, for a model that is in the same league as OpenAI’s GPT-3, everything that went into its development has been disclosed — from the training data to the training recipe.
- This transparency is invaluable for researchers, especially compared to OpenAI’s GPT-4, where such details have not been fully disclosed.
- And, of course, anyone can freely implement its capabilities into their products.
Amazing performance 🔥
- According to the Huggingface LLM leaderboard, which tracks advancements in open-source language models, Falcon is currently the best there is.
- Falcon is already outperforming state-of-the-art language models from renowned players such as DeepMind, Google, and Anthropic.
- To broaden its capabilities, Falcon’s training dataset has been extended with curated sources, including research papers and social media conversations.
The numbers numbers 🤓
- Falcon 40B has 40 billion parameters and was trained on approximately one trillion tokens (around 750 billion words).
- Despite its power, Falcon uses only 75 percent of GPT-3’s training compute, 40 percent of Chinchilla’s, and 80 percent of PaLM-62B’s.
The Future Of Falcon
Falcon 40B is a breakthrough achieved under the leadership of the Technology Innovation Institute (TII) in Abu Dhabi, specifically the AI and Digital Science Research Center (AIDRC).
Currently, it is already rumored that the Falcon development team is now well on its way to developing and soon announcing Falcon 180B.
Following the success of the TII, the United Arab Emirates (UAE) recently moved up five places in the UN Frontier Technologies Readiness Index 2023: the country now ranks as the best Arab country and 37th out of 166 countries.
The open source AI model joins the list of advanced technological milestones that are expected to make the UAE a major player in the field of AI.
As Dr. Ray O. Johnson, CEO of TII, said:
“As the new fuel that drives technological innovation, the move […] will be game-changing in enhancing the capabilities of innovators, and enabling them to push the boundaries of their projects to achieve remarkable advancements.”
How to test Falcon 40B
To test Falcon 40B yourself, you can navigate to this Demo Space on Huggingface — it’s completey free:
To get an idea of the differences between open source LLMs, check out this comparison from Huggingface between Falcon 7B (a smaller version of Falcon) and LLaMA 7B:
Further Information
- Technology Innovation Institute’s Official Website: https://falconllm.tii.ae/
- Technology Innovation Institue & Falcon 40B on Huggingface: https://huggingface.co/tiiuae
- Falcon 40B on Huggingface: https://huggingface.co/tiiuae/falcon-40b-instruct
➡️ For more information about AI & Creativity, follow me on Twitter or Medium (use my referral link to get full access to all my articles and those of thousands of other writers).
➡️ If you like my content, why not leave a “clap” at the end of this article, so more people can see it?
