Stability AI Unveils FreeWilly1 and FreeWilly2

• Stability AI introduces FreeWilly1 and FreeWilly2, new open-source Large Language Models.
• These models excel in reasoning competitions and specialized disciplines like law and mathematics.
• Microsoft's methodology and Meta's LLaMA model influenced the models' development.

Stability AI's CarperAI Lab has unveiled FreeWilly1 and FreeWilly2, two powerful open-source Large Language Models (LLMs). These model have been designed to push the boundaries of language understanding and reasoning. Developed with the industry-standard Alpaca format, they both leverage Meta's LLaMA:

• FreeWilly1 uses the original LLaMA 65B foundation model.
• FreeWilly2 uses the LLaMA 2 70B base model to achieve GPT-3.5-level performance.

Microsoft's groundbreaking Orca project influenced the team's approach to training these models. They leveraged high-quality instructions to generate a dataset containing 600,000 data points. Despite using only 10% of the original Orca dataset size, the FreeWilly models exhibit exceptional performance across multiple benchmarks. They also demonstrated their proficiency in resolving complex issues. This regards specialised disciplines like law and mathematics, intricate reasoning, and understanding language nuances.

Using EleutherAI's lm-eval-harness with the addition of AGIEval, the team conducted thorough evaluations, confirming the FreeWilly models' top-notch performance in language comprehension and their potential to revolutionize various applications in artificial intelligence.

Stability AI believes that these new open-access Large Language Models, FreeWilly1 and FreeWilly2, enhance our understanding of spoken language and create unprecedented possibilities for innovative use-cases across multiple domains.

Worldcoin's unique and unconventional approach makes it stand out among in the crypto space. As we are curious to see how this ambitious project will evolve, we'll keep a close eye on its progress and provide regular updates on the exciting developments ahead.

To know more about these topics, read the following articles:

• OpenAI Introduces Custom Instructions for ChatGPT
• Apple Tests Generative AI with "Apple GPT" Chatbot Project
• Meta Launches Free Open-Source LLaMA 2 to Challenge ChatGPT