Is Inflection-2 The New LLM Leader After Outshining Google’s PaLM 2 On Benchmarks?

Inflection-2, an LLM by AI startup Inflection AI, claims to have outshined Google's PaLM 2 across benchmarks. Let’s dive into the latest in Large Language Model innovation!

A new Large Language Model (LLM) called Inflection-2 has been launched by the AI startup Inflection, with the goal of creating "personal AI for everyone." The LLM is so efficient and powerful that it even outperforms Google's PaLM 2, as per their report.

Training on more than 5,000 NVIDIA GPUs allowed Inflection-2 to achieve 1.025 quadrillion FLOPs, matching the performance of PaLM 2 Large. On assessments of logic, factual understanding and stylistic capability, preliminary benchmarks revealed that Inflection-2 surpasses Google's model!

A number of popular academic AI benchmarks showed that Inflection-2 outperformed PaLM 2 on the majority of them. This involved surpassing the search giant's flagship on many exams, such as the Grade School Math (GSM8k) standards, TriviaQA, and the diversified Multi-task Middle-school Language Understanding (MMLU) assessments.

 

So, What Can We Expect From Inflection Now?

Despite being significantly larger than its predecessor, Inflection-2 will boost its serving speed and lower expenses, thanks to its move from NVIDIA A100 to H100 GPUs for inference and optimization tasks. Inflection-1 and Inflection-2 training was made feasible by an AI cluster that collaboratively consisted of NVIDIA, Microsoft and CoreWeave.

A representative from Inflection stated that with the release of this new model, the company is "a big milestone closer" to its goal of making AI helpers available to everyone. Their 22,000 GPU supercluster will be perfect for training even larger models and the team is "already looking forward" to it.

Pi, the startup's personal assistant app, will soon be powered by the new LLM, allowing for more natural chats and valuable features.

Researchers at Inflection are also concerned about user safety and the company was among the first to join the White House's voluntary AI pledges in July 2023. Models are regularly examined and aligned using best practices, according to the company's safety staff.

For additional information on how Inflection-2 fares against Inflection-1 and the most formidable LLMs, including LLaMA-2, Grok-1, PaLM-2, Claude-2, and GPT-4, as well as other benchmarks, head here.


Despite the dominance of technology giants such as Google and Microsoft in the field of large language models, Inflection's latest effort presents a significant threat to them. With strong benchmarks and promises to scale further, Inflection is driving AI giants to rethink their strategies as the race to deliver the next generation of AI models is on!

Can Inflection-2 overtake Google's PaLM 2 and other models with its convincing benchmark score? Is Inflection poised for growth with this latest innovation?

Let us know your thoughts in the comments section below!