Groq’s Fast AI Inference Raises $640M With $2.8B Valuation

In the rapidly growing world of artificial intelligence (AI) and generative artificial intelligence (GenAI), enterprises, startups and developers are on the lookout for powerful and affordable AI systems capable of developing and deploying generative AI applications.

This ever-increasing demand has led to a wide range of AI companies offering unique platforms to enhance the development process.

Among these companies is the Silicon Valley-based startup Groq, known for its unique and advanced AI hardware and software solutions, which has just revealed a new successful funding round.

So, will Groq’s new financing bring the company, developers and the AI technology industry? Let’s explore!
 

What Did Groq Reveal About Its Funding Round?

 

• Through a press release published on its website, Groq announced that it has secured $640 million in a Series D funding round with a valuation of $2.8 billion.

• The funding round was led by funds and accounts managed by BlackRock Private Equity Partners and witnessed participation from new and existing investors such as Neuberger Berman, Type One Ventures, Cisco Investments, Global Brain’s KDDI Open Innovation Fund III and Samsung Catalyst Fund.

• Groq’s unique AI inference platform has seen an increase in demand from developers, owing to its exceptional speed.

• As such, over 360,000 developers have turned towards the company’s platform, GroqCloud, to build AI applications using open generative AI models such as Llama 3.1 (Meta), Whisper Large V3 (OpenAI), Gemma (Google) and Mixtral (Mistral).

• The added finances from the funding will be used to scale the capacity of its tokens-as-a-service (TaaS) service, add new models and features to GroqCloud and open the doors to a new hiring wave.

• It will also allow the company to deploy over 108,000 LPUs (Language Processing Units) manufactured by GlobalFoundries by the end of Q1 2025, to meet the increasing demand for its products and services.

• At the same time, Groq also announced the appointment of Stuart Pann as Chief Operating Officer. Pann formerly worked as a senior executive at HP and Intel.

• “I am delighted to be at Groq at this pivotal moment. We have the technology, the talent, and the market position to rapidly scale our capacity and deliver inference deployment economics for developers as well as for Groq,” said Stuart Pann.

• Additionally, Groq will also be able to draw from the expertise of its newest technical advisor, Yann LeCun, VP & Chief AI Scientist at Meta.

• Ahead of this, Groq is also working with Aramco Digital, Earth Wind & Power and others to build AI compute centers globally to boost the availability of Groq technology worldwide.

 

What Did Investors Say?

 

• Samir Menon, Managing Director, BlackRock Private Equity Partners, said, “The market for AI compute is meaningful and Groq’s vertically integrated solution is well positioned to meet this opportunity. We look forward to supporting Groq as they scale to meet demand and accelerate their innovation further.”

• Marco Chisari, Head of Samsung Semiconductor Innovation Center and EVP of Samsung Electronics, said, “Samsung Catalyst Fund is excited to support Groq. We are highly impressed by Groq’s disruptive compute architecture and their software-first approach. Groq’s record-breaking speed and near-instant Generative AI inference performance leads the market.”

 

What Did Groq Executives Say?

 

• Jonathan Ross, CEO and Founder of Groq, said, “You can’t power AI without inference compute. We intend to make the resources available so that anyone can create cutting-edge AI products, not just the largest tech companies. This funding will enable us to deploy more than 100,000 additional LPUs into GroqCloud.”

• [Contd.] “Training AI models is solved, now it’s time to deploy these models so the world can use them. Having secured twice the funding sought, we now plan to significantly expand our talent density. We’re the team enabling hundreds of thousands of developers to build on open models and – we’re hiring.”

• Stuart Pann, Chief Operating Officer at Groq, said, “I am delighted to be at Groq at this pivotal moment. We have the technology, the talent, and the market position to rapidly scale our capacity and deliver inference deployment economics for developers as well as for Groq.”

Do you think the added investment to Groq at a time of economic turbulence will help it capture a better market share of the AI industry?

Let us know in the comments below!