The last week has seen a promising entrance for a new chip company, Groq. Whilst Nvidia, AMD, Google and Intel ‘s AI chips have become the hottest commodities on earth (Nvidia recorded the biggest single-day jump in market cap in history this week), a small vendor has demonstrated its new silicon can run AI models faster and more cheaply than the established competition, without reliance on scarce high bandwidth memory. Prices for running AI ‘inference’ have already been falling through the floor and are set to fall further assuming Groq can get their chips fabricated and to market in volume.
chips and hardwarecompute infrastructureinference economics
Groq who?
Groq introduces new silicon capable of running AI inference faster and cheaper than established competitors, potentially disrupting the current dominance of Nvidia and others in the AI chip market.
Joel Miller
1 min read
