Skip to content

ThePawn02

Gaming and Streaming Content

  • Blog
  • Editor's Picks
  • eSports
  • Guides
  • Headlines
  • News
  • Reviews
  • Uncategorized
  • Website Update
Primary Menu
  • Home
  • Watch Live
  • News
  • eSports
  • Blog
  • Reviews
  • Guides
  • Guild Login
    • Guild Mentality
    • The Zealots
    • Malign
  • Socials
    • Youtube Channel
    • Twitch Channel
    • Kick.com
    • Twitter
    • Instagram
    • Facebook
Subscribe
  • Home
  • 2025
  • May
  • Forget megabucks Nvidia GPUs, apparently all you need to run an LLM is a Pentium II CPU from 1997
  • News

Forget megabucks Nvidia GPUs, apparently all you need to run an LLM is a Pentium II CPU from 1997

The catch? It's kinda slow, as in 20,000 times slower than a GPU.
ThePawn.com May 7, 2025 2 min read
Forget megabucks Nvidia GPUs, apparently all you need to run an LLM is a Pentium II CPU from 1997

The catch? It's kinda slow, as in 20,000 times slower than a GPU.

Conventional wisdom says you need a mountain of Nvidia GPUs at about $50,000 a pop to have a chance of running the latest AI models. But apparently not. EXO Labs (via Indian Defence Review) claims to have got the Llama 2 LLM up and running on a Windows 98 box circa 1997 courtesy of a mere Pentium II processor. Hurrah! The catch? It’s running about 20,000 times slower than on a modern GPU. Haroo.

Apparently, Exo Labs picked up the machine for just under $120 on eBay, following which perhaps the biggest headache was getting peripherals to work, what with the legacy PS2 ports and just a single USB input.

Indeed, getting the required files onto the machine was a serious headache. Then there was compiling the files in a format which was compatible with the Pentium II’s ancient instruction set.

Anywho, with the code and hardware sorted, it was time to run Llama 2. Reportedly, the 260K parameter version of the model achieved 39.31 tokens per second on the Pentium II, while the larger 15M parameter version hit just 1.03 tokens per second.

They even tried a partial data model run using a one billion parameter version of Llama 3.2 which returned a glacial 0.0093 tokens per second. To put that into context, there are references to the one billion parameter 3.2 model hitting 40 tokens per second on Arm CPUs and 200 tokens per second on GPUs.

In other words, it’s running about 20,000 times slower on the Pentium II. But hey, it’s running. The comparison isn’t perfect, there are all kinds of variables in terms of how the models are set up. But that 20,000 times figure probably gives the right idea in terms of the performance delta in rough order of magnitude terms.

Indeed, while it’s impressive to get a modern LLM running on such an old CPU, the performance gap is a reminder that speed matters. Actually, it’s a bit like 3D gaming.

Compiled correctly, you’d could no doubt get Cyberpunk 2077 running in full path-traced mode on a Pentium II at 4K. But you’d probably be looking a frame rate similar to the P II’s 0.0093 tokens per second performance. At which point, it’s all a bit academic.

But maybe it would be fun to watch the pixels being rendered, one-by-one. On the other hand, completing a benchmark run could take years. Perhaps we’ll leave all that, for now.


Best CPU for gaming: Top chips from Intel and AMD.
Best gaming motherboard: The right boards.
Best graphics card: Your perfect pixel-pusher awaits.
Best SSD for gaming: Get into the game first.

About Post Author

ThePawn.com

See author's posts

Continue Reading

Previous: Entire Final Fantasy VII Remake Trilogy Coming to Nintendo Switch 2, Square Enix Developer Reveals
Next: The US DOJ recommends Google break up its ad-tech platform in light of illegal monopoly claims. Google disagrees, unsurprisingly

Related News

Intel commences mass layoffs with over 100 Californian employees, including around 45 engineers in efforts to shed $500 million in operating costs this year
2 min read
  • News

Intel commences mass layoffs with over 100 Californian employees, including around 45 engineers in efforts to shed $500 million in operating costs this year

ThePawn.com June 26, 2025
Corsair introduces PC case fans with ‘reverse rotors’ which apparently help those LEDs shine without obstruction
3 min read
  • News

Corsair introduces PC case fans with ‘reverse rotors’ which apparently help those LEDs shine without obstruction

ThePawn.com June 26, 2025
Thief VR producer says ‘VR is a natural fit for an immersive sim’
4 min read
  • News

Thief VR producer says ‘VR is a natural fit for an immersive sim’

ThePawn.com June 25, 2025

Latest YouTube Video

Check out these awesome streamers

ThePawn02 on twitch

From Gamewatcher

  • Best Nintendo Switch 2 Games To Play Right Now
  • PlayStation Plus Monthly Games for July 2025 Include Diablo 4 As the Subscription Service's 15th Anniversary Celebrations Begin
  • Chrono Odyssey Preview
  • Warhammer 40,000: Space Marine Review
  • Dune: Awakening Review

From IGN

  • Persona 5: The Phantom X Codes (June 2025)
  • Death Stranding 2: On the Beach - Ending Explained
  • Dying Light: Retouched Update Isn't Coming to Nintendo Switch as Techland Denies Plans for Switch 2 Port
  • Humble Bundle Roundup June 2025: Mafia x BioShock Collection, Capcom Publisher Sale, and More
  • Deals For Today: Coke Zero, Doritos, Borderlands 4, and Pokémon Legends Z-A Preorders

From Kotaku

  • The Social Network Part II Is Happening, And Facebook Probably Won’t Like It
  • New Xbox 360 Update Adds More Ads 20 Years After Launch
  • John Cena Has An Idea For A Unique Way He Could Enter The MCU As Peacemaker
  • We Are Getting An Official X-Files Lego Set And It Looks Great
  • New Hot Shots Golf Game Cops To Using Generative AI For Trees

.

You may have missed

Intel commences mass layoffs with over 100 Californian employees, including around 45 engineers in efforts to shed $500 million in operating costs this year
2 min read
  • News

Intel commences mass layoffs with over 100 Californian employees, including around 45 engineers in efforts to shed $500 million in operating costs this year

ThePawn.com June 26, 2025
The Bear Season 4 Review
5 min read
  • Reviews

The Bear Season 4 Review

ThePawn.com June 26, 2025
Corsair introduces PC case fans with ‘reverse rotors’ which apparently help those LEDs shine without obstruction
3 min read
  • News

Corsair introduces PC case fans with ‘reverse rotors’ which apparently help those LEDs shine without obstruction

ThePawn.com June 26, 2025
Death Stranding 2: On the Beach – Ending Explained
8 min read
  • Headlines

Death Stranding 2: On the Beach – Ending Explained

ThePawn.com June 26, 2025
Privacy Policy
  • Home
  • Watch Live
  • News
  • eSports
  • Blog
  • Reviews
  • Guides
  • Guild Login
  • Socials
  • Twitch
  • YouTube
  • Instagram
  • Twitter
  • Facebook
  • Kick.com
Copyright © All rights reserved. | MoreNews by AF themes.