Categories
News

AI language model runs on a Windows 98 system with Pentium II and 128MB of RAM — Open-source AI flagbearers demonstrate Llama 2 LLM in extreme conditions


EXO Labs has penned a detailed weblog publish about running Llama on Windows 98 and demonstrated a somewhat highly effective AI massive language model (LLM) working on a 26-year-old Windows 98 Pentium II PC in a transient video on social media. The video exhibits an historic Elonex Pentium II @ 350 MHz booting into Windows 98, and then EXO then fires up its customized pure C inference engine primarily based on Andrej Karpathy’s Llama2.c and asks the LLM to generate a story about Sleepy Joe. Amazingly, it really works, with the story being generated at a very respectable tempo.

The above eye-opening feat is nowhere close to the top sport for EXO Labs. This considerably mysterious group got here out of stealth in September with a mission “to democratize entry to AI.” A staff of researchers and engineers from Oxford College shaped the group. Briefly, EXO sees a handful of megacorps controlling AI as a very dangerous factor for tradition, fact, and different elementary features of our society. Thus EXO hopes to “Construct open infrastructure to coach frontier fashions and allow any human to run them anyplace.” On this manner, extraordinary people can hope to coach and run AI fashions on nearly any gadget – and this loopy Windows 98 AI feat is a totemic demo of what could be carried out with (severely) restricted assets.

For the reason that Tweet video is somewhat transient, we have been grateful to seek out EXO’s weblog publish about Running Llama on Windows 98. This publish is printed as Day 4 of “the 12 days of EXO” collection (so keep tuned).

(*2*)

(Picture credit score: Alex Cheema on GitHub)

As readers would possibly anticipate, it was trivial for EXO to select up an outdated Windows 98 PC from eBay as the muse of this undertaking, however there have been many hurdles to beat. EXO explains that getting knowledge onto the outdated Elonex branded Pentium II was a problem, making them resort to utilizing “good outdated FTP” for file transfers through the traditional machine’s Ethernet port.





Source link

Leave a Reply

Your email address will not be published. Required fields are marked *