Get all your news in one place.
100's of premium titles.
One app.
Start reading
AAP
AAP

YOU WONT BELIEVE: Weka and oracle cloud infrastructure validate 10x throughput gains for long context ai inference | Mind Blowing Facts

Oracle Oracle Cloud Infrastructure Memory OCI Economy Calif Campbell

Joint benchmarks on OCI H100 infrastructure showed 10x more concurrent users, 10x higher token throughput, and 7x more tokens served without adding GPUs

CAMPBELL, Calif., June 10, 2026 /PRNewswire/ -- WEKA, the AI data and memory infrastructure company, today announced production-scale benchmarks that show how organizations can improve the economics of long-context AI inference by serving more users and tokens on the same GPU footprint. The benchmarks show that WEKA's NeuralMesh™ platform with Augmented Memory Grid™ on Oracle Cloud Infrastructure (OCI) serves 10x more concurrent users, delivers 10x higher token throughput, and produces 7x more tokens per GPU than DRAM-only configurations without adding infrastructure. The results were validated on a nine-node OCI bare-metal H100 cluster with 100,000-token context windows.

(PRNewsfoto/WekaIO)

Sign up to read this article
Read news from 100's of titles, curated specifically for you.
Already a member? Sign in here
Related Stories
Top stories on inkl right now
One subscription that gives you access to news from hundreds of sites
Already a member? Sign in here
Our Picks
What’s the Oldest Thing in Your House You Still Use Every Day?
The oldest thing in your house might not sit behind glass or carry a sentimental story. It could be the skillet you grab for eggs, the wooden spoon that has survived three kitchen remodels, or the desk lamp that somehow refuses to die.
Clever Dude
Clever Dude
7 Foods From Your ’80s Childhood That Aren’t Made the Same Way Anymore
If you grew up in the 1980s, you probably remember the bright orange macaroni and cheese, the sweet taste of your favorite soda, and snacks that seemed to make every afternoon better. Some of those familiar products are still available, but the versions on store shelves today may not be…
Grocery Coupon Guide
Grocery Coupon Guide
Brooklyn couple uncover 1901 coal log tied to family history while restoring an 1880s house
James and Laureta Gale found a 1901 coal delivery schedule during their renovation of a historic lodging house. Their discovery connects to James's family history with coal delivery in Brooklyn. The couple is transforming the 1880s building into an 11-room guesthouse with modern amenities. They are also preserving original features…
The Times of India
The Times of India
A couple told a North Carolina woman they were only feeding the turtles, then she turned her camera to the pond
The woman kept on throwing food into the water.
We Got This Covered
We Got This Covered
A Michigan woman says she found worms in fudge from the Applebutter Fest, adding ‘I’m totally grossed out’
An unwanted visitor has made itself a home.
We Got This Covered
We Got This Covered
Lil Jon Says It's 'Hard To Process' Learning the Man Who Raised Him Wasn't His Biological Father
Lil Jon says cousin's DNA test revealed Willie, who raised him, was not his biological father. Ahead of his memoir's release, he reflects on unanswered questions, his son's death and relatives' calls.
International Business Times UK
International Business Times UK
Fourteen days free
Download the app
One app. One membership.
100+ trusted global sources.
Download on the AppStore Get it on Google Play