IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...
InfoWorld

An architecture for engineering AI context

The challenge is not how much context an AI system can hold at once, but how intelligently it can decide what context matters ...
Geeky Gadgets

GPT-4 Turbo 128K context length performance tested

Recently, OpenAI unveiled its latest advancement in the realm of artificial intelligence: the GPT-4 Turbo. This new AI model boasts a substantial 128K context length, offering users the ability to ...
WinBuzzer

Anthropic Unlocks 1M-Token Context Window for all Max, Team, and Enterprise Users

Anthropic has made its 1M-token context window generally available for Claude Opus 4.6 and Sonnet 4.6 at standard pricing, removing the long-context premium.
VentureBeat

MosaicML launches MPT-7B-8K, a 7B-parameter open-source LLM with 8k context length

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More MosaicML has unveiled MPT-7B-8K, an open-source large language model (LLM ...