VentureBeat

OpenAI experiment finds that sparse models could give AI builders the tools to debug neural networks

OpenAI researchers are experimenting with a new approach to designing neural networks, with the aim of making AI models easier to understand, debug, and govern. Sparse models can provide enterprises ...
Purdue University

In Print: ‘Sparse Graphical Modeling for High Dimensional Data’

This book offers a comprehensive framework for mastering the complexities of learning high-dimensional sparse graphical models through the use of conditional independence tests. These tests are ...
Business Wire

Cerebras and Neural Magic Unlock the Power of Sparse LLMs for Faster, More Power Efficient, Lower Cost AI Model Training and Deployment

SUNNYVALE, Calif. & CAMBRIDGE, Mass.--(BUSINESS WIRE)--Cerebras Systems, the pioneer in accelerating generative AI, and Neural Magic, a leader in high-performance enterprise inference servers, today ...
SDxCentral

DeepSeek looks to offload simple LLM tasks to save billions of parameters

Detailed in a recently published technical paper, the Chinese startup’s Engram concept offloads static knowledge (simple ...

New AI method lets models think harder while avoiding costly bandwidth

New AI memory method lets models think harder while avoiding costly high-bandwidth memory, which is the major driver for DRAM ...
Semiconductor Engineering

HW-Aligned Sparse Attention Architecture For Efficient Long-Context Modeling (DeepSeek et al.)

A new technical paper titled “Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention” was published by DeepSeek, Peking University and University of Washington.
Science Daily

Researchers put glycemic response modeling on a data diet

Data-sparse method opens door to personalized nutrition -- without the stool samples. If you eat a snack -- a meatball, say, or a marshmallow -- how will it affect your blood sugar? It's a ...