MLperf

MLCommons, the consortium behind the MLPerf family of machine learning benchmarks, is announcing this morning that the organization will be developing a new desktop AI benchmarking suite under the MLPerf banner. Helmed by the body’s newly-formed MLPerf Client working group, the task force will be developing a client AI benchmark suit aimed at traditional desktop PCs, workstations, and laptops. According to the consortium, the first iteration of the MLPerf Client benchmark suite will be based on Meta’s Llama 2 LLM, with an initial focus on assembling a benchmark suite for Windows. The de facto industry standard benchmark for AI inference and training on servers and HPC systems, MLCommons has slowly been extending the MLPerf family of benchmarks to additional devices over the past several years...

MLPerf Inference v1.0: 2000 Suite Results, New Power Measurements

There has been a strong desire for a series of industry standard machine learning benchmarks, akin to the SPEC benchmarks for CPUs, in order to compare relative solutions. Over...

11 by Dr. Ian Cutress on 4/21/2021

Graphcore Series E Funding: $710m Total, $440m Cash-in-Hand

For those that aren’t following the AI industry, one of the key metrics to observe for a number of these AI semiconductor startups is the amount of funding they...

12 by Dr. Ian Cutress on 1/4/2021

MLPerf Releases Official Results For First Machine Learning Inference Benchmark

Since launching their organization early last year, the MLPerf group has been slowly and steadily building up the scope and the scale of their machine learning benchmarks. Intending to...

12 by Ryan Smith on 11/6/2019

Hot Chips 31 Live Blogs: MLperf Benchmark

MLperf is an up-and-coming benchmark aimed at machine learning, backed by a number of industry leaders in this area.

2 by Dr. Ian Cutress on 8/19/2019

Log in

Don't have an account? Sign up now