Breaking News

Lexar Introduces JumpDrive A50V and C50V Dashcam USB Drives Lexar ARES RGB 2nd Gen DDR5 Passes AMD EXPO Ultra Low Latency Certification Tests Thypoch Introduces New Sculptor AF Lens Series with 23mm f1.4 Prime for Fujifilm X-Mount ASUS Announces Availability of ProArt GR1X Xiaomi and Leica Present the Xiaomi 18 Pro Series

logo

  • Share Us
    • Facebook
    • Twitter
  • Home
  • Home
  • News
  • Reviews
  • Essays
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed

Search form

Google, Baidu Support New MLPerf AI Benchmark

Google, Baidu Support New MLPerf AI Benchmark

Enterprise & IT May 2,2018 0

Google and Baidu collaborated with researchers at Harvard and Stanford to define a suite of benchmarks for machine learning (ML).

The 'MLPerf' effort aims to build a common set of benchmarks that enables the machine learning field to measure system performance for both training and inference from mobile devices to cloud services.

So far, AMD, Intel, two AI startups, and two other universities have expressed support for MLPerf, an initial version of which will be ready for use in August.

Other supporters include the University of California at Berkeley, the University of Minnesota, and the University of Toronto as well as two AI startups, SambaNova and Wave Computing.

The goals of MLPerf is to help companies and researchers accelerate progress in ML via fair and useful measurement. It will enable fair comparison of competing systems, enforce replicability to ensure reliable results while keeping benchmarking effort affordable so all can participate.

The first release of MLPerf will focus on training jobs on a range of systems from workstations to large data centers, a big pain point for web giants such as Baidu and Google. Later releases will expand to include inference jobs, eventually extended to include ones run on embedded client systems.

An early version of the suite running on a variety of AI frameworks will be ready to run in about three months.

Initially, MLPerf will measure the average time to train a model to a minimum quality, probably in hours. Given that these jobs are run on large banks of servers, it may not report performance per watt. It will take into consideration the costs of jobs as long as price does not vary over the time of day that they are run.

Nvidia's P100 Volta chip will be a reference standard because it is widely employed by data centers for training. The group aims to update published results every three months.

MLPerf will use two modes: A Closed Model Division specifies the model to be used and restricts the values of hyper parameters, e.g. batch size and learning rate, with the emphasis being on fair comparisons of the hardware and software systems. (The Sort equivalent is called "Daytona," alluding to the stock cars at the Daytona 500 mile race.)

In the MLPerf Open Model Division, competitors must solve the same problem using the same data set but with fewer restrictions, with the emphasis being on advancing the state-of-the-art of ML. (The Sort equivalent was called "Indy," alluding to the even faster Formula One custom race cars designed for events like the Indianapolis 500.)

Tags: Machine learning
Previous Post
Google Invests in Startups to Improve Google Assistant
Next Post
Samsung Releases PRO Endurance Memory Card

Related Posts

  • Imec Uses Machine Learning Algorithms in Chip Design to Achieve cm Accuracy and Low-power Ultra Wideband Localization

  • Seagate Uses NVIDIA's AI Inference Tools to Improve Hard Drive Manufacturing

  • Intel and Georgia Tech to Mitigate Machine Learning Deception Attacks

  • Infineon, Cypress Deal Wins CFIUS Clearance

  • DARPA is Working on Mathematical Framework to Check the Safety of Autonomous Systems

  • IBM Launches New IC922 POWER9-Based Server For ML Inference

  • SiFive and CEVA Partner to Make Machine Learning Processors Mainstream

  • MLPerf Releases Results for Machine Learning Inference Benchmark

Latest News

Lexar Introduces JumpDrive A50V and C50V Dashcam USB Drives
Consumer Electronics

Lexar Introduces JumpDrive A50V and C50V Dashcam USB Drives

Lexar ARES RGB 2nd Gen DDR5 Passes AMD EXPO Ultra Low Latency Certification Tests
PC components

Lexar ARES RGB 2nd Gen DDR5 Passes AMD EXPO Ultra Low Latency Certification Tests

Thypoch Introduces New Sculptor AF Lens Series with 23mm f1.4 Prime for Fujifilm X-Mount
Cameras

Thypoch Introduces New Sculptor AF Lens Series with 23mm f1.4 Prime for Fujifilm X-Mount

ASUS Announces Availability of ProArt GR1X
Enterprise & IT

ASUS Announces Availability of ProArt GR1X

Xiaomi and Leica Present the Xiaomi 18 Pro Series
Smartphones

Xiaomi and Leica Present the Xiaomi 18 Pro Series

Popular Reviews

Endorfy Thock V2 Wireless Keyboard

Endorfy Thock V2 Wireless Keyboard

SoundPeats Cove Pro

SoundPeats Cove Pro

The Quiet Technology Behind the Spin

The Quiet Technology Behind the Spin

Akaso Brave 8 Lite

Akaso Brave 8 Lite

SoundPeats C30

SoundPeats C30

Kioxia Exceria Plus G3 512GB microSD

Kioxia Exceria Plus G3 512GB microSD

be quiet! Dark Perk Mice

be quiet! Dark Perk Mice

XbotGo Chamaleon

XbotGo Chamaleon

Main menu

  • Home
  • News
  • Reviews
  • Essays
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
  • About
  • Privacy
  • Contact Us
  • Promotional Opportunities @ CdrInfo.com
  • Advertise on out site
  • Submit your News to our site
  • RSS Feed