Breaking News

Samsung announces Galaxy Tab S11 and Galaxy S25 FE series TEAMGROUP Launches EXPERT P34F Find My External SSD NIKON RELEASES A NEW SILVER EDITION OF THE Z F FULL-FRAME MIRRORLESS CAMERA JSAUX Showcases Upcoming Switch 2 Ecosystem Solutions Ahead of IFA Berlin 2025 Viltrox Joins the L-Mount Alliance, Expanding Creative Possibilities

logo

  • Share Us
    • Facebook
    • Twitter
  • Home
  • Home
  • News
  • Reviews
  • Essays
  • Forum
  • Legacy
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map

Search form

Sony Achieves Record Deep Learning Speeds Through Distributed Learning

Sony Achieves Record Deep Learning Speeds Through Distributed Learning

Enterprise & IT Nov 13,2018 0

Sony said that by utilizing its deep learning development framework "Core Library: Neural Network Libraries" in addition to the AI Bridging Cloud Infrastructure (ABCI), it has achieved the fastest deep learning speeds in the world.

Deep learning is a method of machine learning which uses neural networks modeled after the human brain. By harnessing deep learning, image and sound recognition capabilities have seen rapid growth in recent years, even outperforming humans in certain domains. However, the size of data used in this learning and model parameters used to improve recognition accuracy have been increasing, causing a subsequent rise in calculation times. In some cases, it has taken weeks or even months to conduct a single learning session. Because AI development requires a continuous process of trial-and-error, shortening this learning time is of the utmost importance. To this end, distributed learning using multiple GPUs as a means of shortening learning times is emerging as a popular solution.

When increasing the number of GPUs for distributed learning, there are cases where an increase to batch sizes (the amount of data to be processed at one time) halts the learning process, and other cases where the learning speed actually decreases due to the processing delays caused by data transmission times between GPUs. By utilizing technology that can determine the optimal batch sizes and appropriate number of GPUs based on the current state of the learning process, Sony made it possible to carry out learning even in large-scale GPU environments such as ABCI, and increased transmission speeds between GPUs through data synchronization technology optimized for ABCI's system structure. These technologies were implemented into the "Neural Network Libraries," and used ABCI computing resources provided by AIST's "ABCI Grand Challenge" to carry out learning. As a result, it was able to complete ImageNet/ResNet-50 (the general industry benchmark used to measure distributed learning speeds for deep learning) in approximately 3.7 minutes (when using as many as 2,176 GPUs), achieving the world's fastest speeds to date.

The results of this research have been published at "ImageNet/ResNet-50 Training in 224 Seconds (PDF)."

Moving forward, Sony will continue development on related technologies and seek to contribute to the development of society using AI technology.

Tags: deep learningSony
Previous Post
SoftBank to Raise $21 Billion in IPO to Fund Tech Deals
Next Post
China Erases Thousands of Social Media Accounts

Related Posts

  • Sony’s 360 Virtual Mixing Environment now available in Europe

  • Sony completes its INZONE gaming gear range with new headsets and more

  • PlayStation announces FlexStrike wireless fight stick

  • Sony Introduces the RX1R III

  • Sony launches a high-resolution shotgun microphone with superior sound quality and compact design.

  • Sony introduces the FX2 compact camera

  • Celebrate Days of Play 2025 starting on May 28

  • Sony introduces WH-1000XM6

Latest News

Samsung announces Galaxy Tab S11 and Galaxy S25 FE series
Smartphones

Samsung announces Galaxy Tab S11 and Galaxy S25 FE series

TEAMGROUP Launches EXPERT P34F Find My External SSD
Consumer Electronics

TEAMGROUP Launches EXPERT P34F Find My External SSD

NIKON RELEASES A NEW SILVER EDITION OF THE Z F FULL-FRAME MIRRORLESS CAMERA
Cameras

NIKON RELEASES A NEW SILVER EDITION OF THE Z F FULL-FRAME MIRRORLESS CAMERA

JSAUX Showcases Upcoming Switch 2 Ecosystem Solutions Ahead of IFA Berlin 2025
Gaming

JSAUX Showcases Upcoming Switch 2 Ecosystem Solutions Ahead of IFA Berlin 2025

Viltrox Joins the L-Mount Alliance, Expanding Creative Possibilities
Cameras

Viltrox Joins the L-Mount Alliance, Expanding Creative Possibilities

Popular Reviews

be quiet! Dark Mount Keyboard

be quiet! Dark Mount Keyboard

be quiet! Light Loop 360mm

be quiet! Light Loop 360mm

be quiet! Light Mount Keyboard

be quiet! Light Mount Keyboard

Terramaster F8-SSD

Terramaster F8-SSD

Noctua NH-D15 G2

Noctua NH-D15 G2

be quiet! Light Base 600 LX

be quiet! Light Base 600 LX

Soundpeats Pop Clip

Soundpeats Pop Clip

be quiet! Pure Base 501

be quiet! Pure Base 501

Main menu

  • Home
  • News
  • Reviews
  • Essays
  • Forum
  • Legacy
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map
  • About
  • Privacy
  • Contact Us
  • Promotional Opportunities @ CdrInfo.com
  • Advertise on out site
  • Submit your News to our site
  • RSS Feed