Breaking News

Google Outlines How It Tackles Disinformation Across Seearch, News and Youtube LG V50 ThinQ 5G Smartphone Appears Online TCL's Foldable Phone Bends Into a Smartwatch Uber's Growth is Slowing Apple Said to Buying Voice App Startup Pullstring

logo

  • Share Us
    • Facebook
    • Twitter
  • Home
  • Home
  • News
  • Reviews
  • Legacy
    • Media Tests
    • DVD Media Formats

    • Glossary
    • FAQ
    • Firmware
    • Drivers
    • BIOS
    • Software
  • Forum
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map

Search form

Sony Achieves Record Deep Learning Speeds Through Distributed Learning

Sony Achieves Record Deep Learning Speeds Through Distributed Learning

Enterprise & IT Nov 13,2018 0

Sony said that by utilizing its deep learning development framework "Core Library: Neural Network Libraries" in addition to the AI Bridging Cloud Infrastructure (ABCI), it has achieved the fastest deep learning speeds in the world.

Deep learning is a method of machine learning which uses neural networks modeled after the human brain. By harnessing deep learning, image and sound recognition capabilities have seen rapid growth in recent years, even outperforming humans in certain domains. However, the size of data used in this learning and model parameters used to improve recognition accuracy have been increasing, causing a subsequent rise in calculation times. In some cases, it has taken weeks or even months to conduct a single learning session. Because AI development requires a continuous process of trial-and-error, shortening this learning time is of the utmost importance. To this end, distributed learning using multiple GPUs as a means of shortening learning times is emerging as a popular solution.

When increasing the number of GPUs for distributed learning, there are cases where an increase to batch sizes (the amount of data to be processed at one time) halts the learning process, and other cases where the learning speed actually decreases due to the processing delays caused by data transmission times between GPUs. By utilizing technology that can determine the optimal batch sizes and appropriate number of GPUs based on the current state of the learning process, Sony made it possible to carry out learning even in large-scale GPU environments such as ABCI, and increased transmission speeds between GPUs through data synchronization technology optimized for ABCI's system structure. These technologies were implemented into the "Neural Network Libraries," and used ABCI computing resources provided by AIST's "ABCI Grand Challenge" to carry out learning. As a result, it was able to complete ImageNet/ResNet-50 (the general industry benchmark used to measure distributed learning speeds for deep learning) in approximately 3.7 minutes (when using as many as 2,176 GPUs), achieving the world's fastest speeds to date.

The results of this research have been published at "ImageNet/ResNet-50 Training in 224 Seconds (PDF)."

Moving forward, Sony will continue development on related technologies and seek to contribute to the development of society using AI technology.

Tags: deep learningSony
Previous Post
SoftBank to Raise $21 Billion in IPO to Fund Tech Deals
Next Post
China Erases Thousands of Social Media Accounts

Related Posts

  • Sony Names New PlayStation Chief

  • Sony's Profit Weakened as PS4 Sales Slow

  • Intel Introduces the Nauta Distributed Deep Learning Platform for Kubernetes

  • Sony to Launch the "aibo Patrol" Service in Japan

  • Sony Announces the α6400 Mirrorless Camera with Real-time Eye Autofocus, Real-time Tracking

  • Sony Unveils Newest Products at CES 2019

  • Sony to Bring 3D Camera Sensors top Smartphones

  • Deep Learning Turns Mono Audio to 3D Sound

0 Comments

Leave a Reply

More information about text formats

Filtered HTML

  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Lines and paragraphs break automatically.

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.

BBCode

  • No HTML tags allowed.
  • You may use these tags: [abbr], [acronym], [b], [center], [code], [color], [define], [font], [h1], [h2], [h3], [h4], [h5], [h6], [hr], [i], [img], [justify], [left], [list], [node], [php], [quote], [right], [s], [size], [sub], [sup], [u], [url], [wikipedia], [youtube], [align], [link], [ol], [ul]
  • Lines and paragraphs break automatically.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Image CAPTCHA
Enter the characters shown in the image.

Latest News

Google Outlines How It Tackles Disinformation Across Seearch, News and Youtube
Enterprise & IT

Google Outlines How It Tackles Disinformation Across Seearch, News and Youtube

LG V50 ThinQ 5G Smartphone Appears Online
Smartphones

LG V50 ThinQ 5G Smartphone Appears Online

TCL's Foldable Phone Bends Into a Smartwatch
Smartphones

TCL's Foldable Phone Bends Into a Smartwatch

Uber's Growth is Slowing
Enterprise & IT

Uber's Growth is Slowing

Apple Said to Buying Voice App Startup Pullstring
Enterprise & IT

Apple Said to Buying Voice App Startup Pullstring

Popular Reviews

Zidoo Z9S 4K Media Player review

Zidoo Z9S 4K Media Player review

CeBIT 2005

CeBIT 2005

CeBIT 2006

CeBIT 2006

LiteOn iHBS112 review

LiteOn iHBS112 review

Nvidia GeForce RTX 2080 Ti and GeForce 2080 Founder's Edition review

Nvidia GeForce RTX 2080 Ti and GeForce 2080 Founder's Edition review

Sony NS955 DVD Player

Sony NS955 DVD Player

Toshiba Exceria M303 64GB and M501 Exceria Pro 64GB MicroSDXC review

Toshiba Exceria M303 64GB and M501 Exceria Pro 64GB MicroSDXC review

Ridisc Media Tests

Ridisc Media Tests

  • Home
  • News
  • Reviews
  • Legacy
    • Media Tests
    • DVD Media Formats

    • Glossary
    • FAQ
    • Firmware
    • Drivers
    • BIOS
    • Software
  • Forum
  • About
    • Submit News

    • Contact Us
    • Privacy

    • Promotion
    • Advertise

    • RSS Feed
    • Site Map
  • About
  • Privacy
  • Contact Us
  • Promotional Opportunities @ CdrInfo.com
  • Advertise on out site
  • Submit your News to our site
  • RSS Feed