Neural Network Console, a tool to efficiently design the neural networks in a refined user interface.
And Neural Network Libraries, an open-sourced library with deep learning technologies developed at Sony.
Yoshiyuki Kobayashi, a developer who has played a central role in deep learning R&D at Sony, speaks about the history of these two projects, and its implications.
The app provides a free section including exclusive video content, editorial news with and galleries, second screen activities, TV schedules and much more. It contains a selection of programs available on Sony channels along with a combination of content available on our other digital platforms.
Access your personal music collection and play it on Sony's network audio products located anywhere in your home, wirelessly. Each Sony network audio product can playback a separate song and be. On Crackle, watch Hollywood movies for free-uncut and unedited. From your favorite genres like Action, Horror, Sci-Fi, Crime and Comedy. Just press Play. Welcome to Essentials! Register your Sony IP-enabled products and manage your favorite internet content to be delivered to your IPTV product.
First of all, tell us about the current status and future potentials of deep learning.
As you know, image recognition with deep learning is already outperforming human capability, and it's expanding to other areas like speech recognition. With such high performance, it is certain that it'll be widely spread for practical usage in no time. It looks like we're at the dawn of the age where using deep learning everywhere will be taken for granted.
You have worked on deep learning for quite a while. Could you share with us a brief history of machine learning at Sony?
Sony began R&D on machine learning back in the 90's, and was able to work on autonomous cognitive development intelligence or deep learning from early on. In 1999, Sony released AIBO that can be emotionally attached to the users, which was an outcome of machine learning research. As for deep learning, R&D was started in 2010.
What specific efforts are being made for R&D on deep learning?
For example, we have developed software to make R&D on deep learning more efficient, for example in image recognition. By using this software, a developer working on recognition can develop it more quickly, or implement better performance given the same amount of time.Recently released Neural Networks Console/Libraries are also one of such efforts to support developers, as well as an outcome of our own R&D. Neural Network Console has also been used within Sony since 2015, for development of recognizer, etc. We believe it has now evolved into a highly reliable one that is worth distributing, and decided to make it publicly available in June, 2017.
How are the achievements from deep learning R&D being applied?
Sony's business is spread over a variety of fields, ranging from the products like camera and smart phone, to game consoles like PlayStation®4, even entertainment contents like music and films… In all of these areas, our accomplishments from deep learning R&D are being actively used. More specifically, Digital Paper's hand-written digit recognition, real estimate price prediction engine at Sony Real Estimate, Xperia Ear's gesture recognition, and many other are using deep learning technologies. Deep learning is also used to realize image recognition for user identification, face tracking, charge stand recognition, generic object recognition, etc. using a fisheye camera installed at the nose in the latest entertainment robot 'aibo', recently announced in November 2017.
So it is indeed being used in a lot of fields.
People usually think of visual data when it comes to the application of deep learning, but as you can see from these examples, deep learning is also applicable to sensor data, numeric data, and many other fields like speech and text. Moreover, deep learning is not only for data recognition, but also can be applied to anomaly detection, data generation, etc. On top of the products and services directly available to the customers, it is also applicable to a broad range of tasks that improve the efficiency of workplaces, such as factory inspection or anomaly detection.
What's the relationship between Neural Network Console/Libraries and AI?
Neural Network Console/Libraries provide one of the most critical back-end technologies that support AI technology.
What do you mean by back-end technology?
First of all, when we speak of AI market, we usually focus on its applications in autonomous driving, industry, manufacturing etc, but we can also think of it as referring to both the applications and the back-end technology that enables those applications. Back-end technology refers to the technology that operates behind every application and task; for example, processors like GPU or CPU that enables an efficient implementation of deep learning, or cloud environments on top of which training or recognition can be implemented.
So it's a platform for further development of AI technology.
Right, our Neural Network Console/Libraries is a software for development, which is one of those core back-end technologies. It's a very useful software that enables a wide array of tasks, ranging from deep learning R&D to actual embedding into the products.
What type of users were you targeting while developing Neural Network Console/Libraries?
Neural Network Console is a highly innovative tool that enables efficient development of product-level recognizers etc. using GUI, which is unprecedented. It is highly recommended to people who want to focus on the core part of their tasks with high development efficiency, as well as to people who are new to deep learning. On the other hand, Neural Network Libraries belong to the same category as many other deep learning softwares, and are basically for the programmers. It enables programming with flexibility, so it's recommended to people who want to focus on R&D.
What are the merits of Neural Network Console?
Neural Network Console contains a lot of know-hows that we obtained over the years as its functionalities. By utilizing these functionalities, researchers and developers on deep learning can focus on the fundamental aspects of their works. Plus, users that are new to deep learning can learn the essence of deep learning via Neural Network Console. It is also a great tool for the universities and the companies, where the demand for education on deep learning is increasing exponentially.
Now, what are the merits of Neural Network Libraries?
The biggest merit of Neural Network Libraries is that it has been refined continuously since 2011. Not only is it equipped with functionalities to implement most up-to-date R&D works, but it also enables intuitive coding and very fast training and prediction. It is very easy to add new function modules (operators), and portability to various devices has been reflected in its design. Neural Network Libraries' strength comes from having all of these benefits.
What was the primary difficulty during development?
Deep learning is a very active research field world-wide, and new techniques and applications are proposed basically every week. Drivers the cisco-linksys network & wireless cards. We were very careful in the design process in order to make a tool that is both easy to use and and is compatible with new technologies and applications. This usability, along with flexibility towards a variety of techniques and applications, is one of the biggest merits that characterize Neural Network Console/Libraries.
What is the motivation for making Neural Network Console/Libraries publicly available?
Sony Network & Wireless Cards Driver Downloads
Drivers spa condor trail. Our goal is to contribute to our society by having developers fully utilize Neural Network Libraries. Considering the wide spectrum of deep learning's applicability, it is impossible for Sony alone to cover the entire fields of application. By providing the users with efficient development tool, we hope to accelerate the application of new deep learning technologies. Also, Sony hasn't really appealed its deep learning technology externally, but hopefully the release of Neural Network Console/Libraries can attract a lot of talents and corporations.
What kind of reactions have you received after the release of Neural Network Console/Libraries?
For Neural Network Console, we're getting lots of positive reactions that it is very easy to understand and use from the users' perspective, since coding is unnecessary and the UI is intuitive. Also, a lot of people are saying that Neural Network Console/Libraries encouraged them to start using deep learning, and our development team is very happy to hear such feedback. Prior to public release, there were already hundreds of users within Sony, but now with the public release, we hope that a lot more new users, including students, can find it useful.
Any particular types of users you would like to recommend Neural Network Console/Libraries to?
We expect it to be of immediate help for those who are already involved in deep learning development and aspire to make it more efficient. Plus, those who are interested in deep learning but are afraid to get started, or those who are just beginning to learn deep learning, will find it helpful as well.
Developer profile
Yoshiyuki Kobayashi
Yoshiyuki Kobayashi joined Sony in 1999. He started R&D on machine learning technology in 2003, and developed music analysis algorithm '12 notes analysis', and 'ELT,' a technology to automatically generate recognition algorithm. Recently, he is mostly working on Neural Network Console and the development of relevant technologies and software, while promoting machine learning and discovering new applications.
Advance Preparation
- Check that your audio device is compatible with Music Center / SongPal.
Compatible models - Connect to a Wi-Fi network with a smartphone that has Music Center / SongPal installed.
For details about connecting to a Wi-Fi network, refer to the operating instructions of the wireless router.
Make a note of the Wi-Fi network name (SSID) and password of the wireless router for future reference. - Turn on your smartphone’s Location and BLUETOOTH settings.
- To find out whether the devices support the NFC function, refer to operating instructions of each device.
- If your audio device and smartphone are connected via a BLUETOOTH connection, disconnect the BLUETOOTH connection on the smartphone.
Sony Network & Wireless Cards Driver Download
Outline of connection
- Connect the smartphone and audio device via a BLUETOOTH connection
- Connect the audio device to the Wi-Fi network
NoteEven if connecting with a Wi-Fi network, a BLUETOOTH connection is required.
If you want to connect your audio device to a Wi-Fi network using Music Center / SongPal, make the Wi-Fi network settings via BLUETOOTH communications.If you are using iOS 13.0 or later, permit access to the Bluetooth from [Settings] - [Music Center] on the iPhone.
If you are using iOS 14.0 or later, permit access to the Local Network from [Settings] - [Music Center] on the iPhone.
How to connect
For Android devices
First, establish a BLUETOOTH connection.
Launch Music Center / SongPal, tap , and select [Connect manually through Bluetooth settings].
Set the audio device to BLUETOOTH pairing mode.
(For details about the pairing operation of the audio device, refer to the operating instructions of the device.)Follow the instructions on the Music Center / SongPal screen and select the audio device from the smartphone’s BLUETOOTH settings menu to establish a BLUETOOTH connection.
Next, connect to a Wi-Fi network.
If a password is required, enter the password that you recorded.
Connecting the audio device to a Wi-Fi network disconnects Music Center / SongPal from the BLUETOOTH connection. The screen then switches to the following.
- If a BLUETOOTH connection could not be established, see the “Unable to connect via a Bluetooth connection” page.
- If you cannot connect to a Wi-Fi network, see the “Unable to connect via a network” page.
If you have established a BLUETOOTH connection with the audio device and another device (such as a smartphone), disconnect any BLUETOOTH connections other than that for the device to which you want to connect.
Start Music Center, select the audio device to which you want to connect, and then do the operations according to Music Center’s screen.
If a password is required, enter the password that you recorded.
When the connection is complete, the screen switches to the following.
- If registration for the device has failed, see the “Failed to register the device” page.
- If you cannot connect to a Wi-Fi network, see the “Unable to connect via a network” page.
First, establish a BLUETOOTH connection.
Turn on your smartphone’s NFC setting.
Launch Music Center / SongPal, tap , and select [Connect by NFC].
When you touch your smartphone’s mark to the audio device’s mark, a BLUETOOTH connection is established.
Next, connect to a Wi-Fi network.
If a password is required, enter the password that you recorded.
Connecting the audio device to a Wi-Fi network disconnects Music Center / SongPal from the BLUETOOTH connection. The screen then switches to the following.
- If a BLUETOOTH connection could not be established, see the “Unable to connect via a Bluetooth connection” page.
- If you cannot connect to a Wi-Fi network, see the “Unable to connect via a network” page.
For iOS devices (iPhone/iPad/iPod touch)
First, establish a BLUETOOTH connection.
If Windows doesn't find a new driver, you can try looking for one on the device manufacturer's website and follow their instructions. Reinstall the device driver. In the search box on the taskbar, enter device manager, then select Device Manager. Right-click (or press and hold) the name of the device, and select Uninstall. Restart your PC. Drivers & Downloads. Locate drivers, user guides and product specifications for your Gateway technology. Recycle your PC, peripherals, electronics and batteries. Learn more about our environmental commitment. Get support via your Windows 10 device. Downloading Mellanox WinOF-2 Driver. To download the executable file according to your operating system, please follow the steps below: Obtain the machine architecture. To go to the Start menu, position your mouse in the bottom-right corner of the Remote Desktop of your screen. Open a CMD console. Vpi laptops & desktops driver download windows 10. Download the latest drivers, software, firmware, and diagnostics for your HP desktops from the official HP Support website.
Launch Music Center / SongPal, tap , and follow the instructions on the screen.
Note
If there already is an audio device with an established BLUETOOTH connection, disconnect the audio device’s BLUETOOTH connection from the iPhone’s settings screen.Set the audio device to BLUETOOTH pairing mode.
(For details about the pairing operation of the audio device, refer to the operating instructions of the device.)From the setting screen of the iPhone, select [Bluetooth] and select the audio device.
Restart Music Center / SongPal on your iPhone and connect to a Wi-Fi network.
If a password is required, enter the password that you recorded.
When the connection is complete, the following screen appears.
- If a BLUETOOTH connection could not be established, see the “Unable to connect via a Bluetooth connection” page.
- If you cannot connect to a Wi-Fi network, see the “Unable to connect via a network” page.
If you have established a BLUETOOTH connection with the audio device and another device (such as an iPhone), disconnect any BLUETOOTH connections other than that for the device to which you want to connect.
Start Music Center, select the audio device to which you want to connect, and then do the operations according to Music Center’s screen.
If a password is required, enter the password that you recorded.
When the connection is complete, the screen switches to the following.
- If registration for the device has failed, see the “Failed to register the device” page.
- If you cannot connect to a Wi-Fi network, see the “Unable to connect via a network” page.