Neural Network Console

• 科学・IT

This video explains the basic structure of the neural network, Attention.
It has recently been very popularly used in Deep Learning alongside Convolutional Neural Networks.

Previous : Downsizing Neural Networks by Quantization
https://www.youtube.com/watch?v=tFmQj7W4qlk

Basics of Designing Neural Network
https://www.youtube.com/watch?v=lp4skE5U8Cs

The Mechanism of Neural Network Training
https://www.youtube.com/watch?v=XeieQQ-LPTQ

What are Recurrent Neural Networks?(RNN)
https://www.youtube.com/watch?v=nzwLW6zsJoU

Understanding LSTM without Mathematical Expressions (Long Short-Term Memory)
https://www.youtube.com/watch?v=GKCTlXm8S5o

Neural Network Console Youtube Channel
https://www.youtube.com/c/NeuralNetworkConsole

Playlist : Introduction to Deep Learning
https://www.youtube.com/playlist?list=PLg1wtJlhfh23KxT90XrswtrBhBtP_rc53

Neural Network Console
https://dl.sony.com/

Neural Network Libraries
https://nnabla.org/

Squeeze-and-Excitation Networks
Jie Hu, Li Shen, Samuel Albanie, Gang Sun, Enhua Wu
https://arxiv.org/abs/1709.01507

Attention Is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin
https://arxiv.org/abs/1706.03762

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova
https://arxiv.org/abs/1810.04805

**NOTE**
This contents has been translated from Japanese into English.
The original has been published on January 23, 2020.
https://youtu.be/g5DSLeJozdw