Authors : Oyallon, Edouard (Author of the conference)
CIRM (Publisher )
Abstract :
Since 2012, deep neural networks have led to outstanding results in many various applications, literally exceeding any previously existing methods, in texts, images, sounds, videos, graphs... They consist of a cascade of parametrized linear and non-linear operators whose parameters are optimized to achieve a fixed task. This talk addresses 4 aspects of deep learning through the lens of signal processing. First, we explain image classification in the context of supervised learning. Then, we show several empirical results that allow us to get some insights about the black box of neural networks. Third, we explain how neural networks create invariant representation: in the specific case of translation, it is possible to design predefined neural networks which are stable to translation, namely the Scattering Transform. Finally, we discuss several recent statistical learning, about the generalization and approximation properties of this deep machinery.
Keywords : apprentissage profond; traitement du signal; transformée en scattering
MSC Codes :
94A12
- Signal theory (characterization, reconstruction, filtering, etc.)
68T07
- Artificial neural networks and deep learning
Film maker : Hennenfent, Guillaume
Language : English
Available date : 22/02/2021
Conference Date : 28/01/2021
Subseries : Research School
arXiv category : Machine Learning ; Computer Vision and Pattern Recognition
Mathematical Area(s) : Computer Science
Format : MP4 (.mp4) - HD
Video Time : 01:31:47
Targeted Audience : Researchers
Download : https://videos.cirm-math.fr/2021-01-28_Oyallon_1.mp4
|
Event Title : Mathematics, Signal Processing and Learning / Mathématiques, traitement du signal et apprentissage Event Organizers : Anthoine, Sandrine ; Chaux, Caroline ; Mélot, Clothilde ; Richard, Frédéric Dates : 25/01/2021 - 29/01/2021
Event Year : 2021
Event URL : https://conferences.cirm-math.fr/2472.html
DOI : 10.24350/CIRM.V.19705703
Cite this video as:
Oyallon, Edouard (2021). One signal processing view on deep learning - lecture 1. CIRM. Audiovisual resource. doi:10.24350/CIRM.V.19705703
URI : http://dx.doi.org/10.24350/CIRM.V.19705703
|
See Also
-
[Multi angle]
Teasing poster: mathematics, signal processing and learning
/ Author of the conference Antonsanti, Pierre-Louis ; Author of the conference Belotto Da Silva, André ; Author of the conference Cano, Cyril ; Author of the conference Cohen, Jeremy ; Author of the conference Doz, Cyprien ; Author of the conference Lazzaretti, Marta ; Author of the conference Pilavci, Yusuf Yigit ; Author of the conference Rodriguez, Willy ; Author of the conference Stergiopoulou, Vasiliki ; Author of the conference Kaloga, Yacouba ; Author of the conference Safaa, Al-Ali.
-
[Virtualconference]
Optimization - lecture 4
/ Author of the conference Pustelnik, Nelly.
-
[Virtualconference]
Optimization - lecture 3
/ Author of the conference Pustelnik, Nelly.
-
[Virtualconference]
Optimization - lecture 2
/ Author of the conference Pustelnik, Nelly.
-
[Virtualconference]
Optimization - lecture 1
/ Author of the conference Pustelnik, Nelly.
-
[Multi angle]
One signal processing view on deep learning - lecture 2
/ Author of the conference Oyallon, Edouard.
-
[Virtualconference]
Signal processing tutorial - part 2
/ Author of the conference Oudre, Laurent.
-
[Virtualconference]
Signal processing tutorial - part 1
/ Author of the conference Oudre, Laurent.
-
[Virtualconference]
Reinforcement learning - lecture 4
/ Author of the conference Lazaric, Allesandro.
-
[Virtualconference]
Reinforcement learning - lecture 3
/ Author of the conference Lazaric, Allesandro.
-
[Virtualconference]
Reinforcement learning - lecture 2
/ Author of the conference Lazaric, Allesandro.
-
[Virtualconference]
Reinforcement learning - lecture 1
/ Author of the conference Lazaric, Allesandro.
-
[Multi angle]
Basics in machine learning - practical session 2
/ Author of the conference Clausel, Marianne.
-
[Multi angle]
Basics in machine learning - practical session 1
/ Author of the conference Clausel, Marianne.
-
[Multi angle]
Basics in machine learning - lecture 2
/ Author of the conference Clausel, Marianne.
-
[Multi angle]
Basics in machine learning - lecture 1
/ Author of the conference Clausel, Marianne.
Bibliography