Là một dự án mã nguồn mở, Pierian-Data/foundations_for_deep_learning đã đạt 127 sao trên GitHub. Building a foundation for deep learning with mathematics and neuroscience
Tóm tắt dựng từ metadata GitHub của chính dự án — chưa có bài review TopGit. Trang sẽ tự động cập nhật khi bài review đầy đủ được xuất bản.
VÌ SAO CHƯA CÓ REVIEW
TopGit viết bài đầy đủ cho repo có nhiều sao nhất và được yêu cầu nhiều nhất. Trang này là snapshot trong thời gian chờ — xem README gốc ở tab READ ME.
I emphasize mathematical/conceptual foundations because implementations of ideas(ex. Torch, Tensorflow)
will keep evolving but the underlying backbone must be sound. Anybody with an interest in deep learning
can and should try to understand why things work.
I include neuroscience as a useful conceptual foundation for two reasons. First, it may provide inspiration
for future models and algorithms. Second, the success of deep learning can contribute to useful hypotheses
and models for computational neuroscience.
Information Theory is also a very useful foundation as there's a strong connection between data compression
and statistical prediction. In fact, data compressors and machine learning models approximate Kolmogorov Complexity
which is the ultimate data compressor.
You might notice that I haven't emphasized the latest bench-mark beating paper. My reason for this is that a good
theory ought to be scalable which means that it should be capable of explaining why deep models generalise and we
should be able to bootstrap these explanations for more complex models(ex. sequences of deep models(aka RNNs)).
This is how all good science is done.
Classics:
Learning Deep Generative Models(Salakhutdinov 2015)
Uncertainty in Deep Learning(Yarin Gal 2017)
Markov Chain Monte Carlo and Variational Inference: Bridging the Gap (Salimans 2014)
Weight Normalization (Salimans 2016)
Mixture Density Networks (Bishop 1994)
Dropout as a Bayesian Approximation(Yarin Gal 2016)
Learning Deep Generative Models(Salakhutdinov 2015)
Why does unsupervised pre-training help deep learning?(Erhan et al. 2010)
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift(Ioffe 2015)
Mathematical papers:
Dropout Rademacher Complexity of Deep Neural Networks(Wei Gao 2014)
Distribution-Specific Hardness of Learning Neural Networks(Shamir 2017)
Lessons from the Rademacher Complexity for Deep Learning(Sokolic 2016)
A mathematical theory of Deep Convolutional Neural Networks for Feature Extraction(Wiatowski 2016)
Spectral Representations for Convolutional Neural Networks(Rippl 2015)
Electron-Proton dynamics in deep learning(Zhang 2017)
Empirical Risk Minimization for Learning Theory(Vapnik 1991)
The Loss Surfaces of Multilayer Networks(Y LeCun et al. 2015)
Understanding Synthetic Gradients and Decoupled Neural Interfaces(W. Czarnecki 2017)
Dataset Shift(Storkey 2013)
Risk vs Uncertainty(I. Osband 2016)
The loss surface of deep and wide neural networks(Q. Nguyen 2017)
Information Theory papers:
Shannon Information and Kolmogorov Complexity (Grunwald 2010)
Discovering Neural Nets with Low Kolmogorov Complexity(Schmidhuber 1997)
Opening the black box of Deep Neural Networks via Information (Schwartz-Ziv 2017)
Neuroscience papers:
Towards an integration of deep learning and neuroscience(Marblestone 2016)
Equilibrium Propagation(Scellier 2016)
Biologically plausible deep learning(Bengio 2015)
Random synaptic feedback weights(Lillicrap 2016)
Deep learning with spiking neurons(Mesnard 2016)
Towards deep learning with spiking dendrites(Guergiuev 2017)
Variational learning for recurrent spiking networks(Rezende 2011)
A view of Neural Networks as dynamical systems(Cessac 2009)
Note: This is a work in progress. I have a lot more papers to add.
Đọc thêm về Pierian-Data/foundations_for_deep_learning ở đâu?
Trang TopGit này là một snapshot — tab "Readme" hiển thị nguyên văn README của repo (đã bỏ link, giữ ảnh). Repo GitHub ở github.com/Pierian-Data/foundations_for_deep_learning là nguồn chính thức.
Pierian-Data/foundations_for_deep_learning có bao nhiêu sao?
Pierian-Data/foundations_for_deep_learning có 127 sao GitHub — tải lại trang để xem số mới nhất, hoặc xem trực tiếp github.com/Pierian-Data/foundations_for_deep_learning. TopGit phản chiếu số sao của GitHub nhưng không cam kết đến từng phút.
Pierian-Data/foundations_for_deep_learning có phải mã nguồn mở không?
TopGit chưa ghi nhận license cho Pierian-Data/foundations_for_deep_learning. Phần lớn repo public trên GitHub là mã nguồn mở, nhưng điều khoản khác nhau từng repo — mở file LICENSE để xác nhận.
Pierian-Data/foundations_for_deep_learning có website riêng không?
TopGit chưa ghi nhận URL trang chủ cho Pierian-Data/foundations_for_deep_learning. Phần README ở tab phía trên thường có link demo, hoặc xem mô tả GitHub của repo.
Pierian-Data/foundations_for_deep_learning là gì?
Pierian-Data/foundations_for_deep_learning (Pierian-Data/foundations_for_deep_learning) là dự án đa ngôn ngữ trên GitHub. Theo mô tả gốc: Building a foundation for deep learning with mathematics and neuroscience
Đọc đầy đủ README ở tab phía trên.
foundations_for_deep_learning có đáng để bạn bỏ thời gian?
ChatGPT, Claude và Perplexity đều đọc được trang này. Hỏi thử xem họ nghĩ gì về foundations_for_deep_learning.