RNN 卷积神经网络- 吴恩达Andrew Ng 论文等资料汇总

Posted 2021-09-14 架构师易筋

总结

感谢 吴恩达Andrew Ng老师详细教授的RNN，NLP，正在流行的翻译算法Transformers。
课程地址：https://www.deeplearning.ai/program/deep-learning-specialization/

相关的课程总结：

1. RNN神经网络- 吴恩达Andrew Ng 循环神经网络Recurrent Neural Networks Week1 知识总结
2. RNN神经网络- 吴恩达Andrew Ng 循环神经网络 NLP Natural Language processing and word Embeddings Week2 知识总结
3. RNN神经网络- 吴恩达Andrew Ng 循环神经网络 语音识别Sequence Models and the Attention Mechanism Week3 知识总结
4. RNN神经网络- 吴恩达Andrew Ng 循环神经网络 NLP Transformers Week4 知识总结

论文即参考资料

W​eek 1:

• Minimal character-level language model with a Vanilla Recurrent Neural Network, in Python/numpy (GitHub: karpathy)

• The Unreasonable Effectiveness of Recurrent Neural Networks (Andrej Karpathy blog, 2015)

• d​eepjazz (GitHub: jisungk)

• Learning Jazz Grammars (Gillick, Tang & Keller, 2010)

• A Grammatical Approach to Automatic Improvisation (Keller & Morrison, 2007)

• Surprising Harmonies (Pachet, 1999)

W​eek 2:

• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings (Bolukbasi, Chang, Zou, Saligrama​ & Kalai, 2016)

• GloVe: Global Vectors for Word Representation (Pennington, Socher & Manning, 2014)

• W​oebot.

W​eek 4:

• Natural Language Processing Specialization (by DeepLearning.AI)

• Attention Is All You Need (Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser​ & Polosukhin, 2017)

参考

https://www.coursera.org/learn/nlp-sequence-models/supplement/Sul1k/references