My PhD work on RNNs for musical sequence prediction got me interested in memory-augmented neural architectures. I spent a couple of weeks working through two key papers:
- Neural Turing Machine — Graves et al., Google DeepMind (arXiv)
- Differentiable Neural Computer — a more advanced variant published in Nature
I put together a Google Slides presentation with my observations and notes. Feedback welcome — let me know if anything needs correcting.