My PhD work on RNNs for musical sequence prediction got me interested in memory-augmented neural architectures. I spent a couple of weeks working through two key papers:

  • Neural Turing Machine — Graves et al., Google DeepMind (arXiv)
  • Differentiable Neural Computer — a more advanced variant published in Nature

I put together a Google Slides presentation with my observations and notes. Feedback welcome — let me know if anything needs correcting.