Visualizing Memorization in RNNs(distill.pub)

5 pointsby stared7 tahun yang lalu1 comments

https://distill.pub/2019/memorization-in-rnns/

2 comments

selimonder7 tahun yang lalu

Great post. Long sequences are a problem I have been dealing with long enough now. Even though GRU outperforms LSTM in longer sequences, it still isn't enough and vanishing gradients problem is still experienced. Currently, one-dimensional convolution units are effective while dealing with longer time steps, but sadly it's not the precise unit people wish to use while processing longer time-steps.

[deleted]7 tahun yang lalu