Show HN: WaveletLM – wavelet-based, attention-free model with O(n log n) scalinggithub.com7 points·by anarmorarm·há 3 meses·1 comments
anarmorarm·há 3 meses·discussEdit: GPT-2, not GPT-2 Medium. The 2nd paragraph should read:"With 23.8 PPL on WikiText-103, WaveletLM beats both GPT-2, which was trained on 80× more data, and Transformer-XL Standard, which..."
"With 23.8 PPL on WikiText-103, WaveletLM beats both GPT-2, which was trained on 80× more data, and Transformer-XL Standard, which..."