Skip to content

i keep trying to explain to students that it's, like, a whole thing now

Notifications You must be signed in to change notification settings

chrishwiggins/all-you-need

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This weekend someone sent me a Twitter thread with two recent papers with "...is all you need" in the title. It reminded me that, in the class "Data: past, present, and Future" (the "class" version of the book "How Data Happened") we recently assigned Steven Levy excellent piece on the paper that started it all, "Attention Is All You Need" introducing the Transformer architecture (the "T" of GPT) in 2017. It struck me that we will at some point reach peak "all you need" on arxiv.org, and made me wonder if it's a trend or just my own cognitive bias. It turns out the frequency of "all you need" is growing as t^{12} approximately (cumulative number of papers growing as t^{13}) so the date at which all new papers on the arxiv are "all you need" should be calculable. Source code on GitHub so you can track it yourself as we approach the all-you-need-a-geddon.

About

i keep trying to explain to students that it's, like, a whole thing now

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published