4/ Notice that the EleutherAI team is hoping to release GPT-NeoX with 150-200 billion parameters (competing with GPT-3 DaVinci) by Aug-Dec 2021. Just around the corner.
Original tweet: https://twitter.com/giano/status/1394213041139499008
I hope to see other companies doing the same.
“Q: Are you serious when you say you are going to train a model comparable to the biggest GPT-3 (175b parameters)?
A: Yes…We expect our final model to be somewhere between 150 and 200b param”
https://t.co/P2LWvL8dpY
GPT-3’s free alternative GPT-Neo is something to be excited about https://t.co/Jlmg7ASRuK
I highly recommend reading the announcement:
Replit Apps https://t.co/BfYJN0excZ
Selling hours https://t.co/qsvLxYQ0EC https://t.co/iGb9TxjSIb
