July 15, 2022
@BlancheMinerva @Microsoft @NVIDIAAI @DeepMind @OpenAI @MetaAI @allen_ai “I have successfully loaded it on a single x2iezn.6xlarge instance in AWS but using only CPUs the model is very slow. Text generation sampling for several sequences can take several minutes to return”
https://t.co/RUTCZWAdsy

That is $5 / hour at the current AWS prices.


This is one of the many thoughts I post on Twitter on daily basis. They span many disciplines, including art, artificial intelligence, automation, behavioral economics, cloud computing, cognitive psychology, enterprise management, finance, leadership, marketing, neuroscience, startups, and venture capital.

I archive all my tweets here.