July 15, 2022
@BlancheMinerva @Microsoft @NVIDIAAI @DeepMind @OpenAI @MetaAI @allen_ai "I have successfully loaded it on a single x2iezn.6xlarge instance in AWS but using only CPUs the model is very slow. Text generation sampling for several sequences can take several minutes to return"
That is $5 / hour at the current AWS prices.
Original tweet: https://twitter.com/giano/status/1547846111473283074
This is one of the many thoughts I post on Twitter on daily basis. They span many disciplines, including art, artificial intelligence, automation, behavioral economics, cloud computing, cognitive psychology, enterprise management, finance, leadership, marketing, neuroscience, startups, and venture capital.
I archive all my tweets here.