Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it
AI Summary
Andrew Ho, a former OpenAI employee, is launching a company that will focus on specialized training data, predicting that AI labs will need to invest over $100 billion in targeted data collection. He and researcher Adam Hunt argue that large language models are becoming more specialized and are not improving in versatility despite scaling up.
From the source
Former OpenAI employee Andrew Ho and Cambridge researcher Adam Hunt see a growing problem with large language models. Instead of becoming more versatile, the models are becoming more specialized, excelling at coding and math while stagnating or even regressing in other areas. Ho is leaving OpenAI to start a company focused on specialized training data and predicts that AI labs will need to spend more than $100 billion on targeted data collection. The article Ex-OpenAI researcher bets $100 billio
The full text couldn't be loaded here (the source may require a subscription).
View original at The Decoder