New Delhi: Stuart Russel, a University of California, Berkeley professor, cautioned that the text supply for training generative AI models might soon run out of AI developers. Russel highlighted how AI’s reliance on a lot of text material for training big language models is starting to need to be upgraded during his speech at a UN summit.
Russell expressed concern that AI-powered bots like ChatGPT could be “running out of text in the universe” that serves as their training material. The technology that fuels these bots, which analyzes vast amounts of digital text, is now reaching a critical point. During an interview with the International Telecommunication Union, a UN communications agency, Russell described AI’s progress hitting a “brick wall.”
Shortly, data collecting and training strategies for generative AI developers may be impacted by the lack of text accessible for training. These difficulties occur as AI progresses, replacing human involvement in predominantly language-focused tasks.
Russel believes that AI will increasingly replace people in many occupations requiring a “language in, language out” dynamic, notwithstanding the approaching text shortage. Despite the obstacles posed by the limited amount of text available, he is still hopeful about AI’s ability to take over language-related duties currently handled by humans.
The overall training of chatbots may hit a brick wall in the future but in terms of usage, ChatGPT has witnessed a drop in active users since the peak it reached after the launch.
Global desktop and mobile traffic to the ChatGPT website fell by 9.7% in June compared to May, according to analytics company Similarweb. Additionally, the number of unique visitors fell by 5.7%, and the time spent on the website declined by 8.5%. David Carr, Senior Insights Manager at a similar web, hypothesized that this fall might reflect a decline in interest in the chatbot. Rishi Jaluria, an analyst at RBS Capital Markets, viewed the data differently, who said that it showed a rise in demand for generative AI that provides real-time data.