VANCOUVER — Former OpenAI chief scientist Ilya Sutskever, one of the biggest names in artificial intelligence, had a prediction to make on Friday (Dec 13) — reasoning capabilities will make technology far less predictable.

Accepting a "Test Of Time" award for his 2014 paper with Google's Oriol Vinyals and Quoc Le, Sutskever said a major change was on AI's horizon.

An idea that his team had explored a decade ago, that scaling up data to "pre-train" AI systems would send them to new heights, was starting to reach its limits, he said. More data and computing power had resulted in ChatGPT that OpenAI launched in 2022, to the world's acclaim.

"But pre-training as we know it will unquestionably end," Sutskever declared before thousands of attendees at the NeurIPS conference in Vancouver. "While compute is growing," he said, "the data is not growing, because we have but one internet."

Related

---