What happened
In a Stanford HAI talk and conversation with Fei-Fei Li, Jeff Dean said automated research systems can speed up parts of model development but cannot make recursive self-improvement run infinitely fast, because training, computation, data storage, and evaluation take time. He also described Discovery Loop, his new company, which he said has about 20 automated improvement loops running and aims to increase domain experts’ productivity by 20 to 50 times.