Some of my favorite reactions to this paradigm shift in machine intelligence we are witnessing:
bless you Melanie.
Mine olde friend, the log scale, still as beautiful the day I met you
Weird, the AI that has read every chess book in existence and been trained on more synthetic games than any one human has seen in a lifetime still doesn't understand the rules of chess
^(just an interesting data point from Ernie, + he upvotes pictures of my dogs on FB so I gotta include him)
Dog tax
Yes, the classical algo achieves perfect accuracy and is way faster. There is also a table that shows the cost of running o1 is enormous. Like comically bad. Boil a small ocean bad. We'll just 10x the size and it will achieve 15 steps inshallah.
Imo, this is like the same behavior we see on math problems. More steps it takes, the higher the chance it just decoheres completely. I can't see any reason why this type of thing would just "click" for the models if they are also unable to do multiplication.
I mean this just reeks of pure hopium from OAI and co that things will magykly work out. (But the newer model is clearly better^{tm}! I still don't see any indication that one day that chart is just going to be 100s across the board.)