It is striking that every AI corporation has a press arm. nebius.science is from Nebius Group, which is the non-Russian rebranded Yandex and sells data centers.
We can only hope that none of us fall behind on the changing of LLMs lol. They change faster and faster lately. I don't blame him for thinking LLMs are still at the level of GPT 4 turbo lmao.
My favorite LeCun was when he was talking about LLMs understanding the real world. In the clip he essentially said "If I have a water bottle on this book and I push the book, the water bottle will move as well. A 3 year old can tell you this. But an LLM has no concept of this effect since it's not written explicitly in any books". The clip is then immediately followed by asking this exact question to a number of LLMs and giving exactly the correct answer.
From the interview, I see he still harps on about the limitations of LLMs and harps on about real world AI. I just can't take him seriously because pretty much everything he says is wrong and hypothetical. He still can't point to a single thing that an LLM fails at that require his so called "world models"
He'll just throw some random stuff out there like "we're not at level 5 driving yet" despite having hundreds of millions of miles driven autonomously every day. He just seems to keep holding on to his beliefs (much of them economic) and refuses to adjust his priors.
Thats kind of missing the point. There's nothing magical about "level 5". This is stupid academic nonsense, not an objective test or anything that can be measured:
> The vehicle can drive anywhere in road traffic and under all conditions without human beings.
I can't drive anywhere in road traffic under all conditions so I guess i'm not level 5? What piece of technology doesn't ever fail or require some kind of human intervention. I don't even think I trust my toaster when I'm out of the room.
Self driving is very much here. Sometimes it fails, because it's technology. The reason steering wheels exist is due to regulations. There are some Chinese cars like Apollo RT6 with a detachable steering wheel
We're still far from solving real-world physical interaction, even with the world knowledge of LLMs incorporated into VLAs. It's the reason robotics startups trying to deploy into people's homes are so reliant on teleop; the hardware is sufficient (we know that because the robots can solve tasks when piloted by a human), but the intelligence is still insufficient.
I don't think JEPA is necessarily the solution (although I'm bullish on world models), but I don't understand why people feel so infuriated about LeCun. The reason he is famous today is because he spent years taking a contrarian stance, working on neural networks when they were seen as dead and buried. He was eventually proven right. Nowadays he holds strong views which contradict the LLM zeitgeist --- what's shocking about that?
It is striking that every AI corporation has a press arm. nebius.science is from Nebius Group, which is the non-Russian rebranded Yandex and sells data centers.
Please call me when Yann is right about literally anything.
No one has been more wrong and for longer about anything than Yann on LLMs.
Noam Chomsky has been wrong about LLMs for longer
We can only hope that none of us fall behind on the changing of LLMs lol. They change faster and faster lately. I don't blame him for thinking LLMs are still at the level of GPT 4 turbo lmao.
My favorite LeCun was when he was talking about LLMs understanding the real world. In the clip he essentially said "If I have a water bottle on this book and I push the book, the water bottle will move as well. A 3 year old can tell you this. But an LLM has no concept of this effect since it's not written explicitly in any books". The clip is then immediately followed by asking this exact question to a number of LLMs and giving exactly the correct answer.
From the interview, I see he still harps on about the limitations of LLMs and harps on about real world AI. I just can't take him seriously because pretty much everything he says is wrong and hypothetical. He still can't point to a single thing that an LLM fails at that require his so called "world models"
He'll just throw some random stuff out there like "we're not at level 5 driving yet" despite having hundreds of millions of miles driven autonomously every day. He just seems to keep holding on to his beliefs (much of them economic) and refuses to adjust his priors.
> "we're not at level 5 driving yet" despite having hundreds of millions of miles driven autonomously every day
Those are two very different things; you know that, right? You could even drive billions of miles, but that doesn't mean we have attained Level 5.
Level 5 definition: https://www.zf.com/products/en/cars/stories/6_levels_of_auto...
Thats kind of missing the point. There's nothing magical about "level 5". This is stupid academic nonsense, not an objective test or anything that can be measured:
> The vehicle can drive anywhere in road traffic and under all conditions without human beings.
I can't drive anywhere in road traffic under all conditions so I guess i'm not level 5? What piece of technology doesn't ever fail or require some kind of human intervention. I don't even think I trust my toaster when I'm out of the room.
Self driving is very much here. Sometimes it fails, because it's technology. The reason steering wheels exist is due to regulations. There are some Chinese cars like Apollo RT6 with a detachable steering wheel
https://www.globaltimes.cn/page/202207/1271140.shtml
We're still far from solving real-world physical interaction, even with the world knowledge of LLMs incorporated into VLAs. It's the reason robotics startups trying to deploy into people's homes are so reliant on teleop; the hardware is sufficient (we know that because the robots can solve tasks when piloted by a human), but the intelligence is still insufficient.
I don't think JEPA is necessarily the solution (although I'm bullish on world models), but I don't understand why people feel so infuriated about LeCun. The reason he is famous today is because he spent years taking a contrarian stance, working on neural networks when they were seen as dead and buried. He was eventually proven right. Nowadays he holds strong views which contradict the LLM zeitgeist --- what's shocking about that?
[dead]
[flagged]