[photon]

Not sure I'd say LLMs have passed the Turing test. It really depends on the kind of question asked, in some cases sure it sounds very good (and it should since it's just taking what real people have said and re-stating it), but in other cases it's clear that there's zero comprehension going on and it fails laughably.

Not even sure the Turing test is an applicable test for LLM AIs since again it's just regurgitating what people have said.. so the test is testing what humans say, not what the AI "thinks". But I guess that could be said of humans to some degree.

And it's not a bad thing that better tests become relevant as things advance.. the Turing test isn't some absolute thing, it's just an idea from an era with zero experience with what was to come.

That said then I kind of agree with the point about the benchmark being for it to come up with something novel and unique. Well first I disagree with that being the only benchmark, but it is something that humans are capable of, just maybe not to the degree that we probably would like to think of ourselves. But the point that some significant portion of what we say and do and create is just an extension or remix of something previous. Creators are inspired by what they consume, but does inspire just mean some degree of taking something and remaking it in a different way with some different influence? But new stuff does occur.

Demonstrating understanding would be something that would be a sign of a true AI vs a LLM.