The issue we're seeing here (to me) really outlines a reason a lot of us are going to be blindsided by all this. It's really good at some things, and really bad at others. If what you do overlaps with the latter, you're likely to dismiss it and stop paying attention (which is reasonable).
For example, what Firebot and I do almost never require that needle-in-a-haystack search capability, but the same can't be said of a lawyer (I presume), who might need damn accurate search capability.
The advancement moves so quick though, and a ton of early LLM issues have been fixed for over a year and nobody even noticed (it's very common to hear people say they can't do math when they're well into solving PhD level math problems by this point).
I assume history will repeat and this search issue will be lessened over time.
|