Just as a caution for anyone using it for important work, GPT4 failed at doing simple arithmetic for me. I had a PDF of a financial document that I needed to pull a bunch of numbers from, but the formatting was terrible and the OCR didn't seem to pick up the alignment of everything, so copying to Excel wasn't going to work without a bunch of manual effort.
So after a tiny bit of manual cleanup, I dumped it into GPT and it was great at formatting each revenue source into its own line correctly. But then I asked it to sum the numbers together and it completely failed, even though it clearly had all the numbers. It said "Now we will sum these numbers together: 2021.98 + 3216.45 + 56542.54" and so on. But the result was off from what I expected, so I dumped the equation it had written out (adding together about 40 different numbers) into Excel verbatim, and indeed it was totally wrong. It was randomly off by a little over $20K. And the number it was off by doesn't correlate to any of numbers in the document, so it just straight up made up a result instead of doing simple math.
I know it's a language model (and it has been good in that regard), but it's still pretty crude for a lot of things.
|