I'd read from the start, as with any book to TV/Film adaptation some characters get combined together or cut out. So there will be a few names in the books after 3 that you may not be familiar with. You won't be completely out of the loop if you don't but miss out on more world building for sure.
|