I finally finished the books. Should I start watching the TV show?

I have some concerns (It might alter my perception of some characters as I imagined them, it diverges from the book, etc) but it's also meant to be a very well-constructed show. I'm at a bit of an impasse, currently. Your thoughts?