Not at all. I was about 18 and just graduating high school when I started to read the Philosopher's Stone. I had an 18 hr flight the day the last book was published, and I kid you not, just under 1/2 the airplane had a copy of Book 7 in their hands including people in their 50s and 60s. HP - and any well-written book - is for all ages.
You sir...read slow. But for reals, read the series and start from the beginning. As for the movies(after reading the books), start with the fourth one, maybe the third one. The ones before seem really childish as the characters are so little. Eleven...I don't like watching the first ones. The fourth is when it starts to get good. I am excited about the July 15th showing. Juicy says we have tickets. I hope I don't have to be angry again. I hate being angry at a movie.