I think it's the latter. I would suggest you to do some meditation.
Throwing an arrow in the air but it might be the case that your mind is wandering too much when you start reading. Doing some concentration practice will help.
Don't judge things. Things are just as is, it's your opinion that makes them good or bad. Remember this and whenever you make a judgement then just remove that opinion of yours.