Its logical that any light energy not absorbed by a solar panel could cause heat. As the temperature of a panel increases past a point, its efficiency decreases.
Since red and IR is such a large part of the light spectrum it causes the greater problem than blue and UV light which may also not be absorbed. Silicon solar panels have traditionally had a problem absorbing red and IR light, causing them to lose overall efficiency and lifetime, in places like middle east deserts. In fact, one talked about solution was to coat silicon panels with a layer of Red/IR QD that would convert the light rays into energy and transfer them into the rest of the panel.