My initial circuit did the same thing until I switched from a TI chip to a MIC7300YM5 TR. I think the output load was too much for it and could only source to 4.35V.
My PWM filter is a 39K with a 0.1uF to GND and the op amp is just configured as a buffer to give me the full 0 to 5V swing.