If you are driving some LEDs directly without any resistor, you should be pulsing it.
This subject differs from designer to designer.
Some argue that it is wrong.
Some say that it is perfectly normal.
Some argue the people (not the subject) who say it is perfectly normal.
Some argue the people back, not the subject.
So why don't you try driving your LEDs without any resistor but using some PWM freq like MIBAM?
And then if your circuit collapses, then have some resistor and try again.
Post your result here.

A similar LED - Resistor - PWM relationship complexity had been gone on this forum.