Various thing may do that, but I would suggest to enable the Brown-Out detect, and Power On Timer config fuses and see how better/worst it is from there.