I'm using a SMPS power supply. (from a PC).
Connecting GND to the case of the XTAL solved my problem.
I've never had such a problem before and have no idea why giving GND to case of XTAL solved it . . .
Thank you everyone for helping me out . . .