Constant drops to 10fps

I'm getting constant drops from 70 to 10-5 fps every 5 or so minutes and I'm not sure why. I have everything on cursed with VSync off and FPS Lock at 72. Any way to fix this?