We maybe missed a step with your flashing alert light before simply turning it off.
When it flashes, you can press the button in the middle of the wheel and it gives the reason for the flashing light. Pssible causes are missed calls (check caller ID log), line busy - another handset is on an call or loss of signal to base.
Opman