The STANDARD 3.5mm jack actually has two (2) standards, Mono or Stereo.
As you have said that if you pull the plug out about way, then the phone reports the headset connected, means you have the wrong jack.
A Mono 3.5mm jack has one black band on the plug and a stereo has two.
Below is a picture of a stereo plug, notice the two black insulating bands