Easiest thing in the world! 
At the top of the speaker, the fret is molded into a 'handle' which makes it easier to move the speaker. If you reach into the handle with your right hand, you will feel a small button under your ring-finger. Press the button towards the front of the speaker to release the fret, and pull it up about an inch, the fret ought to be free.
We kid because we love.
Bang & Olufsen Tysons Galleria
McLean, VA USA