Lantern is a goal element on some levels. To remove it, you first need to light it.

Make a match or use power-ups next to Lantern to light it. Then, make one more match or use power-ups once more, to destroy it.

But be careful: if you don't hit the Lantern right after it's lit, it will gown out again.