It is not impossible to remove, but a real pain indeed.
What you need to do is dremel tool the carbon tube on the inside so it weakens. Then you need to release/break the tube from the plastic pieces, like with a screwdriver or pliers. When you jam the screwdriver in there and the plastic...