Vincent,
The snap shot below shows decal editor with a terminal selected. Click the right mouse button and select padstacks.
As you can see the older padstack properties window comes up, not the new padstack window.
This is the window I can not remove an added layer from. Add a new layer and see if you can remove it using this window.