First, remove all the etch from the layers you want to remove. Then open the stackup editor tool and by right mouse button on the grey space on the far left of the form (I've highlighted the spot in my pic below - it's the spot highlighting the "6") You will see that you get the option to "Remove Layer". Continue to remove layers until you are left with TOP, BOTTOM and a dielectric layer between them.