How to delete a categorization class with gui?

It seems that I can’t do it. Click the green add sign on the right and select “remove category” will not work. Everything will be the same even if you have clicked save. The only way of doing this for me is to click restore defaults and click save.
Is it a bug or an intended feature? If it is a bug, I will be happy to assist during test.