Simplicity does not automatically make a design good. Each component should have a reason to exist, but that reason need not be purely functional.
Appearance may not improve durability or manufacturing, yet it can matter to someone deciding what to buy.
The choice still depends on the situation and the alternatives. Removing something is not an improvement by itself.
Edited from website discussions, awaiting personal revision; not a published essay.