Controls UI - Fix crash on missing control

Properly clean up state when switching structures. Due to events
coming in from the listing controller, do not assume controls that
were initially created are still present.

Bug: 152678308
Test: manual, switch structures after reboot
Change-Id: Ic60782c5a7e292ea633ad812f3313efd33574cc6