Ignore touches during setup to avoid crash.

Also log in case the root cause is (now or in the future) a bug, rather than a race.

Fixes: 192490822
Test: use device normally for a bit
Change-Id: Id4a7f1980bff142e826839c3d76feac419158619