Clean-up displayed-bounds

Nothing uses this anymore and it is always empty, so clean-up
the code around it so we don't continue to complicate things
with other bounds.

Bug: 151862790
Test: builds/tests pass
Change-Id: Ib7b9247cc0b125ed019680342be7fc5ffb6245de