Don't filter out groups if summary is re-inflating

Bug: 249150028
Test: atest PreparationCoordinatorTest
Test: manual
  0. Enable ADB debugging and plug in device to USB port
  1. Go to lockscreen, have "USB debugging connected" as *only*
  notification
  2. Turn screen off w/ power button
  Observe: no clock flicker
Change-Id: I96e978f6288df97c1250e5e9a4b4cbf24e00c530