Reduce WTFs in SyncManager

We sometimes get these WTFs due to a race condition. To improve system health,
let's remove excessive WTFs.

Fix: 158724292
Test: manual code inspection
Change-Id: Id808aedcf2f26973773ae3b3e519baf9ac80a235