PBAP: Do not set phonebook access to ACCESS_REJECTED automatically

The value is saved in SharedPreferences. However, it will return ACCESS_UNKNOWN in several cases. We shouldn't set it as rejected automatically. We should ask user when PBAP connect.

Bug: 230712201
Test: manual
Change-Id: Ia3f373b9799cf02c47dc782688430fb234491f61
(cherry picked from commit 5bc5f103)