Exclude all directories instead of only known ones

The previous known directories seem to be removed in some case and
breaks the test.  Since the intention is to exclude directories and
compare existing files, exclude all directories instead.

Test: atest ApkVerityTest
Bug: 149469433
Change-Id: Ib096062b5647920b90f7d9d5638226392a2df174