simplewall process notifications for all blocked apps and displays only without "Disable notifications" flag (whatewer checked app in list or not).
It may happen because of app trying to connect to ip contained in blocklist when blocklist are enabled. Same with custom rules.
At this time no way to do not show notifications except "Disable notifications" flag and disable entire notifications in settings.