Go to Wilder's security forum and search for "matousec.com". You will find that their testing methodology has been discredited many times.
Some of the most common reasons:
1. They test in levels, if a product fails to pass one level then it is not allowed to continue to the next level of testing even though it could pass the next level.
2. Their tests is not a firewall test at all, they don't even tests many network protocols, ports, etc. They test only full advanced HIPS features. So if a products doesn't have full HIPS features included, they give that product a low score even though it could have excellent firewall network control.
3. The
Security Software Testing Suite used in their testing contains mostly methods that are no longer used by most malware today, so even if a product get top score, it really doesn't mean much.
4. Many users believe that Comodo secretly owns matousec.com and uses it to advertise their own product. Awhile back many years ago, matousec.com announced that they were bought by another company. The new company was unknown and hide its registrant with Proxies because nobody could find out who really bought it. You can click-
here and see they still hide their ownership using Whois Protection Guard. Before they announced that they were bought, the Whois info was available to the public. Matousec.com was bought right after the fact of their last test where Comodo took 3rd place below PC Tools Firewall and Online Armor. After the buyout Comodo has been on top every since.
5. The Online Armor controversy- TallEmu was the owner and original developer of Online Armor before he sold it to Emsisoft. Somehow TallEmu and matousec.com (under new ownership after it was sold) got into a disagreement about payments for testing. Online Armor had got top score twice in a roll and PC Tools Firewall also got better scores on previous tests compared to Comodo, but now PC Tools was getting discontinued and the only competitor left was Online Armor. The disagreement did not get settled between TallEmu and matousec.com, so they removed all previous tests that showed that Online Armor had got better scores than Comodo twice in a roll. This happened right after Emsisoft bought Online Armor and it was not the responsibility of Emsisoft to pay the testing fees. Never the less all tests by matousec.com completely removed all references to Online Armor (even the ones that were paid for). Online Armor is still not available on their testing. Some users see this as a way Comodo got rid of their only competitor that could beat them on these tests.
There is even much more to find I'm not going to list everything or I would have to write a book, search on Wilder's Security Forum.
Lets say you probably will never see another product besides Comodo get top honors on their testing results unless matousec.com changes ownership.
Enjoy!!
