I think one of the important thing to take out of this test is an AV's ability to protect at browser level. Bitdefender gives us the perfect example here. It blocked almost everything at browser level which is brilliant. Anyone who has used their TrafficLight extension already have an idea about how good they are in this department. This is why Bitdefender always performs excellent in other test labs like AV-Test, AV-Comparatives (Product of the year) even though in the hub it didn't always performed well. Same goes to Avira. Nothing is wrong with our malware hub tests but one should remember that it showcases a products signatures and behavioral protection capabilities but the first line of defense is ignored.
So, every tests are different and all of them are valid in their own way and useful when done right. CheckLab-pl's tests are more transparent than other labs so we highly appreciate it.
Thank you for your understanding. We're constantly looking for new ways to getting sample malware. Our honeypots are not enough.
This month we will cooperation with CERT Polska. Additional if we can get, for example, 20 samples 0-day or almost-0-day from Malware HUB and check in March 2020 it will be great. We will publish SHA256 from MHUB, so our readers will check protection in the table with malware summaries.
We will try to cooperate with MHUB this month.This is why it's important to understand what the test is trying to accomplish and try to look at the bigger picture. Every test has their pros and cons, comparing this test to the HUB is a great example. Each test focuses on different things, but this test highlights what other components can potentially add to the overall protection, something the HUB doesn't capture. The HUB however focuses on zero day malware, something that we cannot verify with other tests because they didn't provide us with the info to verify the samples, with the exception of this test. I really wish that the other professional tests would follow this example of how to provide us with the checksums, but they won't unfortunately. Their explanations are just weak excuses because this test shows that it actually can be done.