AV-Comparatives: Real-World Protection Test - October 2017

HarborFront

Level 72
Verified
Top Poster
Content Creator
Oct 9, 2016
6,158
I think that some people don't take a liking to some vendors doing better than their own preference, it has always been like this... Fact of the matter is that these testing companies pour so much work into testing professionally and conducting re-assessments prior to publishing the results. The results are based on fact... Product X detected X amount of samples, Product X blocked X amount of malicious links, Product X was light on resources or not under that testing environment, etc.

It doesn't mean a product is bad if it scores low and it doesn't mean a high scoring product always will score highly. It is just a test conducted by experienced people who are good with testing. Every vendor has good and bad days. Just because the results are factual doesn't mean they shouldn't be taken with a grain of salt and anyway these companies usually leave notes actually stating that 100% detection isn't always, just for their tests if it happens. We already know 100% of proper malware classification is impossible, the closest to that is blacklisted everything and allowing only the whitelisted (and then come file-less attacks from zero-day exploits from the web -> next big thing to overstepping the mark on that concept)

So also for what you said, I don't think it is weird that Tencent or VIPRE performed well in the test. Tomorrow? Maybe not so well. Its a hit and miss game with security software and malicious samples/website detection. :)
Agreed to what you say. Product quality and reliability in protection and performance will rise and fall through the years.

However, if the same product is being tested by the various labs and its standing is within the top 3 for the past 3 years then you can safely say the product has consistent quality and reliability in its protection and performance.

This is one of the ways to select a security product. Other ways will need to see the testing results at MT forums, read and get feedback from forums etc

:)
 
Last edited:

Nightwalker

Level 24
Verified
Honorary Member
Top Poster
Content Creator
Well-known
May 26, 2014
1,339
Thx @Nightwalker so it is safe to say that Microsoft, Avast-AVG and Bitdefender have the largest home user base in the AV-industry?

I think so, Avast-AVG is a behemot on par with Microsoft and Bitdefender engine is almost omnipresent (even uTorrent uses Bitdefender On-Access SDK).
 

mlnevese

Level 28
Verified
Top Poster
Well-known
May 3, 2015
1,761
The fact is that if you choose any of the big names out there you'll be well protected. There are occasional fluctuations from a single test to the next or previous one but that is just to be expected.

The grater problem is that all products have fanboys who will go for pages in any forum ranting about how testing A, B or C is flawed because their favorite product was not rated 100% protection and have no idea what a statistical fluctuation mean...

We see that a lot on the what's better threads where the team product A will start to bash product B and vice-versa, without even asking if the OP tried both products in his machine, which one caused less lag in day to day operations, which one he found easier to work with, etc. In the end, that's what will actually determine what is the best product for this person.

The same goes on the threads of Product X sucks because it didn't detect sample Y while product Z did... well did you try a dynamic test to see if the sample is blocked? Were you connected to the product cloud if it has one? Anyway even these questions mean nothing because product X may have received an update 5 minutes after you posted your thread and is now able to detect sample Y.

in other words there are some simple truths many people seem to be unable to grasp:

1) There is no 100% protection. No matter what product you use, there is something out there that will be able to pass it and infect you.
2) There is no 100% detection. There is always something unknown out there.
3) Unless you go hunting for the samples mentioned in itens 1 and 2, you're unlikely to be hit by them
4) Only you can say what is the better product for you. The real parameters you should be worried about are impact on our system and easy of use.
5) Safe habits are the most efficient away to avoid infection. Practice them. This applies to real life as well ;)
 

zzz00m

Level 6
Verified
Well-known
Jun 10, 2017
248
The fact is that if you choose any of the big names out there you'll be well protected. There are occasional fluctuations from a single test to the next or previous one but that is just to be expected.

The grater problem is that all products have fanboys who will go for pages in any forum ranting about how testing A, B or C is flawed because their favorite product was not rated 100% protection and have no idea what a statistical fluctuation mean...

We see that a lot on the what's better threads where the team product A will start to bash product B and vice-versa, without even asking if the OP tried both products in his machine, which one caused less lag in day to day operations, which one he found easier to work with, etc. In the end, that's what will actually determine what is the best product for this person.

The same goes on the threads of Product X sucks because it didn't detect sample Y while product Z did... well did you try a dynamic test to see if the sample is blocked? Were you connected to the product cloud if it has one? Anyway even these questions mean nothing because product X may have received an update 5 minutes after you posted your thread and is now able to detect sample Y.

in other words there are some simple truths many people seem to be unable to grasp:

1) There is no 100% protection. No matter what product you use, there is something out there that will be able to pass it and infect you.
2) There is no 100% detection. There is always something unknown out there.
3) Unless you go hunting for the samples mentioned in itens 1 and 2, you're unlikely to be hit by them
4) Only you can say what is the better product for you. The real parameters you should be worried about are impact on our system and easy of use.
5) Safe habits are the most efficient away to avoid infection. Practice them. This applies to real life as well ;)

And the bottom line here is that only taking regular image backups can save you in the long run. Use your anti malware software to keep your system clean, and alert you to an attack. Then wipe and restore with your most recent clean image! (y)
 
  • Like
Reactions: mlnevese

About us

  • MalwareTips is a community-driven platform providing the latest information and resources on malware and cyber threats. Our team of experienced professionals and passionate volunteers work to keep the internet safe and secure. We provide accurate, up-to-date information and strive to build a strong and supportive community dedicated to cybersecurity.

User Menu

Follow us

Follow us on Facebook or Twitter to know first about the latest cybersecurity incidents and malware threats.

Top