AV-Comparatives: Real-World Protection Test - October 2017

[HarborFront]

I think that some people don't take a liking to some vendors doing better than their own preference, it has always been like this... Fact of the matter is that these testing companies pour so much work into testing professionally and conducting re-assessments prior to publishing the results. The results are based on fact... Product X detected X amount of samples, Product X blocked X amount of malicious links, Product X was light on resources or not under that testing environment, etc.

It doesn't mean a product is bad if it scores low and it doesn't mean a high scoring product always will score highly. It is just a test conducted by experienced people who are good with testing. Every vendor has good and bad days. Just because the results are factual doesn't mean they shouldn't be taken with a grain of salt and anyway these companies usually leave notes actually stating that 100% detection isn't always, just for their tests if it happens. We already know 100% of proper malware classification is impossible, the closest to that is blacklisted everything and allowing only the whitelisted (and then come file-less attacks from zero-day exploits from the web -> next big thing to overstepping the mark on that concept)

So also for what you said, I don't think it is weird that Tencent or VIPRE performed well in the test. Tomorrow? Maybe not so well. Its a hit and miss game with security software and malicious samples/website detection.

Agreed to what you say. Product quality and reliability in protection and performance will rise and fall through the years.

However, if the same product is being tested by the various labs and its standing is within the top 3 for the past 3 years then you can safely say the product has consistent quality and reliability in its protection and performance.

This is one of the ways to select a security product. Other ways will need to see the testing results at MT forums, read and get feedback from forums etc

 

[Windows_Security]

I thought Vipre also uses Bitdefender definitions

 

[Nightwalker]

I thought Vipre also uses Bitdefender definitions

It does, Vipre is a full rebrand of Bitdefender (engine, cloud, behavior blocker) while G-Data, Emsisoft and F-Secure for example just use the engine (Bitdefender Core SDK).

 

[Windows_Security]

Thx @Nightwalker so it is safe to say that Microsoft, Avast-AVG and Bitdefender have the largest home user base in the AV-industry?

 

[Nightwalker]

Thx @Nightwalker so it is safe to say that Microsoft, Avast-AVG and Bitdefender have the largest home user base in the AV-industry?

I think so, Avast-AVG is a behemot on par with Microsoft and Bitdefender engine is almost omnipresent (even uTorrent uses Bitdefender On-Access SDK).

 

[mlnevese]

The fact is that if you choose any of the big names out there you'll be well protected. There are occasional fluctuations from a single test to the next or previous one but that is just to be expected.

The grater problem is that all products have fanboys who will go for pages in any forum ranting about how testing A, B or C is flawed because their favorite product was not rated 100% protection and have no idea what a statistical fluctuation mean...

We see that a lot on the what's better threads where the team product A will start to bash product B and vice-versa, without even asking if the OP tried both products in his machine, which one caused less lag in day to day operations, which one he found easier to work with, etc. In the end, that's what will actually determine what is the best product for this person.

The same goes on the threads of Product X sucks because it didn't detect sample Y while product Z did... well did you try a dynamic test to see if the sample is blocked? Were you connected to the product cloud if it has one? Anyway even these questions mean nothing because product X may have received an update 5 minutes after you posted your thread and is now able to detect sample Y.

in other words there are some simple truths many people seem to be unable to grasp:

1) There is no 100% protection. No matter what product you use, there is something out there that will be able to pass it and infect you.
2) There is no 100% detection. There is always something unknown out there.
3) Unless you go hunting for the samples mentioned in itens 1 and 2, you're unlikely to be hit by them
4) Only you can say what is the better product for you. The real parameters you should be worried about are impact on our system and easy of use.
5) Safe habits are the most efficient away to avoid infection. Practice them. This applies to real life as well

 

[zzz00m]

The fact is that if you choose any of the big names out there you'll be well protected. There are occasional fluctuations from a single test to the next or previous one but that is just to be expected.

The grater problem is that all products have fanboys who will go for pages in any forum ranting about how testing A, B or C is flawed because their favorite product was not rated 100% protection and have no idea what a statistical fluctuation mean...

We see that a lot on the what's better threads where the team product A will start to bash product B and vice-versa, without even asking if the OP tried both products in his machine, which one caused less lag in day to day operations, which one he found easier to work with, etc. In the end, that's what will actually determine what is the best product for this person.

The same goes on the threads of Product X sucks because it didn't detect sample Y while product Z did... well did you try a dynamic test to see if the sample is blocked? Were you connected to the product cloud if it has one? Anyway even these questions mean nothing because product X may have received an update 5 minutes after you posted your thread and is now able to detect sample Y.

in other words there are some simple truths many people seem to be unable to grasp:

1) There is no 100% protection. No matter what product you use, there is something out there that will be able to pass it and infect you.
2) There is no 100% detection. There is always something unknown out there.
3) Unless you go hunting for the samples mentioned in itens 1 and 2, you're unlikely to be hit by them
4) Only you can say what is the better product for you. The real parameters you should be worried about are impact on our system and easy of use.
5) Safe habits are the most efficient away to avoid infection. Practice them. This applies to real life as well

And the bottom line here is that only taking regular image backups can save you in the long run. Use your anti malware software to keep your system clean, and alert you to an attack. Then wipe and restore with your most recent clean image!