Andy Ful
From Hard_Configurator Tools
Thread author
Verified
Honorary Member
Top Poster
Developer
Well-known
- Dec 23, 2014
- 8,329
Real-World tests include fresh web-originated samples.
Malware Protection tests include older samples (several days old) usually delivered via USB drives or network drives.
Real-World 2019-2020: SE Labs, AV-Comparatives, AV-Test (7659 samples in 24 tests)
-------------------Missed samples
Norton 360..................8
Trend Micro IS............13
F-Secure, Kaspersky...19
Avast, Microsoft.........37
Avira (Free, Pro).........46
McAfee (IS,TP)...........76
Malware Protection 2019-2020: AV-Test, AV-Comparatives (224173 samples in 16 tests)
-------------------Missed samples
Norton 360.............4
Microsoft.............. 25
F-Secure Safe........26
Kaspersky IS.........28
Avira (Free, Pro)....37
McAfee (IS,TP).....37
Avast Free............59
TrendMicro IS.......257
Why I used two years period?
The results of any single test made by SE Labs, AV-Test, or AV-Comparatives are useless for comparing AVs. In most cases, the statistical errors allow only saying that the group of 10 first AVs can be awarded. This follows from a too-small number of tested samples. I noticed that even the period of one year is not sufficient. For example:
Real-World: SE Labs, AV-Comparatives, AV-Test
--------------2019----2020------
Avast Free...............26..............11
Microsoft................12..............25
The one-year results are totally different, but the two-year results are the same.
On the other side, the AV protection is changing in time. So, it would not be reasonable to increase the period above two years.
Some thoughts about these results:
------------------- 2019----2020
AV-Comparatives.............0............257
AV-Test....................................0..............0
Norton got stellar protection results in any test, because it adopted in default settings a file reputation lookup (Norton Insight feature). This also caused the biggest false positives rate. Similar settings are available by tweaking Kaspersky (unknown ---> untrusted), Avast (Hardened Mode), or Microsoft Defender (ASR prevalence rule). In fact, a tweaked Kaspersky can apply stronger protection than a tweaked Norton.
Links to tests:
SE Labs
News Archive - AV-Comparatives (av-comparatives.org)
Home users (av-test.org)
Malware Protection tests include older samples (several days old) usually delivered via USB drives or network drives.
Real-World 2019-2020: SE Labs, AV-Comparatives, AV-Test (7659 samples in 24 tests)
-------------------Missed samples
Norton 360..................8
Trend Micro IS............13
F-Secure, Kaspersky...19
Avast, Microsoft.........37
Avira (Free, Pro).........46
McAfee (IS,TP)...........76
Malware Protection 2019-2020: AV-Test, AV-Comparatives (224173 samples in 16 tests)
-------------------Missed samples
Norton 360.............4
Microsoft.............. 25
F-Secure Safe........26
Kaspersky IS.........28
Avira (Free, Pro)....37
McAfee (IS,TP).....37
Avast Free............59
TrendMicro IS.......257
Why I used two years period?
The results of any single test made by SE Labs, AV-Test, or AV-Comparatives are useless for comparing AVs. In most cases, the statistical errors allow only saying that the group of 10 first AVs can be awarded. This follows from a too-small number of tested samples. I noticed that even the period of one year is not sufficient. For example:
Real-World: SE Labs, AV-Comparatives, AV-Test
--------------2019----2020------
Avast Free...............26..............11
Microsoft................12..............25
The one-year results are totally different, but the two-year results are the same.
On the other side, the AV protection is changing in time. So, it would not be reasonable to increase the period above two years.
Some thoughts about these results:
- The entries with the same color cannot be differentiated due to statistical errors.
- The differences between AVs are very small and they can hardly be noticed by the home user.
- In some cases, the differences can be leveled by tweaking the AV settings.
------------------- 2019----2020
AV-Comparatives.............0............257
AV-Test....................................0..............0
Norton got stellar protection results in any test, because it adopted in default settings a file reputation lookup (Norton Insight feature). This also caused the biggest false positives rate. Similar settings are available by tweaking Kaspersky (unknown ---> untrusted), Avast (Hardened Mode), or Microsoft Defender (ASR prevalence rule). In fact, a tweaked Kaspersky can apply stronger protection than a tweaked Norton.
Links to tests:
SE Labs
News Archive - AV-Comparatives (av-comparatives.org)
Home users (av-test.org)
Last edited: