Reply to thread

Message

<blockquote data-quote="Andy Ful" data-source="post: 1102276" data-attributes="member: 32260">I should probably explain why I cannot treat the video from this thread as a real-world test. Simply, the leading AV testing labs use this term for &quot;0-day malware attacks, inclusive of web and e-mail threats&quot;. It is interesting how AV testing labs choose the representative samples. For example, AV-Test registers over 450000 new malware per day and only a small part of registered samples are used in the test.[URL unfurl=&quot;false&quot;]https://www.av-test.org/en/statistics/malware/[/URL]Here is a fragment of AV-Comparatives testing methodology related to finding new threats for real-world tests:Another fragment related to the statistical analysis of results:[URL unfurl=&quot;false&quot;]https://www.av-comparatives.org/real-world-protection-test-methodology/[/URL]For example in the latest test, 13 AVs belong to the same cluster so they must be treated as equally effective, even though some of them detected all tested samples and some others missed 4 samples. The statistical model AV-Comparatives used, says that the differences in missed samples are not real. Those differences can appear with high probability as artifacts of the testing methodology.[ATTACH=full]285539[/ATTACH][URL unfurl=&quot;false&quot;]https://www.av-comparatives.org/tests/real-world-protection-test-february-may-2024/[/URL]Please forgive me if this post is off-topic, but most readers usually do not realize such important details.</blockquote>

[QUOTE="Andy Ful, post: 1102276, member: 32260"] I should probably explain why I cannot treat the video from this thread as a real-world test. Simply, the leading AV testing labs use this term for "[B]0-day malware attacks, inclusive of web and e-mail threats". [/B] It is interesting how AV testing labs choose the representative samples. For example, AV-Test registers over 450000 new malware per day and only a small part of registered samples are used in the test. [URL unfurl="false"]https://www.av-test.org/en/statistics/malware/[/URL] Here is a fragment of AV-Comparatives testing methodology related to finding new threats for [B][COLOR=rgb(184, 49, 47)]real-world[/COLOR][/B] tests: Another fragment related to the statistical analysis of results: [URL unfurl="false"]https://www.av-comparatives.org/real-world-protection-test-methodology/[/URL] For example in the latest test, 13 AVs belong to the same cluster so they must be treated as equally effective, even though some of them detected all tested samples and some others missed 4 samples. The statistical model AV-Comparatives used, says that the differences in missed samples are not real. Those differences can appear with high probability as artifacts of the testing methodology. [ATTACH type="full" width="797px" alt="1726786297362.png"]285539[/ATTACH] [URL unfurl="false"]https://www.av-comparatives.org/tests/real-world-protection-test-february-may-2024/[/URL] Please forgive me if this post is off-topic, but most readers usually do not realize such important details. [/QUOTE]

Verification