Reply to thread

Message

<blockquote data-quote="Andy Ful" data-source="post: 1112408" data-attributes="member: 32260">Those tests are considered the most reliable among professional tests. But, their results are often misunderstood. For example, people mainly ignore the information included in the testing methodology:[URL unfurl=&quot;false&quot;]https://www.av-comparatives.org/real-world-protection-test-methodology/[/URL]Here is an example from a recent test:[ATTACH=full]286805[/ATTACH]According to the testing methodology, when the test includes about 500 samples, the first 9 AVs can have similar detection in the wild because they are placed in the same cluster (cluster nr 1). Eset still had a fair chance to be the best in the wild during the testing period, even if it missed 4 samples in that particular test. The same is true for any AV in that cluster. Most posts in the threads about testing results are related to the illusion that these results are real in the wild. Many more samples are needed to see the real differences.From my experience, the cumulative results of AV-Comparatives, AV-Test, and SE Labs over two years (over 7000 samples) are required to show the differences in the protection of the top solutions.</blockquote>

[QUOTE="Andy Ful, post: 1112408, member: 32260"] Those tests are considered the most reliable among professional tests. But, their results are often misunderstood. For example, people mainly ignore the information included in the testing methodology: [URL unfurl="false"]https://www.av-comparatives.org/real-world-protection-test-methodology/[/URL] Here is an example from a recent test: [ATTACH type="full" alt="1735040706268.png"]286805[/ATTACH] According to the testing methodology, when the test includes about 500 samples, the first 9 AVs can have similar detection in the wild because they are placed in the same cluster (cluster nr 1). Eset still had a fair chance to be the best in the wild during the testing period, even if it missed 4 samples in that particular test. The same is true for any AV in that cluster. Most posts in the threads about testing results are related to the illusion that these results are real in the wild. Many more samples are needed to see the real differences. From my experience, the cumulative results of AV-Comparatives, AV-Test, and SE Labs over two years (over 7000 samples) are required to show the differences in the protection of the top solutions. [/QUOTE]

Verification