Forums
New posts
Search forums
News
Security News
Technology News
Giveaways
Giveaways, Promotions and Contests
Discounts & Deals
Reviews
Users Reviews
Video Reviews
Support
Windows Malware Removal Help & Support
Inactive Support Threads
Mac Malware Removal Help & Support
Mobile Malware Removal Help & Support
Blog
Log in
Register
What's new
Search
Search titles only
By:
Search titles only
By:
Reply to thread
Menu
Install the app
Install
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Forums
Security
General Security Discussions
Why I think testing "labs" are useless
Message
<blockquote data-quote="Andy Ful" data-source="post: 884492" data-attributes="member: 32260"><p>The below is probably true:</p><ol> <li data-xf-list-type="ol">All AV vendors were/are/will be cheating in some way.</li> <li data-xf-list-type="ol">There were/are/will be many tests impaired by money.</li> <li data-xf-list-type="ol">Differences between many AVs in a single test are a simple illusion (due to big statistical errors).</li> <li data-xf-list-type="ol">Most people misunderstand the test results and compare the tests which cannot be directly compared.</li> </ol><p>So, are the tests useless?</p><p></p><p>Yes - for most people.</p><p>No - for some people and AV vendors.</p><p></p><p>Generally, the tests are not useless as an average of many (comparable) tests. If one takes the average then the first two points are unimportant (the vendors cannot cheat and pay all the time). The third point is not valid, because the statistical errors get smaller if the number of tests increases.<img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite130" alt="(y)" title="Thumbs up (y)" loading="lazy" data-shortname="(y)" /></p></blockquote><p></p>
[QUOTE="Andy Ful, post: 884492, member: 32260"] The below is probably true: [LIST=1] [*]All AV vendors were/are/will be cheating in some way. [*]There were/are/will be many tests impaired by money. [*]Differences between many AVs in a single test are a simple illusion (due to big statistical errors). [*]Most people misunderstand the test results and compare the tests which cannot be directly compared. [/LIST] So, are the tests useless? Yes - for most people. No - for some people and AV vendors. Generally, the tests are not useless as an average of many (comparable) tests. If one takes the average then the first two points are unimportant (the vendors cannot cheat and pay all the time). The third point is not valid, because the statistical errors get smaller if the number of tests increases.(y) [/QUOTE]
Insert quotes…
Verification
Post reply
Top