Forums
New posts
Search forums
News
Security News
Technology News
Giveaways
Giveaways, Promotions and Contests
Discounts & Deals
Reviews
Users Reviews
Video Reviews
Support
Windows Malware Removal Help & Support
Inactive Support Threads
Mac Malware Removal Help & Support
Mobile Malware Removal Help & Support
Blog
Log in
Register
What's new
Search
Search titles only
By:
Search titles only
By:
Reply to thread
Menu
Install the app
Install
JavaScript is disabled. For a better experience, please enable JavaScript in your browser before proceeding.
You are using an out of date browser. It may not display this or other websites correctly.
You should upgrade or use an
alternative browser
.
Forums
Security
General Security Discussions
Why I think testing "labs" are useless
Message
<blockquote data-quote="Burrito" data-source="post: 883447" data-attributes="member: 72439"><p>Testing and tests are great.</p><p></p><p>They are the official report card of capabilities.</p><p></p><p>Sure, there are challenges and limitations.</p><p></p><p>I've communicated with Andreas (AV-Comparatives) off-line and other lesser known testers -- they are really bright really smart people. And they do a great job of factoring in as many variables as possible for testing within certain constraints. </p><p></p><p>Certainly there are some limitations that I don't care for. Like the 'everybody gets a trophy' designed malware test sets where most AVs finish with detection rates close to 100%. But if certain AVs are shown at their real sucky level --- they most likely wouldn't ever be a paying customer. And again.... malware testing is not an easy business.</p><p></p><p>And ---- that some AVs are tested, but we never know it.... as they pay have their results NOT posted. That's sorta lame.</p><p></p><p>And other stuff... It's not perfect by any means.</p><p></p><p>And certainly testing has less meaning to us here at MT. Since many here use multiple capabilities and mitigations and don't run at default settings --- the results of testing don't reflect much in terms of how the average MT system would respond.</p><p></p><p>All that stated --- testing is great. It generally is reflective in a general sense of the baseline abilities and qualities of products.</p></blockquote><p></p>
[QUOTE="Burrito, post: 883447, member: 72439"] Testing and tests are great. They are the official report card of capabilities. Sure, there are challenges and limitations. I've communicated with Andreas (AV-Comparatives) off-line and other lesser known testers -- they are really bright really smart people. And they do a great job of factoring in as many variables as possible for testing within certain constraints. Certainly there are some limitations that I don't care for. Like the 'everybody gets a trophy' designed malware test sets where most AVs finish with detection rates close to 100%. But if certain AVs are shown at their real sucky level --- they most likely wouldn't ever be a paying customer. And again.... malware testing is not an easy business. And ---- that some AVs are tested, but we never know it.... as they pay have their results NOT posted. That's sorta lame. And other stuff... It's not perfect by any means. And certainly testing has less meaning to us here at MT. Since many here use multiple capabilities and mitigations and don't run at default settings --- the results of testing don't reflect much in terms of how the average MT system would respond. All that stated --- testing is great. It generally is reflective in a general sense of the baseline abilities and qualities of products. [/QUOTE]
Insert quotes…
Verification
Post reply
Top