Yes and No, what is a real test?
to me , it is :
1- Take several average users
2- teach them the basis of how works the native security as you would give the driving license learning book to wannabe drivers
3- let them surf as they do at home.
4- sometimes send them some phishy emails with malicious links/samples.
5- observe the behaviors of the users and how respond the software. this is the most important point.
Security softwares always reacts after the user behavior.
That is real world test and no labs could ever produce it because it is lot of time and wasted resources. What youtesters/labs does is an extrapolation of this test , so it is inherently inaccurate by design. Average users won't encounter hundreds of samples in their life , and surely not 5 in less than 10mn...
Some labs are using methodolgies that seems more professional and neutral than others, on the test i provided you; if you read carefully, engineers evaluate the legitimacy of the samples used and adapt this volatility into the test.
But remember this test (as all tests) were made in an specific point in time. So just take it as information not as a forever rule because as you know things are always evolving.
I find funny some people bashing products by pointing tests months/years old...
Last edited by a moderator:
