Microsoft-prevalence-based analysis of the File Detection Tests

[Petrovic]

Content source

https://www.facebook.com/AVComparatives/posts/10154502979120354

These reports are supplementary to AV-Comparatives’ main reports, already published, of the September 2013 and March 2014 File-Detection Tests. No additional testing has been performed; rather, the existing test results have been re-analysed from a different perspective, to consider what impact the missed samples are likely to have on customers, according to telemetry data of Microsoft. Of the prevalent samples used in the malware-detection test, some will pose a greater threat to the average user than others, as they are more widespread than others. Some may target e.g. a specific company or user base, but present less of risk to other users. Other malware samples may only be found on specific websites, affect specific countries/regions, or only be relevant to particular operating system versions or interface languages. This supplement uses global telemetry data (malware prevalence) provided by Microsoft to consider the customer impact posed by missed detections. That is, the malware files that antimalware products failed to detect are weighted based on malware-family prevalence, and each vendor’s prevalence-weighted results are reported along with the file-detection results in these reports. These results aim to give insight into the customer impact of the missed detections. In addition to global prevalence weighting impact, geo-location prevalence is also used to determine the customer impact of missed detections in specific countries for products tested. This is used to present the file-detection efficacy of antimalware products in the test against prevalent malware samples.

http://www.av-comparatives.info/wp-content/uploads/2014/08/avc_prevalence_201403_en.pdf

 

[FreddyFreeloader]

So, MSE is in the top 6 AVs, if you factor in customer impact, and not so much missed samples? Veeeerrrrryyyyy interesting.

 

[Deleted member 178]

that the whole point; why many test labs/youtube tests results are flawed. Who care of the samples found in remote part of the world or in some unknown chinese/russian websites that no ones cares to go.