- May 26, 2014
- 1,339
Quoting Marcos from ESET:
Very poor test result
Below find my personal comments that may not represent an official response of the company on this test.
1, It's not a real world test and it appears that some protection layers were bypassed (e.g. web protection with more aggressive detection and url blocking), ie. the results might not reflect how ESET would protect users in real life. Also the question is if the missed sample was actual or synthetic threat. Since we didn't get missed samples for verification, we don't know how prevalent in the world they are.
2, A false positive test was not a part of the test. It's easy to detect 100% of malware if also clean files are detected.
3, The author works for Emsisoft. Despite the claims of being independent, it's hard to believe that this did not affect the test in any way. It's also interesting that Bitdefender got best results and Emsisoft uses its engine as well.
Employees of AV companies should not perform tests that they proclaim to be independent and unbiased. Only prestigious and respectful AV testing organizations should do that where independence is ensured. It would not be too difficult to make a test where an AV scoring 100% in other tests would get 0% if the "right" samples were picked in the test set.
4, "If a sample successfully makes it to memory and begins execution, it is considered a miss." This is a flawed methodology. A file has to be first unpacked in memory before it is executed. Advanced memory scanner triggers a scan only after a file has been executed and unpacked in memory.
I strongly recommend taking tests from youtube or performed by other than non-professional testers with a pinch of salt. One must consider and understand all aspects of how a test was performed in order to take the results seriously.
Very poor test result