Reply to thread

Message

<blockquote data-quote="SeriousHoax" data-source="post: 1025963" data-attributes="member: 78686">Thanks for the test. Don&#039;t take it the wrong way but I have some serious doubts about the testing method and some more disclaimer would be nice like not all products scan file on write or on access by default, eg: Emsisoft.&nbsp;Firstly, what Andy pointed out is correct. MD&#039;s result here is not very accurate and won&#039;t match with a real world scenario in most cases. MD with only 18% pre-launch detection is absurd when a file is downloaded from the internet. Either it&#039;s fully due to MD&#039;s issue with Firefox or the issue was with the automated method that you used.Besides, you should try your best to fix your issue with Chrome. As much as we would like to see less monopoly, Chrome is still the most used browser on Windows so it&#039;s only fair to use Chrome to make the test more similar to a real-world scenario. Second choice would be Edge as it&#039;s the default browser and Firefox should be the third and last choice. Firefox is also third in market share in Windows behind Chrome and Edge I think, so it&#039;s a proper order IMO.Bitdefender&#039;s result is also very unusual. Are you sure something wrong didn&#039;t happen during the test? Bitdefender is always one of the best in every test, including Mitre Evaluation for Endpoint products. I have never seen it missing this many threats in any test as far as I can remember in recent years, specially when almost all other products got 100% which also includes your own previous tests. Even the not so good Webroot blocked 100%. I remember maybe in 2021/2020, MD had an issue in one of AV-Comparative&#039;s test where something wrong happened. It was a bug so in the end MD&#039;s result wasn&#039;t published. So it&#039;s not uncommon to have an odd bug either on the AVs&#039;s side or on the test&#039;s.Some popular vendors in the past even had issues with lab&#039;s testing method which was sorted out later among them. AMTSO standard is accepted by all. Don&#039;t know how it is for avlab.pl.Were all the AV vendors made aware of the test before or after it was done?Also, using free AV, Paid AV, Business AV all in the same test is not ideal. Do something about it if possible. But we certainly appreciate your desire to be more transparent than other testing labs.</blockquote>

[QUOTE="SeriousHoax, post: 1025963, member: 78686"] Thanks for the test. Don't take it the wrong way but I have some serious doubts about the testing method and some more disclaimer would be nice like not all products scan file on write or on access by default, eg: Emsisoft. Firstly, what Andy pointed out is correct. MD's result here is not very accurate and won't match with a real world scenario in most cases. MD with only 18% pre-launch detection is absurd when a file is downloaded from the internet. Either it's fully due to MD's issue with Firefox or the issue was with the automated method that you used. Besides, you should try your best to fix your issue with Chrome. As much as we would like to see less monopoly, Chrome is still the most used browser on Windows so it's only fair to use Chrome to make the test more similar to a real-world scenario. Second choice would be Edge as it's the default browser and Firefox should be the third and last choice. Firefox is also third in market share in Windows behind Chrome and Edge I think, so it's a proper order IMO. Bitdefender's result is also very unusual. Are you sure something wrong didn't happen during the test? Bitdefender is always one of the best in every test, including Mitre Evaluation for Endpoint products. I have never seen it missing this many threats in any test as far as I can remember in recent years, specially when almost all other products got 100% which also includes your own previous tests. Even the not so good Webroot blocked 100%. I remember maybe in 2021/2020, MD had an issue in one of AV-Comparative's test where something wrong happened. It was a bug so in the end MD's result wasn't published. So it's not uncommon to have an odd bug either on the AVs's side or on the test's. Some popular vendors in the past even had issues with lab's testing method which was sorted out later among them. AMTSO standard is accepted by all. Don't know how it is for avlab.pl. Were all the AV vendors made aware of the test before or after it was done? Also, using free AV, Paid AV, Business AV all in the same test is not ideal. Do something about it if possible. But we certainly appreciate your desire to be more transparent than other testing labs. [/QUOTE]

Verification