MalwareTips AV Test [March 2017]

Discussion in 'Community Announcements' started by BoraMurdar, Apr 19, 2017.

  1. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,521
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    #1 BoraMurdar, Apr 19, 2017
    Last edited by a moderator: Apr 19, 2017
    Hello, guys and gals. I am proud to introduce you with the new MalwareTips AV Test , conducted from March 1. to March 31. 2017. A lot of things has been improved starting from the testing procedures, evaluations of the new criteria, scoring and at last creation and presentation of the results. I truly hope you will like it, as a lot of time and sweat was invested by our AV Testers, and I will use this moment to thank all of them for their awesomeness! Further improvements will come in the upcoming tests. Enjoy :)



    During the period from March 1. to March 31. we tested 7 security products against the malware packs posted in our Malware Hub Forum. You will find each product's report in its dedicated subforum, or following the links bellow:
    ____________________________________________________________________________
    MalwareTips AV Test – March 2017 – Avast Free Antivirus
    MalwareTips AV Test – March 2017 – AVG Internet Security
    MalwareTips AV Test – March 2017 – Bitdefender Free Antivirus
    MalwareTips AV Test – March 2017 – ESET Smart Security
    MalwareTips AV Test – March 2017 – Kaspersky Total Security
    MalwareTips AV Test – March 2017 – Norton Security
    MalwareTips AV Test – March 2017 – Windows Defender + Immunet Free

    ______________________________________________________________________________

    COMPARATIVE RESULTS - March 2017

    [​IMG]
    [​IMG]


    PDF
     
  2. harlan4096

    harlan4096 Moderator
    Staff Member AV Tester

    Apr 28, 2015
    2,632
    20,719
    Almería (Spain)
    Windows 10
    Kaspersky
    Really great work! thank You very much @BoraMurdar!
     
  3. Winter Soldier

    Winter Soldier Level 25

    Feb 13, 2017
    1,466
    10,344
    PLC programmer - Robotics industry
    Wormhole
    Windows 10
    Emsisoft
    Thank you @BoraMurdar and Malware Hub Testers for this awesome work! ;)
     
  4. frogboy

    frogboy Level 61
    Trusted

    Jun 9, 2013
    6,228
    64,823
    Heavy Duty Mechanic.
    Western Australia
    Windows 10
    Emsisoft
    Well done @harlan4096 you and Kaspersky are the clear winners. ;) And thank you @BoraMurdar for compiling the AV Tests this way. ;)
     
  5. Brodyaga

    Brodyaga Level 22
    Trusted AV Tester

    Aug 25, 2014
    1,109
    10,030
    Engineer
    Dnepropetrovsk
    Windows 10
    Microsoft
    Thanks for @BoraMurdar summarizing the results and all the testers for the work done!
     
  6. Hanmin147

    Hanmin147 Level 28

    Jul 28, 2014
    1,786
    7,607
    Windows 10
    Avast
    Awesome initiative being done here! But I think the results are a little skewed due to the methodology.

    The most obvious ones are the Avast and AVG tests, being under the same company, both AVs use essentially the same technology to detect malware, they also share the same signatures, so there should be no reason that one scores better than the other.

    The reason for this is due to the different test done with the AVs, AVG might have tested pack 1, 2 and 3 while Avast with pack 1, 4 and 6, therefore leading to different detection ratios.

    Of course there is no exact way to fix this because the testers are all helpful volunteers from the forum and not paid companies like AV comparatives and such.

    Just my constructive criticism for the site :)
     
  7. harlan4096

    harlan4096 Moderator
    Staff Member AV Tester

    Apr 28, 2015
    2,632
    20,719
    Almería (Spain)
    Windows 10
    Kaspersky
    Thanks, but here there are no "winners", I like to test samples and help (in this case) sending unknown malwares to Kaspersky ;)
     
  8. In2an3_PpG

    In2an3_PpG Level 11

    Nov 15, 2016
    504
    8,339
    IT Jr. Network Admin
    United States
    Windows 10
    Default-Deny
    Really great job @BoraMurdar :)

    Thank you very much for putting the time into this.

    Thanks to all the Testers as well.
     
  9. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,521
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    AVG was mainly tested with their Internet Security and Avast by it's Free Antivirus version. Although now they share the same signatures you can see that detection beyond signatures can differ in a number of situations. Total detection ratio between those 2 doesn't differ too much ( Avast - 84,61% , AVG - 83,33%) that's only 128 points difference, but Avast at the end protected the system state in 70% of cases, and AVG a little beyond 80%, that's more than a 1000 points difference.
     
  10. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,521
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    The correction will be made, so sorry. Avast actually has 25461 points...
     
  11. Parsh

    Parsh Level 24
    Trusted AV Tester

    Dec 27, 2016
    1,328
    12,035
    7 Islands of Bombay
    Windows 10
    Default-Deny
    #11 Parsh, Apr 19, 2017
    Last edited: Apr 19, 2017
    Big thanks to all awesome testers at MH and sir Boramurdar for the report long awaited!
    Nice addition of stats we have here compared to previous reports :)

    Some results may be difficult to accept but this has to be one of the most practical tests done. No testing will be accurate, but they can be as insightful as possible, with varying dates of samples.

    I hope that we'll have more monthly reports plotting the performance and improvements of the AVs.
     
  12. Thirio

    Thirio Level 2

    Mar 3, 2017
    59
    187
    Canada
    Windows 10
    Comodo
    Avast was tested against 247 samples in 20 scenarios while AVG was tested against 330 samples in 26 scenarios. IMHO this is not the proper way to compare the two products. Because Avast was tested against fewer samples it will have a lower detection rate than AVG. In theory the two products should be identical with the exception of AVG missing the hardened mode feature in Avast.

    I get it though it's difficult to test two products at the same time under same circumstances. I enjoy these reports and hope to see improvement in the future. Thanks for doing this at least,keep it up and we won't need to look anywhere else for reports ;)
     
  13. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,521
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    Results updated!
     
  14. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,521
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    In theory, if they are tested at the exact same times, and if you test only the components which rely on signatures. I think the fuse of Avast and AVG will be completed in the next major Avast version.
     
  15. TerrakionSmash

    TerrakionSmash Level 16

    Nov 17, 2016
    751
    2,129
    Somewhere underwater or over water. I am water!
    Windows 10
    Microsoft
    Has these all been done manually?
     
    MWNu72, _CyberGhosT_, AtlBo and 6 others like this.
  16. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,521
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    What do you mean?
     
    MWNu72, AtlBo, raveed and 5 others like this.
  17. harlan4096

    harlan4096 Moderator
    Staff Member AV Tester

    Apr 28, 2015
    2,632
    20,719
    Almería (Spain)
    Windows 10
    Kaspersky
    #17 harlan4096, Apr 19, 2017
    Last edited: Apr 19, 2017
    I also would like to thank (among the AV Testers, in general) the Malware UpLoaders/Posters, for their hard working searching unknown malware...
     
    MWNu72, Fritz, HarborFront and 16 others like this.
  18. Elpibe

    Elpibe Level 3

    Sep 26, 2015
    107
    199
    Argentina
    Antivirus doesnt change the results according to the Windows version? Because i read a couple of months ago that 1 ex engineer of Mozilla and 1 engineer from Chrome said to "quit using 3rd companies antivirus", that windows defender was the best for Windows 8.x and 10
     
    MWNu72, HarborFront, AtlBo and 7 others like this.
  19. Hanmin147

    Hanmin147 Level 28

    Jul 28, 2014
    1,786
    7,607
    Windows 10
    Avast
    Ah yes thank you for the clarification, but the point is not all AVs are tested equally with the same samples, therefore the results might be a little different.
     
  20. Cats-4_Owners-2

    Cats-4_Owners-2 Level 37
    Trusted

    Dec 4, 2013
    2,659
    11,440
    Southern California (east of Los Angeles)
    Windows 10
    Kaspersky
    @Elpibe, Compatibility may be the more accurate term than 'best' in your concerns. Although I've not graduated to the level of malware tester (yet) my impressions testing through personal use is that Windows Defender continues to be a significantly compatible option which may have more to do with it's light integrated performance than it's detection/protection results. :)
     
    rockstarrocks, MWNu72, Fritz and 17 others like this.
Loading...
Similar Threads Forum Date
MalwareTips 2.0 Theme (Feedback and Testing for Members) Community Feedback Feb 23, 2016
thank you malwaretips community New Member Introductions Jan 5, 2018
dvnkt: Hello MalwareTips New Member Introductions Nov 24, 2017