AV Test MalwareTips Cumulative Report - November 2016

Discussion in 'General Security Discussions' started by BoraMurdar, Dec 15, 2016.

  1. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,503
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    All tests were conducted in protected virtual environment. Due to the small number of samples used in this tests, you should take results with a grain of salt. MalwareTips doesn’t encourage readers to take this test as a proof that tested security product is good or bad as security products are dynamically changing. This test shows how the tested product behaves with certain malware samples, on unique circumstances in given period of time.

    Product’s malware detection rate is not an equivalent of protection. This should not be mixed up. MalwareTips encourage you to compare these results with others and take informed decisions on what security products to use.

    Document-page-001 (1).jpg
    PDF

    All credits to our AV Testers Team

    Each security product's subforum will soon be updated with it's monthly report!

    Sky is the limit, stay tuned with MalwareTips ;)
     
    Pearl96, Parsh, vemn and 55 others like this.
  2. frogboy

    frogboy Level 61
    Trusted

    Jun 9, 2013
    6,228
    64,817
    Heavy Duty Mechanic.
    Western Australia
    Windows 10
    Emsisoft
    @BoraMurdar what a great idea for a new thread, this would be the most accurate of it's kind out there i would say. :)
     
    Dirk41, AtlBo, JM Security and 26 others like this.
  3. tonibalas

    tonibalas Level 38
    Trusted

    Sep 26, 2014
    2,795
    19,966
    An excellent idea for a monthly report:).
    Now any member or guest can see the performance of a security product;).
    I have to buy a new pc and find time to start testing myself.
     
  4. SHvFl

    SHvFl Level 32
    Content Creator Trusted

    Nov 19, 2014
    2,153
    16,406
    Supermodel for McDonald's
    Europe
    Windows 10
    Emsisoft
    This kind of report has issues. If not all test are done at the same date the static detection will vary a lot which will also break the dynamic stats for the program. So if a specific tester is a day late always or even a few hours it will affect the test a lot.
    It's an interesting metric but not so sure about it's accuracy.
     
    Parsh, AtlBo, Solarlynx and 20 others like this.
  5. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,503
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    It will be improved over time, that's why there is a disclaimer above ;)
     
    AtlBo, jamescv7, Solarlynx and 22 others like this.
  6. HarborFront

    HarborFront Level 34
    Content Creator

    Oct 9, 2016
    2,305
    5,768
    Far East
    Hi

    Is Comodo that good....I mean its AV or inclusive of its sandbox?

    Thanks
     
    Svoll, AtlBo, Solarlynx and 15 others like this.
  7. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,503
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    Be patient, Comodo's detailed report will be posted soon
     
    Svoll, AtlBo, Solarlynx and 15 others like this.
  8. SHvFl

    SHvFl Level 32
    Content Creator Trusted

    Nov 19, 2014
    2,153
    16,406
    Supermodel for McDonald's
    Europe
    Windows 10
    Emsisoft
    Yeah, i know that's why i said it's interesting.I for sure don't know how accurate it is and tbh none can say even if they checked all data times because you have no idea how signatures changed.
    Anw at least it's not paid test using samples that will make products look good. Maybe in the future you ignore all reports that are 12 hours after VT report or something like that(you might already have done it)?
     
    AtlBo, Svoll, DardiM and 15 others like this.
  9. Sundaram999

    Sundaram999 Level 5

    Jun 11, 2014
    249
    1,455
    AtlBo, Svoll, DardiM and 14 others like this.
  10. shmu26

    shmu26 Level 53

    Jul 3, 2015
    4,273
    13,595
    Utopia
    if you look at the details, you will see that COMODO's static detection rate is super low. It caught almost nothing. That's the AV for you...
     
    geminis3, AtlBo, Svoll and 15 others like this.
  11. tim one

    tim one Level 19
    Trusted AV Tester

    Jul 31, 2014
    904
    9,093
    Europe
    Windows 10
    Emsisoft
    Great explanation and contents, thank you @BoraMurdar! :)
     
    AtlBo, JM Security, Svoll and 17 others like this.
  12. BoraMurdar

    BoraMurdar Super Moderator
    Staff Member

    Aug 30, 2012
    5,784
    22,503
    Doctor of medicine
    Serbia
    Windows 10
    Emsisoft
    Comodo's static detection rate (signatures) are actually 0,98%, it will be fixed soon
     
    AtlBo, JM Security, Svoll and 18 others like this.
  13. shmu26

    shmu26 Level 53

    Jul 3, 2015
    4,273
    13,595
    Utopia
    Please add infected rate to the graph. That's what we really want to know.
     
    jelson, AtlBo, Svoll and 10 others like this.
  14. kev216

    kev216 Level 18
    Content Creator Trusted

    Aug 6, 2014
    897
    12,014
    Belgium
    Windows 10
    Sophos
    Really great idea for a thread! Looking forward to the next one. Thanks @BoraMurdar :)
     
    AtlBo, JM Security, Svoll and 16 others like this.
  15. davisd

    davisd Level 9

    Feb 2, 2016
    404
    4,594
    Latvia
    Windows 10
    Emsisoft
    If all run samples are malware, and Windows Defender's Total Detection Rate is 64.70% then system infection rate wouldn't be 35.30% at that point? But over 12 or 24 hours infection rate would lower i guess when AV signatures gets updated and it finds those infections?
     
    AtlBo, Svoll, venustus and 10 others like this.
  16. tim one

    tim one Level 19
    Trusted AV Tester

    Jul 31, 2014
    904
    9,093
    Europe
    Windows 10
    Emsisoft
    Please consider that some undetected malware may be corrupt, or dormant ( dynamic scan) because VM-aware.
    It is not simple.
     
    Parsh, AtlBo, JM Security and 17 others like this.
  17. shmu26

    shmu26 Level 53

    Jul 3, 2015
    4,273
    13,595
    Utopia
    I would add that there are native Windows security features that can stop the malware. For instance, it might fail to escalate privileges on a modern OS, but could succeed on Windows XP.
     
    AtlBo, Svoll, DardiM and 13 others like this.
  18. conceptualclarity

    Content Creator Trusted

    Aug 23, 2013
    844
    2,434
    USA
    ESET
    Very, very welcome. :D

    This should be a boost to Malware Tips' profile.

    Would really like to see not just the brand but the specific product(s) used listed in the chart, since with most of these brands there are three or more current products available.
     
    AtlBo, Solarlynx, Svoll and 16 others like this.
  19. tim one

    tim one Level 19
    Trusted AV Tester

    Jul 31, 2014
    904
    9,093
    Europe
    Windows 10
    Emsisoft
    The problem is our testing environment, the virtual machine.
    If a malware is not detected by the AV in testing because it has anti-vm routines, this malware is not producing processes in its execution because it goes into sleep mode.
    Now the AV does not detect the malware but not because of a lack, but because the malware is inert: no malware in the eyes of the AV.
    Perhaps the best solution would be Shadow Defender in this context.
    @BoraMurdar is totally right in saying to take the tests as a grain of salt.
     
    Parsh, AtlBo, JM Security and 18 others like this.
  20. shmu26

    shmu26 Level 53

    Jul 3, 2015
    4,273
    13,595
    Utopia
    that's the advantage of SD. The disadvantage is you can't do a reboot with the malware still present. I looks to me like some of our testers reboot and then run a scan, although you would know better than me.
     
    geminis3, AtlBo, Svoll and 10 others like this.
Loading...
Similar Threads Forum Date
thank you malwaretips community New Member Introductions Jan 5, 2018
dvnkt: Hello MalwareTips New Member Introductions Nov 24, 2017
Hello MalwareTips! Is Windows 10 tracking me? New Member Introductions Oct 3, 2017