AV-TEST [CheckLab.pl] Anti-virus test report - July 2019

[Evjl's Rain]

Hello Everybody.

Some people on this forum know me as a CEO at www.AVLab.pl. Today I would like to present you our new brand it known as CheckLab. The website is available at domain CheckLab :: Professional Testing Service

The CheckLab organization was founded in July 2019 by the AVLab.pl company. The primary objective of the CheckLab organization is to test security usefulness, and issuing certificates confirming the protection effectiveness against malware, and also provide results to public information while ensuring the maximum transparency of the tests. There is so much additional information related to tests so we have decided to prepare a supporting website.

You can read more how we carry out the tests and the making of CheckLab, a website dedicated to security tests at Publications | CheckLab :: Professional Testing Service

Description about whole methodology and used tools: Methodology | CheckLab :: Professional Testing Service

The tests lasted the whole July 2019 and were based on testing security of the following software:

• AVIRA Antivirus Pro
• EMSISOFT Business Security
• F-SECURE Total
• G DATA Endpoint Protection Business
• G DATA Total Security
• KASPERSKY Endpoint Security Cloud Protection
• SECUREAPLUS Premium
• The eighth product was not included in the official results.

We present the newest results for tested antivirus products in July 2019: Recent results | CheckLab :: Professional Testing Service

Recent results

checklab.pl

 

[The Cog in the Machine]

The eighth product is Zonealarm, I guess

 

[Burrito]

Their methodology sounds pretty good.

But it's hard to make money in security software testing.

Hopefully they make it.

The eighth product is Zonealarm, I guess

Probably a good guess. And I hate the way the system works... vendors can pay to not publish test results.

 

[Evjl's Rain]

they mention Comodo internet security and Webroot in their description of methodology (point 6.)

Step 3: Methods of carrying out automatic tests

The latest update for the following methods was introduced in January 2019. In comparative tests all products are evaluated in the same working environment. An operating system, additional tools, and installed software must be unchangeable. Currently, there are no such products which by way of...

checklab.pl

I guess Webroot is the 8th product -> It seems right to me

in other notes, they also mention avast, bitdefender, windows defender,...

 

[Solarquest]

I like they share SHA of malware tested.
E.g. 29244590a5360c7f77f60b3dc2b68dd4072022c9e3240c04c30f7b890606dac5

VirusTotal

VirusTotal

www.virustotal.com

That still has only 20 detections on VT..

 

[Adrian Ścibor]

I like they share SHA of malware tested.
E.g. 29244590a5360c7f77f60b3dc2b68dd4072022c9e3240c04c30f7b890606dac5

VirusTotal

VirusTotal

www.virustotal.com

That still has only 20 detections on VT..

Thank you that you are interested our tests. As for SHA's and VirusTotal, please read this article: The making of CheckLab.pl | CheckLab especially start from"

"VirusTotal is not suitable for giving an opinion on whether or not antivirus detects anything. We will try our best to prove this below."

We describe why results on Virus Total and security tests is often different.

 

[upnorth]

Business versions are normally much stronger and capable then " Home " versions as they tend to include more modules and features. Personal I'm not too fond with tests that mix these as it's an obvious risk the result will be interpreted as something it ain't. Compare business versions with business versions, or Home versions with Home versions IMO.

 

[Adrian Ścibor]

Business versions are normally much stronger and capable then " Home " versions as they tend to include more modules and features. Personal I'm not too fond with tests that mix these as it's an obvious risk the result will be interpreted as something it ain't. Compare business versions with business versions, or Home versions with Home versions IMO.

I understand your opinion. However, charting only for 2-3 business products would not be visually appealing. Maybe we will split it in the future, when our tests will be more popular. We have only one test for now. But thanks for opinion.

 

[woodrowbone]

Welcome to the forum Adrian, it´s always a good thing when you guys join the discussions clarifying things.

/W

 

[Adrian Ścibor]

Welcome to the forum Adrian, it´s always a good thing when you guys join the discussions clarifying things.

/W

No problem. I have 6-7 years experience in testing and I know this market in inside, therefore I can explain many issues.

But the most important for us is transparency. Once caught, a fraud organization will never be able to rebuild its reputation. That is why we try to show more things than any other testing organization.

I was even thinking about publishing our automation system code to testing on GitHub. It is written in NodeJS and Python. It is very simple to install. It's only require to have Linux and VMware with Windows 10. How it works you can see at two videos this article: The making of CheckLab.pl | CheckLab

1. First stage – sample verification. Testing application launches the analyzer: Sandbox. It is a normal operation system lacking in protection in which we check whether malware samples can move to the next stage (must be able to infect a system).

2. Second stage – antivirus testing. Testing application launches the analyzer: Testing. If a sample was malicious, it shall be subject to security testing with solutions for workstation protection installed.

I haven't decided yet to publish, because automation cost a lot of money. It is a very hard business decision.