Products tested
The products that participated in this year's test are listed below. The manufacturers either provided
us with the latest version of their product, or confirmed that it was available from the Google Play
Store at the time of the test (July 2014). After the test, manufacturers had the opportunity to fix
any flaws we found. Any problems that have already been solved are noted in the report.
• AhnLab V3 Mobile 2.1.2.13
• avast! Mobile Security 3.0.7650
• Avira Antivirus Security 3.5.2983
• Baidu Mobile Manager 5.2.0
• Bitdefender Mobile Security 2.19.344
• CheetahMobile Clean Master 5.6.0
• CheetahMobile CM Security 1.6.1
• ESET Mobile Security 3.0.937.0-15
• F-Secure Mobile Security 9.2.15183
• G Data Internet Security 25.3.0
• IKARUS mobile.security 1.7.20
• Kaspersky Internet Security 11.4.4.232
• Kingsoft Mobile Security 3.3.1
• McAfee Mobile Security 4.1.0.543
• Quick Heal Total Security 2.00.021
• Qihoo 360 AntiVirus 1.0.0
• Sophos Security and Antivirus 3.5.1324
• Tencent Mobile Manager 4.8.2
• Trend Micro Mobile Security 5.0
• Webroot SecureAnywhere Mobile Complete 3.6.0.6610
Test Set
We collected the malware samples used in the test during the period of few months leading up to
the test. 3991 malicious applications were used to create a representative test set. So-called
"potentially unwanted apps" were not used in the test. The security products were updated and
tested on the 11 th July 2014.
The test was conducted with an active Internet connection on genuine Android smartphones (no
emulators were used). The test set consisted exclusively of .APK files. An on-demand scan was
conducted first. After this, every undetected app was installed manually. We did this to allow the
products to detect the malware using real-time protection.
We additionally conducted a false-positive test using the top 100 ad-free programs from the Google
Play Store. None of the products tested produced any false positives with these apps.
Protection rate results
1. AhnLab, G Data, Qihoo 100%
2. Avira, Bitdefender, McAfee, 99,9%
Cheetah Clean Master, Cheetah CM Security,
Kingsoft, Trend Micro
3. Avast 99,8%
4. ESET, Kaspersky Lab 99,7%
5. Quick Heal 99,5%
6. Ikarus 98,9%
7. Baidu, Sophos 98,8%
8. Webroot 97,4%
9. F-Secure 96,1%
10. Tencent 83,8%
http://www.av-comparatives.org/wp-content/uploads/2014/09/avc_mob_201407_en.pdf
The products that participated in this year's test are listed below. The manufacturers either provided
us with the latest version of their product, or confirmed that it was available from the Google Play
Store at the time of the test (July 2014). After the test, manufacturers had the opportunity to fix
any flaws we found. Any problems that have already been solved are noted in the report.
• AhnLab V3 Mobile 2.1.2.13
• avast! Mobile Security 3.0.7650
• Avira Antivirus Security 3.5.2983
• Baidu Mobile Manager 5.2.0
• Bitdefender Mobile Security 2.19.344
• CheetahMobile Clean Master 5.6.0
• CheetahMobile CM Security 1.6.1
• ESET Mobile Security 3.0.937.0-15
• F-Secure Mobile Security 9.2.15183
• G Data Internet Security 25.3.0
• IKARUS mobile.security 1.7.20
• Kaspersky Internet Security 11.4.4.232
• Kingsoft Mobile Security 3.3.1
• McAfee Mobile Security 4.1.0.543
• Quick Heal Total Security 2.00.021
• Qihoo 360 AntiVirus 1.0.0
• Sophos Security and Antivirus 3.5.1324
• Tencent Mobile Manager 4.8.2
• Trend Micro Mobile Security 5.0
• Webroot SecureAnywhere Mobile Complete 3.6.0.6610
Test Set
We collected the malware samples used in the test during the period of few months leading up to
the test. 3991 malicious applications were used to create a representative test set. So-called
"potentially unwanted apps" were not used in the test. The security products were updated and
tested on the 11 th July 2014.
The test was conducted with an active Internet connection on genuine Android smartphones (no
emulators were used). The test set consisted exclusively of .APK files. An on-demand scan was
conducted first. After this, every undetected app was installed manually. We did this to allow the
products to detect the malware using real-time protection.
We additionally conducted a false-positive test using the top 100 ad-free programs from the Google
Play Store. None of the products tested produced any false positives with these apps.
Protection rate results
1. AhnLab, G Data, Qihoo 100%
2. Avira, Bitdefender, McAfee, 99,9%
Cheetah Clean Master, Cheetah CM Security,
Kingsoft, Trend Micro
3. Avast 99,8%
4. ESET, Kaspersky Lab 99,7%
5. Quick Heal 99,5%
6. Ikarus 98,9%
7. Baidu, Sophos 98,8%
8. Webroot 97,4%
9. F-Secure 96,1%
10. Tencent 83,8%
http://www.av-comparatives.org/wp-content/uploads/2014/09/avc_mob_201407_en.pdf
