Security News NSS Labs filed an antitrust suit against CrowdStrike, Symantec, ESET

amico81

Level 21
Thread author
Verified
Top Poster
Well-known
Jan 10, 2017
1,061
NSS Labs vs. CrowdStrike, Symantec, ESET and the Anti-Malware Testing Standards Organization - NSS Labs, Inc

Advancing Transparency and Accountability in the Cybersecurity Industry

On September 18, 2018, NSS Labs filed an antitrust suit against CrowdStrike, Symantec, ESET and the Anti-Malware Testing Standards Organization (AMTSO). You might be asking yourself, why?

NSS Labs’ mission is to advance transparency and accountability in the cybersecurity industry. We filed this suit because some vendors have not been living up to their responsibility to protect consumers and they know it, and they’re trying to prevent the public from knowing it too. If you are in the cybersecurity industry, it won’t surprise you to hear that vendors often know about their products’ deficiencies yet don’t reveal them to consumers. What should shock you is that they are actively conspiring to prevent independent testing that uncovers those product deficiencies to prevent consumers from finding out about them.

Keep in mind that these actions are not occurring in a vacuum. When a customer unknowingly relies on a flawed security product it can have serious consequences – from financial losses to physical safety. We filed this suit because we believe it’s important to bring the actions of some antivirus (AV) vendors to light and shine a spotlight on several bad behaviors in the cybersecurity industry. In short, some vendors have not been living up to their responsibility to protect consumers and they know it. Exposure to cyber risks is worsening daily and the implications are staggering. Given the pervasiveness of cyberattacks and the resulting impacts to our society, it is more critical than ever for cybersecurity products to do what they promise.

Just a few weeks ago, Kirstjen M. Nielsen, Secretary of Homeland Security stated that the breadth, scope and consequences of cyberattacks exceeds the risk of physical attacks and these attacks have moved past the epidemic stage and are now at a pandemic stage. The World Economic Forum estimates global losses due to cybercrime at US $0.5 Trillion in 2017 and these losses are projected to grow even more rapidly.

But what does this have to do with our lawsuit?

NSS Labs frequently uncovers product deficiencies during our independent tests. We tell customers about those deficiencies. As you can imagine, this can hurt a vendor’s sales. So, what is a vendor to do? Some (the good ones) fix their products. Others try to avoid being tested. But being the sole vendor refusing to be tested is bad for sales.…However, if a group of vendors agree ahead of time to boycott an independent test lab – say a lab they cannot get to do their bidding – then each is insulated from criticism by being one among many. You hopefully see where this is going.

The actions of the parties named in this suit were conducted by and through their participation in the Anti-Malware Testing Standards Organization (AMTSO), an organization that claims its purpose is to establish standards “for fair and useful testing.” What they neglect to tell you is that their version of “fair and useful” tests are driven by the same security vendors whose products are being tested; not a neutral, independent third-party setting a higher bar for the security vendors and the industry. They claim to try to improve testing but what they’re actually doing is actively preventing unbiased testing. Further, vendors are openly exerting control and collectively boycotting testing organizations that don’t comply with their AMTSO standards – even going so far as to block the independent purchase and testing of their products.

In addition, a number of vendors such as CrowdStrike have conspired to prevent testing of their products by placing clauses in their end user licensing agreements (EULA) that make testing of their products subject to their permission. This unethical and deceptive behavior hampers transparency and hinders consumers in their ability to assess whether a product delivers on its promises.

Out of necessity, consumers trust their security vendors to do right by them but in reality, they often have no way to know if they should. Which is why at NSS Labs we have a saying, “If it is good enough to sell, it is good enough to test.”

Many of you reading this have relied on NSS Labs tests and insights to guide your decisions. We strive to earn your trust every day and do not take your trust for granted. It is our hope that our actions today mark an important step forward in advancing transparency and accountability in the cybersecurity industry.

Thank you for your continued support.

Vikram Phatak, CEO of NSS Labs
 

amico81

Level 21
Thread author
Verified
Top Poster
Well-known
Jan 10, 2017
1,061
CrowdStrike and Malwarebytes slam NSS Labs AV report | CRN

NSS-Labs-chart.jpg
 
D

Deleted Member 3a5v73x

From the first glance it looks serious already by seeing ESET involved, I kinda trust those guys and their articles, but now? Need more information to judge. From what I see NSS Labs aren't entirely saying truth.. "illegal" client version of Crowdstrike.. tens of thousands for Malwarebytes to participate, even tho NSS denies that.. only Eset is neutral.. damn, I also really have mixed feelings about this statement. Not really sure who to trust at this point.
at NSS Labs we have a saying, “If it is good enough to sell, it is good enough to test.”
 
Last edited by a moderator:

shmu26

Level 85
Verified
Honorary Member
Top Poster
Content Creator
Well-known
Jul 3, 2015
8,153
Do they test consumer products, as well? Or only end-points and advanced network protection etc
 
5

509322

From the first glance it looks serious already by seeing ESET involved, I kinda trust those guys and their articles, but now? Need more information to judge. From what I see NSS Labs aren't entirely saying truth.. "illegal" client version of Crowdstrike.. tens of thousands for Malwarebytes to participate, even tho NSS denies that.. only Eset is neutral.. damn, I also really have mixed feelings about this statement. Not really sure who to trust at this point.

ESET is trustworthy.

Do they test consumer products, as well? Or only end-points and advanced network protection etc

NSS did have some consumer variant test results posted on its website, but I have not seen a consumer test from NSS in 3 or 4 years. From what is on their website, it appears that they don't do it any longer.

GO NSS ! GO ! Kick AMTSO !

Those test Labs are vendors' marketing proxies...

Think about it... these tests are marketing tools with potentially significant sums of money to be gained or lost from their results. But how influential are these tests - really ?

While that is true, look at Dr Web. They stopped participating years ago and, yet, they still survive. Dr Web has a staff of over 400, which means it has grown over the years since it stopped participating in lab tests. The same kinda-sorta can be said about GDATA, but not really, because it still participates in many tests... just not AV-Comparatives.

Would Dr Web be more well-known and bigger if participated in AV-Comparatives ?

This same rigmarole debate applies to the commissioned and non-commissioned tests from the enterprise-focused testing as well. I think the people at the enterprise level pick-and-choose security softs heavily based upon these test lab results. That way they can say... "Hey, we can't help that we got compromised... look... we used the soft that placed No. 1 in the lab tests... here look at these test results..."

So lab tests can also factor into liability-avoidance - which is something they were never intended to do.
 
Last edited by a moderator:

Burrito

Level 24
Verified
Top Poster
Well-known
May 16, 2018
1,363
In addition, a number of vendors such as CrowdStrike have conspired to prevent testing of their products by placing clauses in their end user licensing agreements (EULA) that make testing of their products subject to their permission. This unethical and deceptive behavior hampers transparency and hinders consumers in their ability to assess whether a product delivers on its promises.

Good for NSS.

Companies that place EULAs that try to restrict testing should be called out.
 
  • Like
Reactions: Al-Faqir
5

509322

Companies that place EULAs that try to restrict testing should be called out.

It won't change anything. Testing of security softs is not a right or entitlement.

The publisher will make sure that their product gets market exposure through carefully picked testing. (That is precisely has been happening forever despite the relatively recent "no testing" EULAs.)

It has been reported that only Crowdstrike prohibits or restricts testing in its product EULAs. People and organizations will still buy despite a EULA that says no testing.

And I think there is quite a bit of hypocrisy going around. People on the forums often state that AV test lab results are biased, manipulated, meaningless or even worthless... and now some of those same people are siding with NSS. The quality of the testing is not the issue. The hypocrisy is the issue.
 
Last edited by a moderator:

Burrito

Level 24
Verified
Top Poster
Well-known
May 16, 2018
1,363
  • Like
Reactions: Brie and Al-Faqir

About us

  • MalwareTips is a community-driven platform providing the latest information and resources on malware and cyber threats. Our team of experienced professionals and passionate volunteers work to keep the internet safe and secure. We provide accurate, up-to-date information and strive to build a strong and supportive community dedicated to cybersecurity.

User Menu

Follow us

Follow us on Facebook or Twitter to know first about the latest cybersecurity incidents and malware threats.

Top