Make your video test requests!

[danb]

Hey Shadowra, I had an idea for a new test. While I was tweaking Sirius recently, I was cross-checking a lot of its verdicts with VirusTotal, and I noticed that the results from the various engines were surprisingly inconsistent.

I completely understand that VirusTotal results do not necessarily reflect an engine's full protection capabilities, but it made me wonder just how reliable these results are when comparing different engines.

Has anyone ever performed a study comparing the accuracy of the different engines on VirusTotal, including both malware detections and false positives?

If not, and you think this would be a worthwhile test, it would be great if you could give it a shot when you get a chance, and possibly include the Sirius verdicts as well. I'm planning to run a similar test myself soon.

Thank you!

 

[danb]

Hey Shadowra, I ran a test of 25 samples, and there is a super fast way to do this.

1) Download malware samples
2) Analyze the files with Sirius
3) Click the Hash in the Sirius results to view the VirusTotal results
4) Use the SingleFile Chrome extension to download the VirusTotal results
5) Once I was finished testing, I just copied the Sirius results from our database to an excel spreadsheet. This is the only tricky part for you, but if you want me to lookup the results and send them to you when you are finished testing, just let me know.
6) Then I uploaded the spreadsheet and the SingleFile VirusTotal results to ChatGPT and had it sort everything out and create the report

You can use a prompt similar to this:
I just performed a malware study with VirusTotal and Sirius, they are listed in the Study spreadsheet. Can you please parse all of the VirusTotal reports and make a list of all of the vendors, including Sirius, and show the total results and make a nice little one page report out of it that I can post on MalwareTips?

Then ChatGPT sent me the final results! The whole process only took me about 40 minutes. I will probably run more tests like this, but I do not have a VirusTotal account, so it started to block me towards the end of the test.

 

[Dreams&Visions]

Release of AppCheck Anti Ransom test?
What are the next vids to come?

 

[Shadowra]

Release of AppCheck Anti Ransom test?
What are the next vids to come?

next : Trend Micro
I still have a few videos to share between now and December because I'd like to launch a big project by the end of the year! (I'll start a thread)

But I'll make a note of your request, as well as the one from @danb !

@Cosmic1764 & @NovaFang : Okay !

NB : I'm going to try to post as many videos as possible over the next few days—I have a ton in the pipeline, so don't be surprised (Just so you know, I'm taking a personal weekend off from November 20 to November 24; I'll be at the Miku Expo.)