I can understand removing any signature scanners. We did that in 02 and, except for alpha/beta testing for friends/devs, we haven't had any onboard since.
FPs and faulty removal routines can and often do cripple innocent components. I think it is sad that so many still periodically rip the guts out of their system while usually using multiple scanners and without even a clue to what items they are removing. Then these same folks wonder why their system and applications fail to function properly after they have been ripped apart by various scanners.
However, even if you don't maintain any sensitive material or transfer, I can't understand why you wouldn't want to maintain control of your environment. Personally, I could not tolerate looking at the net without all the filtering in place. yuk
I've removed every piece of security, because I trust myself to keep the machine safe, and I have the virus knowledge to removed any infections I receive.
I assume you still wear a seat belt in a car even if the driver has many years of driving experience and if he/she is driving slow and safe along the road?
So, Do you have any image backups made? Important data backed up on a USB or EXHDD? I also don't feel the need to run an AV or full security suite, have HIPS/BB's etc but still I take the precautions just "incase".
All my data is backed up on 2 separate TrueCrypt EXHDD's.
If I do happen to get infected (rare chance), It takes no more then 5 mins to do a system image restore and the infection is completely gone.