Should you wash your clothes after each time you wear them?

I feel like its pointless to wash what I just wore after I ware it. I have alot of cloths, so I always ware something different everyday. I probably wont ware the same t-shirt after a months or weeks. I also don't really get active when I'm wearing my cloths ( I ware a wife-beater (tank top) under my shirts, so if i do sweat I sweat on the tank top and clean that instead of the T-shirt) Is really a need to clean your cloths every time you wear it unless you do something active that would cause it too be dirty? I mean wouldn't washing your cloths after every ware ruin them?