Filson and Carharrt do last, but they don't fit me very well.
My TNF stuff is mostly older, and still wearing well. Mountain Hardware and Arc'terex are good too.
The stuff I wear the most, every day, never an issue, is underwear. (Uniforms they give us for free). For shorts nothing beats Ex Officio; I have pairs that I've been wearing for over 5 years (3 deployments) and they still have no pilling, no tears, no saggy elastic. I've tried everything else; literally. I've thrown out UA, Polo, REI, and dozens more in that time (I buy to see if they can replace the EO stuff as the price is high).
Which brings me to my favorite bitch; why can't any other makers of high end T shirts realize the market for military colors. UA owns this nitch, and that means they sell 3-4 MILLION T shirts a year to those of us who need them. Issue stuff is crap; everybody buys good shirts. You'd think REI (at least) would catch on to this, but no. They already make the shirts, they just need to add the colors. How hard can that be?
For a good canvas pant, I find Kavu does good, but they use "natural" dies, so expect major fading the first couple washes. Prana does some nice stuff too, mostly for climbers and yoga folks, but very comfortable and wears well.