It bothers me enough that I learned how to tighten a joint, peen a pin, and sand the pin down flush with the bolster. It's relatively easy to do, and now I never have to worry about wobbly blades again. I feel the same way about blades that aren't crinked quite properly, and now adjust them accordingly. These two meager skills, along with learning how to reset an edge bevel, go a long way toward creating exceptional vintage knives out of what would ordinarily be considered disappointing aftermarket purchases.
Just to clarify, I can live with a small amount of blade play. But what I consider to be wobble is entirely different. If I can feel the play during use, it's wobble. If play causes one blade to scratch against another while opening or closing, then it's wobble. If I shake the frame, with the blade(s) either open or closed, and can feel or hear the blade move, it's wobble.