Oil slick effect...
That happens because the oxide layer is of varying thickness. The colors come from interferance effects like those that lead to the irridesence of a peacock feather, a soap bubble, or yes, a sufficiently thin film of oil on water.
The thicker and more even the oxide the less it will occur (Because the layer is thick compared to the wavelenth of visible light), until the appearance is an even grey or blue. Given enough time, this will happen. Since the oxide layer isn't very durable, and not totally insoluble, it can thin out again, and the effect will return.
Roughing up the surface slightly as Bruise mentions will help eliminated the interference colors because the light isn't being reflected back from a smooth surface, so all colors get a chance to interfere an equal ammount, so no one color predominates.
If the mirror finish must be maintained, then the only way to prevent the irridesence is to build up a thick enough oxide layer, either through usage over time, or regular treatment with vinegar, citrus juice or the like.
Most everyone seems to agree that a patina produced over time through use looks better than one produced by short treatments with stronger oxidizing agents.