Stoddard Solvent, sold as either 'Odorless Paint Thinner,' 'White Spirits,' or 'Mineral Spirits," or as part of the WD-40 compound will clean it off perfectly. The WD-40 will also leave a lot of mineral oil, which is not really the best thing on a leather strop. If you have some Coleman fuel, that will really strip off everything, too, without leaving much as residue. Lighter fluid (naphtha) is another great solvent useful for cleaning strops. But nothing will beat plain old Stoddard Solvent. After cleaning, I'd rub the strop down with a couple of dabs of shoe cream just to revitalize the leather, but truth be told, you probably would never notice if it's been done or not.
Stitchawl