It's common practice for people to take souvenirs, Americans did it all the time. And in real life a lot of the Americans that took German weapons like Lugers and P38s weren't already issued a sidearm, so that was their sidearm. Then there's the way in the German Army of WWII, only officers carried sidearms so for an American it was a way of saying they'd captured or killed someone important.