Yeah, Harry just wanted to steal everything and vanish. His primary concern was simply getting away without any witnesses, so they could ghost with the money they had stolen. He wasn’t going to bother with petty theft, and was content to stay on the down low if it meant they’d be safe from the law.

Marv was portrayed as being the dumb one, but he was outright sociopathic in his actions, and had zero qualms about blatantly harming others if it meant he’d get famous. His primary concern was with garnering infamy and making a name for themselves as thieves. He wanted everyone to know that the Wet Bandits had stolen from them. And that is diametrically opposed to Harry’s goal of ghosting after their big score.