What's the one where the guy finds out his wife is going to blind & drown him, so he plays along until he steps aside as she's about to push him in the river, and she goes in instead? Is that Eggs and Marrowbones?

In some versions of The Two Sisters, the older sister, who pushed the younger in, gets named by the harp (and, presumably, punished). In others, the miller gets executed for his role in the drowning.

Since the Bible has been cited, there's Chad Gadya in the Passover Hagadah, where The Holy One destroys the Angel of Death. I suppose there are other Passover & Chanukah songs that qualify as rejoicing in the punishment of evil.