My old landlady used to drive her caught mice a mile down the road, just in case they came back again.

In a similar vein, if there's a particularly big scary house spider, I'll walk it a good distance from the house before letting it go.