Man in the Zoo, theLady and the Fox by David Garnett
A classic duo from Garnett: after a quarrel with his lover, when she exclaims he should be kept in the zoo, John moves into a cage between an orang-utan and a chimpanzee, and becomes the zoo's star exhibit; and a Victorian vicar is aghast when his beloved new wife turns into a fox.