Mouses or Mice?

We each needed a replacement mouse, so we bought two. But two what? What is the correct plural form? ‘Mouses’ offends the grammar pedant, and ‘Mice’ is just silly.
 
My mother used to enjoy a story about a man who wanted to place an order for poultry. But he couldn’t remember the plural form of ‘goose’, so he ordered ‘one goose, and another for my friend’.
 
There we are: one mouse for me and another for MountGrace.