Windows bitmap files can be used as icons. When the Change Icon... button is pressed from a Shortcut dialog, keep in mind that it is possible to Browse... for *.BMP files when showing all files in the Browse dialog.

It can only help to choose BMP files that equal or are directly proportional to 32x32 pixels.