Here's an inspiring list of tricks used by foley artists to create sound effects for film. These sound design ideas can be put to devious use by those making music too.
Put a nail end-to-end in-between your thumb and index-finger and then throw it as hard as you can past the mics. The nail spins and creates a good raw sound to start the design with. Then just apply your favorite effect to give it the bullet sense of speed you desire.
To help make cheap, low-noise recordings of this kind of thing you could try constructing something like this Porta-Booth.
