Why is that when a song is paused at its beginning that sound is output when there should be silence?

The pause with sound function plays a dozen or so frames before the position at which the track is paused in a loop, so if you pause at the beginning of a track and there is sound directly before the end of the previous track, that sound may be produced.