I usually put the musics, though in some cases, especially in RPGs I also put background/ambient effects (for example if it's a forge you would hear the metal sounds, if it's the camp talk the fire sound from the campfire, etc).
I am not sure if always using the music could be repetitive. On the other hand, using the background effect could also make it seem a bit too silent
