When we switched it to one badge per category, we weren't able to make it automatically delete the ones that were already awarded. Matt has to automatically go through and removed them from your profile page. Originally we had them all listed on the side bar, because it seemed like a good idea. But then we decided that for the sake of being less cluttered, we should only list the most recent in each category.