Sometimes we're just loyal to the wrong people