It gets even more annoying when you equip items that could go in two different slots... for example the Slavers craft able items. Those items have a primary slot, but if you equip it in the secondary and switch it, when you equip it back it will go into the primary, not the slot you had...