Well not necessarily, Armor +x% will make the weapon much worse at penetrating enemy armor, and the opposite if it's Armor -x%.
But otherwise Armor -x% doesn't actually make the weapon all that much better against already low armor targets (like a sectogre or something).
Not sure how many "almost ignore armor but don't actually do all that much damage" weapons exist in the game at the moment though. :-)