I never use them, but I probably should. Even when going with pistols as main weapons, I still prefer to have the other hand empty, so I can quickly equip knives, grenades etc.
But the main problem is, that enemies will often hit the side armour, even when standing straight ahead of your agents.