To me, difficulty is more about knowing the right tactics. Watch some let's plays of piratez, to see if you can learn something.
At Jack Sparrow, every enemy gets an extra +20% armor, has more reactions, more TU and better accuracy. And there are a lot more enemies. Better start from a low difficulty and raise it if you don't feel challanged.