A difference of scale. A jail is generally a smaller local detainment facility, usually physically a part of a local police station. A prison is a purpose built facility for a large number of prisoners for an extended period.
That's the word meanings anyway. There may be further differences at the mission level that I'm unaware of.