Men and women in their late teens and early 20s are struggling, but some are especially hard hit.