The difference is size.
USPS Priority Mail does not have a maximum weight limit, whereas USPS First Class does. If you want your package to be able to weigh more than 13 ounces (0.6 pounds) use USPS Priority Mail. In addition, priority mail shipment will typically arrive “Express”.