You can set an individual shipping cost per product in your online store using the Shipping freight feature. Enable this feature using the Free shipping and Shipping freights add-on.

A guide for this add-on is available here: Free Shipping and Shipping Freights Add-on.

You can find instructions for configuring and managing shipping freight for products in Managing Shipping Freight.