Will a newly installed water softener eventually dissolve old mineral deposits in my plumbing?

I am hoping that putting in a softener will start to dissolve away deposits that might be inside my water heater and other plumbing from years of hard water.