Answer: 

No. The scent and color will fade with age, but this does not affect the quality of the soap. In fact, the soap will last longer if allowed to age (dry and harden). The scent will return when the bar is wetted for use.