We can be forgiven for our sexual immorality, but to be forgiven does not undo the damage done by sexual immorality.  It takes years.  Thank God He does restore as you repent and turn away.