Leave a little space between plans.

On a day with an HS appointment, you could leave some time free afterwards. You can decide what to do when you get home, depending on how you feel.