Be able to change location to appointment after note has attached

Just like I can change the type of service even though a note has been matched I would like to also be able to update the place of service as well. I don't like that I have to unlink the note than go to calendar to change the place of service than rematch the note