HDMI High Definition audio device dissconects but will not reconnect.

I have a NVIDIA GeForce 210 Graphics card with a HDMI output going to my Toshiba big screen TV.

The graphics card has built in audio for the HDMI output. The problem I am having is when I have the TV on the HDMI source everything works (video/sound). When I change the TV source to something other then the HDMI source, the HDMI High Definition audio device in my sound properties is disconnected.

Now when I go back to the HDMI source on the TV the HDMI High Definition audio device in my sound properties will not reconnect to send sound over the HDMI anymore.

The only way I can get it to connect again to send sound, is if the TV source is set to HDMI, then I need to restart my PC. After it restarts the HDMI High Definition audio device is then connected and will send sound.

Then again if I change the TV source to something else besides HDMI the HDMI High Definition audio device in my sound properties is disconnected. I then have to repeat the steps above to get it going again.

Is this the way it should work, or am I missing an option that needs to be selected to let the HDMI High Definition audio device connect every time an HDMI source is selected?