After changes that don't involve a restart the Audiofuse isn't properly returned to snd-usb-audio. This means that it can't be used by alsa, pulseaudio, or jack. Disconnecting and reconnecting it fixes this, but is inconvenient.
Right now getting this working right is my main priority.