I discovered that NRFX_CLOCK_EVT_HFCLKAUDIO_STARTED is not handled in clock_event_handler in clock_control_nrf.c and will cause an ASSERT.