When the core is busy shutting down only uninstall the exception handler if fastmem is actually enabled. We only install when fastmem is enabled, so only uninstall when it is as well. Fixes a crash I was getting on ARMv7.