Kernel Panic CPU7 failed to shut down @cpu_common.c:656

[brockb961]

I Purchased a new MacMini M2Pro about 6 weeks ago. After a few weeks, I started having system crashes like the one attached. I thought it would be a hardware problem, so I took it in to Apple and they ran their diags, found nothing, and completely reinstalled the OS. I then used system migration to reinstall my apps and data and turned off all of the login and background items to try to isolate any software issues. I had no crashes until yesterday, it then crashed last night. I attached the problem report.

I’m still not convinced that I don’t have a hardware issue as the panic cause given is always “CPU7 failed to shutdown”, but Apple wants to blame software. I would note that the mac is almost always sitting idle when it crashes. Where should I go next to deal with this?



panic(cpu 8 caller 0xfffffe001ff2aab8): CPU7 failed to shut down @cpu_common.c:656
Debugger message: panic
Memory ID: 0xff
OS release type: User
OS version: 22G74
Kernel version: Darwin Kernel Version 22.6.0: Wed Jul 5 22:21:53 PDT 2023; root:xnu-8796.141.3~6/RELEASE_ARM64_T6020
Fileset Kernelcache UUID: 372E97D731A4610CE851B87FE0C17455
Kernel UUID: 5157FA93-CB99-3EAF-9C18-BC4AA1F0BF22
Boot session UUID: F42BDCC4-72AE-4471-9339-BF4BE48444E3
iBoot version: iBoot-8422.141.2
secure boot?: YES
roots installed: 0
Paniclog version: 14
KernelCache slide: 0x00000000179a8000
KernelCache base: 0xfffffe001e9ac000
Kernel slide: 0x00000000179b0000
Kernel text base: 0xfffffe001e9b4000
Kernel text exec slide: 0x0000000018dac000
Kernel text exec base: 0xfffffe001fdb0000
mach_absolute_time: 0x4625fe5d88a
Epoch Time: sec usec
Boot : 0x64be8774 0x000cce88
Sleep : 0x00000000 0x00000000
Wake : 0x00000000 0x00000000
Calendar: 0x64c19807 0x000a018c

Zone info:
Zone map: 0xfffffe1000710000 - 0xfffffe3000710000
. VM : 0xfffffe1000710000 - 0xfffffe14cd3dc000
. RO : 0xfffffe14cd3dc000 - 0xfffffe1666d74000
. GEN0 : 0xfffffe1666d74000 - 0xfffffe1b33a40000
. GEN1 : 0xfffffe1b33a40000 - 0xfffffe200070c000
. GEN2 : 0xfffffe200070c000 - 0xfffffe24cd3d8000
. GEN3 : 0xfffffe24cd3d8000 - 0xfffffe299a0a4000
. DATA : 0xfffffe299a0a4000 - 0xfffffe3000710000
Metadata: 0xfffffe5f9771c000 - 0xfffffe5f9f71c000
Bitmaps : 0xfffffe5f9f71c000 - 0xfffffe5fa5484000
Extra : 0 - 0

TPIDRx_ELy = {1: 0xfffffe2999ff7000 0: 0x0000000000000008 0ro: 0x0000000000000000 }
CORE 0 PVH locks held: None
CORE 1 PVH locks held: None
CORE 2 PVH locks held: None
CORE 3 PVH locks held: None
CORE 4 PVH locks held: None
CORE 5 PVH locks held: None
CORE 6 PVH locks held: None
CORE 7 PVH locks held: None
CORE 8 PVH locks held: None
CORE 9 PVH locks held: None
CORE 0: PC=0xfffffe001fe3a364, LR=0xfffffe001fe3a364, FP=0xfffffe5fcb7dbef0
CORE 1: PC=0xfffffe001fe3a364, LR=0xfffffe001fe3a364, FP=0xfffffe5fccccfef0
CORE 2: PC=0xfffffe001fe3a364, LR=0xfffffe001fe3a364, FP=0xfffffe5fcb9afef0
CORE 3: PC=0xfffffe001fe3a364, LR=0xfffffe001fe3a364, FP=0xfffffe5fccc33ef0
CORE 4: PC=0xfffffe001ff36c28, LR=0xfffffe001fe3a370, FP=0xfffffe5fcd02fe80
CORE 5: PC=0xfffffe001fe3a364, LR=0xfffffe001fe3a364, FP=0xfffffe5fccdd7ef0
CORE 6: PC=0xfffffe001ff36c18, LR=0xfffffe001fe3a370, FP=0xfffffe5fcda77ef0
CORE 7: PC=0xfffffe001ff294a4, LR=0xfffffe001ff372bc, FP=0xfffffe5fcbeefe80
CORE 8 is the one that panicked. Check the full backtrace for details.
CORE 9: PC=0xfffffe001ff36c28, LR=0xfffffe001fe3a370, FP=0xfffffe5fccd47e80
ECC Corrections:41073
Compressor Info: 0% of compressed pages limit (OK) and 0% of segments limit (OK) with 0 swapfiles and OK swap space
Panicked task 0xfffffe2000678268: 0 pages, 530 threads: pid 0: kernel_task
Panicked thread: 0xfffffe2999ff7000, backtrace: 0xfffffe5fcd48f7f0, tid: 104
lr: 0xfffffe001fe03c14 fp: 0xfffffe5fcd48f870
lr: 0xfffffe001ff41ef0 fp: 0xfffffe5fcd48f890
lr: 0xfffffe001ff3379c fp: 0xfffffe5fcd48f900
lr: 0xfffffe001ff31fac fp: 0xfffffe5fcd48f9c0
lr: 0xfffffe001fdb7784 fp: 0xfffffe5fcd48f9d0
lr: 0xfffffe001fe03510 fp: 0xfffffe5fcd48fd80
lr: 0xfffffe0020568718 fp: 0xfffffe5fcd48fda0
lr: 0xfffffe001ff2aab8 fp: 0xfffffe5fcd48fdd0
lr: 0xfffffe001fe22bd4 fp: 0xfffffe5fcd48fe30
lr: 0xfffffe001fe3ac4c fp: 0xfffffe5fcd48fec0
lr: 0xfffffe001fe3a9d8 fp: 0xfffffe5fcd48ff20
lr: 0xfffffe001fdc0bd8 fp: 0x0000000000000000

last started kext at 411401085: com.apple.driver.AppleHIDKeyboard 231 (addr 0xfffffe001ed5e760, size 5204)
loaded kexts:
com.apple.driver.AppleTopCaseHIDEventDriver 6440.7
com.apple.filesystems.autofs 3.0
com.apple.driver.AppleHIDALSService 1
com.apple.UVCService 1
com.apple.driver.AppleAHCIPort 378
com.apple.driver.AppleBiometricServices 1
com.apple.driver.CoreKDL 1
com.apple.iokit.SCSITaskUserClient 482.120.2
com.apple.driver.AppleUSBMassStorageInterfaceNub 554
com.apple.driver.BCMWLANFirmware4388.Hashstore 1
com.apple.iokit.AppleBCM5701Ethernet 11.0.0
com.apple.driver.DiskImages.ReadWriteDiskImage 493.0.0
com.apple.driver.DiskImages.UDIFDiskImage 493.0.0
com.apple.driver.DiskImages.RAMBackingStore 493.0.0
com.apple.driver.DiskImages.FileBackingStore 493.0.0
com.apple.driver.AppleAOPVoiceTrigger 250.2
com.apple.driver.AppleThunderboltIP 4.0.3
com.apple.driver.AppleUSBDeviceNCM 5.0.0
com.apple.driver.AppleFileSystemDriver 3.0.1
com.apple.AppleFSCompression.AppleFSCompressionTypeZlib 1.0.0
com.apple.AppleFSCompression.AppleFSCompressionTypeDataless 1.0.0d1
com.apple.nke.l2tp 1.9
com.apple.filesystems.tmpfs 1
com.apple.filesystems.nfs 1
com.apple.filesystems.lifs 1
com.apple.filesystems.apfs 2142.140.9
com.apple.IOTextEncryptionFamily 1.0.0
com.apple.driver.SEPHibernation 1
com.apple.filesystems.hfs.kext 627.100.6
com.apple.security.BootPolicy 1
com.apple.BootCache 40
com.apple.driver.AppleSmartIO2 1
com.apple.driver.AppleSN012776Amp 640.8
com.apple.driver.ApplePMP 1
com.apple.driver.AppleCS42L84Audio 640.8
com.apple.driver.AppleTypeCRetimer 1.0.0
com.apple.AppleEmbeddedSimpleSPINORFlasher 1
com.apple.driver.AppleT6020CLPC 1
com.apple.driver.AppleT6020SOCTuner 1
com.apple.driver.AppleSmartBatteryManager 161.0.0
com.apple.driver.AudioDMAController-T602x 240.2
com.apple.driver.usb.AppleSynopsysUSB40XHCI 1
com.apple.driver.AppleSPMIPMU 1.0.1
com.apple.driver.AppleMobileDispT602X-DCP 140.0
com.apple.driver.AppleAVD 728.3.1
com.apple.AGXG14X 227.7.14
com.apple.driver.AppleProResHW 276.1.0
com.apple.driver.AppleJPEGDriver 5.4.0
com.apple.driver.AppleAVE2 670.13.2
com.apple.driver.AppleS5L8920XPWM 1.0.0d1
com.apple.driver.ApplePMPFirmware 1
com.apple.driver.AppleSamsungSerial 1.0.0d1
com.apple.driver.AppleSerialShim 1
com.apple.driver.AppleSPIMC 1
com.apple.driver.AppleS5L8960XNCO 1
com.apple.driver.AppleEventLogHandler 1
com.apple.driver.AppleT6020PMGR 1
com.apple.driver.AppleS8000AES 1
com.apple.driver.AppleS8000DWI 1.0.0d1
com.apple.driver.AppleInterruptControllerV2 1.0.0d1
com.apple.driver.AppleBluetoothModule 1
com.apple.driver.AppleBCMWLANBusInterfacePCIe 1
com.apple.driver.AppleT8110DART 1
com.apple.driver.AppleS5L8940XI2C 1.0.0d2
com.apple.driver.AppleT6020 1
com.apple.driver.AppleM68Buttons 1.0.0d1
com.apple.iokit.IOUserEthernet 1.0.1
com.apple.driver.usb.AppleUSBUserHCI 1
com.apple.iokit.IOKitRegistryCompatibility 1
com.apple.iokit.EndpointSecurity 1
com.apple.driver.AppleDiskImages2 198.100.13
com.apple.AppleSystemPolicy 2.0.0
com.apple.nke.applicationfirewall 404
com.apple.kec.InvalidateHmac 1
com.apple.kec.Compression 1
com.apple.kec.AppleEncryptedArchive 1
com.apple.driver.AppleHIDKeyboard 231
com.apple.driver.AppleMultitouchDriver 6440.7
com.apple.driver.AppleInputDeviceSupport 6460.1
com.apple.driver.AppleHSBluetoothDriver 6440.7
com.apple.driver.IOBluetoothHIDDriver 9.0.0
com.apple.iokit.IOAHCIBlockStorage 350.140.3
com.apple.driver.usb.IOUSBHostHIDDevice 1.2
com.apple.driver.usb.cdc.ncm 5.0.0
com.apple.driver.usb.cdc.ecm 5.0.0
com.apple.driver.usb.cdc.acm 5.0.0
com.apple.driver.usb.serial 6.0.0
com.apple.driver.driverkit.serial 6.0.0
com.apple.iokit.IOAHCIFamily 301.100.1
com.apple.iokit.IOAVBFamily 1140.6
com.apple.plugin.IOgPTPPlugin 1150.2
com.apple.driver.AppleMesaSEPDriver 100.99
com.apple.iokit.IOBiometricFamily 1
com.apple.driver.AppleThunderboltPCIUpAdapter 4.1.1
com.apple.driver.AppleThunderboltDPOutAdapter 8.5.1
com.apple.driver.usb.cdc 5.0.0
com.apple.driver.AppleUSBAudio 560.2
com.apple.iokit.IOAudioFamily 440.2
com.apple.vecLib.kext 1.2.0
com.apple.driver.AppleConvergedIPCOLYBTControl 1
com.apple.driver.AppleConvergedPCI 1
com.apple.driver.AppleBluetoothDebug 1
com.apple.driver.usb.AppleEmbeddedUSBXHCIPCI 1
com.apple.driver.usb.AppleUSBXHCIPCI 1.2
com.apple.driver.DiskImages.KernelBacked 493.0.0
com.apple.driver.AppleAOPAudio 240.5
com.apple.driver.AppleXsanScheme 3
com.apple.driver.usb.networking 5.0.0
com.apple.driver.AppleThunderboltUSBDownAdapter 1.0.4
com.apple.driver.AppleThunderboltPCIDownAdapter 4.1.1
com.apple.driver.AppleThunderboltDPInAdapter 8.5.1
com.apple.driver.AppleThunderboltDPAdapterFamily 8.5.1
com.apple.nke.ppp 1.9
com.apple.driver.AppleBSDKextStarter 3
com.apple.kext.triggers 1.0
com.apple.filesystems.hfs.encodings.kext 1
com.apple.driver.AppleSyntheticGameController 10.7.1
com.apple.driver.AppleDCPDPTXProxy 1.0.0
com.apple.driver.DCPDPFamilyProxy 1
com.apple.driver.AppleTrustedAccessory 1
com.apple.iokit.AppleSEPGenericTransfer 1
com.apple.driver.AppleSEPHDCPManager 1.0.1
com.apple.driver.AppleBTM 1.0.1
com.apple.driver.IOHIDPowerSource 1
com.apple.driver.AppleCallbackPowerSource 1
com.apple.driver.AppleDiagnosticDataAccessReadOnly 1.0.0
com.apple.driver.AppleCSEmbeddedAudio 640.8
com.apple.driver.AppleEmbeddedAudio 640.8
com.apple.iokit.AppleARMIISAudio 240.2
com.apple.driver.ApplePassthroughPPM 3.0
com.apple.driver.AppleSPU 1
com.apple.iokit.IONVMeFamily 2.1.0
com.apple.driver.AppleNANDConfigAccess 1.0.0
com.apple.driver.AppleSART 1
com.apple.driver.AppleStockholmControl 1.0.0
com.apple.driver.AppleUSBXDCIARM 1.0
com.apple.driver.AppleUSBXDCI 1.0
com.apple.iokit.IOUSBDeviceFamily 2.0.0
com.apple.driver.usb.AppleSynopsysUSBXHCI 1
com.apple.driver.usb.AppleUSBXHCI 1.2
com.apple.driver.AppleEmbeddedUSBHost 1
com.apple.driver.usb.AppleUSBHub 1.2
com.apple.driver.usb.AppleUSBHostCompositeDevice 1.2
com.apple.driver.AppleDialogPMU 1.0.1
com.apple.driver.AppleSPMI 1.0.1
com.apple.driver.AppleMCA2-T602x 740.3
com.apple.driver.AppleEmbeddedAudioLibs 240.1
com.apple.driver.DCPAVFamilyProxy 1
com.apple.iokit.IOMobileGraphicsFamily-DCP 343.0.0
com.apple.driver.AppleDCP 1
com.apple.driver.AppleFirmwareKit 1
com.apple.driver.AppleFirmwareUpdateKext 1
com.apple.iokit.IOMobileGraphicsFamily 343.0.0
com.apple.AGXFirmwareKextG14XRTBuddy 1
com.apple.AGXFirmwareKextRTBuddy64 227.7.14
com.apple.iokit.IOGPUFamily 65.60.1
com.apple.driver.AppleT8112TypeCPhy 1
com.apple.driver.AppleT8103TypeCPhy 1
com.apple.driver.AppleHPM 3.4.4
com.apple.driver.ApplePMGR 1
com.apple.driver.AppleARMWatchdogTimer 1
com.apple.driver.AppleDisplayCrossbar 1.0.0
com.apple.iokit.IODisplayPortFamily 1.0.0
com.apple.driver.AppleTypeCPhy 1
com.apple.driver.AppleBluetoothDebugService 1
com.apple.driver.AppleBCMWLANCore 1.0.0
com.apple.iokit.IO80211Family 1200.13.0
com.apple.driver.IOImageLoader 1.0.0
com.apple.driver.AppleOLYHAL 1
com.apple.driver.AppleThunderboltNHI 7.2.81
com.apple.driver.AppleT6000PCIeC 1
com.apple.iokit.IOThunderboltFamily 9.3.3
com.apple.driver.ApplePIODMA 1
com.apple.driver.AppleT602xPCIe 1
com.apple.driver.AppleGPIOICController 1.0.2
com.apple.driver.AppleFireStormErrorHandler 1
com.apple.driver.AppleMobileApNonce 1
com.apple.driver.AppleMultiFunctionManager 1
com.apple.driver.corecapture 1.0.4
com.apple.driver.AppleEmbeddedPCIE 1
com.apple.driver.usb.AppleUSBHostPacketFilter 1.0
com.apple.iokit.IOTimeSyncFamily 1150.2
com.apple.driver.DiskImages 493.0.0
com.apple.iokit.IOGraphicsFamily 597
com.apple.iokit.IOBluetoothSerialManager 9.0.0
com.apple.iokit.IOBluetoothHostControllerUSBTransport 9.0.0
com.apple.iokit.IOBluetoothHostControllerUARTTransport 9.0.0
com.apple.iokit.IOBluetoothHostControllerTransport 9.0.0
com.apple.driver.IOBluetoothHostControllerPCIeTransport 9.0.0
com.apple.iokit.IOBluetoothFamily 9.0.0
com.apple.iokit.CSRBluetoothHostControllerUSBTransport 9.0.0
com.apple.iokit.BroadcomBluetoothHostControllerUSBTransport 9.0.0
com.apple.driver.AppleSSE 1.0
com.apple.driver.AppleSEPKeyStore 2
com.apple.driver.AppleUSBTDM 554
com.apple.iokit.IOUSBMassStorageDriver 235.140.2
com.apple.iokit.IOPCIFamily 2.9
com.apple.iokit.IOSCSIBlockCommandsDevice 482.120.2
com.apple.iokit.IOSCSIArchitectureModelFamily 482.120.2
com.apple.driver.AppleRSMChannel 1
com.apple.iokit.IORSMFamily 1
com.apple.driver.AppleIPAppender 1.0
com.apple.driver.AppleFDEKeyStore 28.30
com.apple.driver.AppleEffaceableStorage 1.0
com.apple.driver.AppleCredentialManager 1.0
com.apple.driver.KernelRelayHost 1
com.apple.iokit.IOUSBHostFamily 1.2
com.apple.driver.AppleUSBHostMergeProperties 1.2
com.apple.driver.usb.AppleUSBCommon 1.0
com.apple.driver.AppleSMC 3.1.9
com.apple.driver.RTBuddy 1.0.0
com.apple.driver.AppleEmbeddedTempSensor 1.0.0
com.apple.driver.AppleARMPMU 1.0
com.apple.iokit.IOAccessoryManager 1.0.0
com.apple.driver.AppleOnboardSerial 1.0
com.apple.iokit.IOSkywalkFamily 1.0
com.apple.driver.mDNSOffloadUserClient 1.0.1b8
com.apple.iokit.IONetworkingFamily 3.4
com.apple.iokit.IOSerialFamily 11
com.apple.driver.AppleSEPManager 1.0.1
com.apple.driver.AppleA7IOP 1.0.2
com.apple.driver.IOSlaveProcessor 1
com.apple.driver.AppleBiometricSensor 2
com.apple.iokit.IOHIDFamily 2.0.0
com.apple.driver.AppleANELoadBalancer 6.602.2
com.apple.driver.AppleH11ANEInterface 6.602.1
com.apple.AUC 1.0
com.apple.iokit.IOAVFamily 1.0.0
com.apple.iokit.IOHDCPFamily 1.0.0
com.apple.iokit.IOCECFamily 1
com.apple.iokit.IOAudio2Family 1.0
com.apple.driver.AppleIISController 240.1
com.apple.driver.AppleAudioClockLibs 240.1
com.apple.driver.AppleM2ScalerCSCDriver 265.0.0
com.apple.iokit.IOSurface 336.60.1
com.apple.driver.IODARTFamily 1
com.apple.driver.FairPlayIOKit 71.1.0
com.apple.driver.AppleARMPlatform 1.0.2
com.apple.iokit.IOSlowAdaptiveClockingFamily 1.0.0
com.apple.iokit.IOReportFamily 47
com.apple.security.quarantine 4
com.apple.security.sandbox 300.0
com.apple.iokit.IOStorageFamily 2.1
com.apple.kext.AppleMatch 1.0.0d1
com.apple.driver.AppleMobileFileIntegrity 1.0.5
com.apple.iokit.CoreAnalyticsFamily 1
com.apple.security.AppleImage4 5.0.0
com.apple.kext.CoreTrust 1
com.apple.iokit.IOCryptoAcceleratorFamily 1.0.1
com.apple.kec.pthread 1
com.apple.kec.Libm 1
com.apple.kec.corecrypto 12.0



** Stackshot Succeeded ** Bytes Traced 469763 (Uncompressed 1187936) **

 

[ifrit05]

Well, looking at that part of the source code for the kernel gives us this:

#if USE_APPLEARMSMP
    if (!ml_is_quiescing()) {
        // For runtime disable (non S2R) the CPU will shut down immediately.
        ml_topology_cpu_t *cpu = &ml_get_topology_info()->cpus[cpu_id];
        assert(cpu && cpu->cpu_IMPL_regs);
        volatile uint64_t *cpu_sts = (void *)(cpu->cpu_IMPL_regs + CPU_PIO_CPU_STS_OFFSET);

        // Poll the "CPU running state" field until it is 0 (off)
        // This loop typically finishes in about 600ns.  Sometimes it takes as long as 10us.
        // If it takes longer than 10s, assume something went horribly wrong and panic.
        uint64_t start = mach_absolute_time(), interval;
        nanoseconds_to_absolutetime(10 * NSEC_PER_SEC, &interval);

        while ((*cpu_sts & CPU_PIO_CPU_STS_cpuRunSt_mask) != 0x00) {
            __builtin_arm_dsb(DSB_ISH);
            if (mach_absolute_time() > start + interval) {
                panic("CPU%d failed to shut down", cpu_id);

Not sure if its a hardware issue or not still though, try restoring without transferring user data, there might be a service or app that's causing it.

 

[brockb961]

I will try this, but it doesn't make much sense. I also have a M2 MBA which was migrated from the same computer at almost exactly the same time. They both have exactly the same software. These crashes seem to happen sometimes frequently then go away for 2-3 days.

 

[brockb961]

I did try booting it into Safe Mode and letting it run in that state. It has since crashed with the same crash in safe mode also.

 

[jac8304]

@brockb961 did you ever get a resolution with this? I just got an M2 Max 32gb Macbook pro and I am experiencing the EXACT same thing. Apple is also saying and asking me to do the same things. They won't replace the machine until I've gone to the apple store or repaired it several times...but it's so tricky to reproduce. I went to an apple store and they didn't log it visit and they said nothing was wrong with their scan. I also don't trust mailing in my very expensive machine. Curious if you were ever able to either fix it or get a replacement and what you had to do for either resolution?

 

[brockb961]

I did finally get it resolved. The solution, as I expected, was to replace the logic board. No issues after that.

I was very frustrated with the Apple Store who kept insisting, even after restoring the machine twice, that it was a software issue. Frustrated, I called Apple phone support and insisted on a second level specialist. After going through all we had done, she agreed it needed a hardware fix and communicated to the store to replace the logic board.

Using the Apple Store for support was very frustrating. I’m sure they are ok for basic issues, but once it gets past that they only have one answer - that it’s your software. In the future I’ll call in for support. They seemed so much more knowledgeable than the (non)Genius Bar.

 

[jac8304]

Thank you!! I am going to call back and see if I can pursue this path. It's frustrating that such an expensive machine and AppleCare doesn't seem to have the best support. I would expect, for this price, that a machine that is only a couple months old would just be replaced after several calls and store visits.

 

[brockb961]

I thought the same. My experience was very different with phone support vs. store support. At least at my store there was really no next level support, just those who could ask if it were plugged in or tell you to just restore it unless it had a hard fail on diagnostics. They had no concept of intermittent problems.

 

[jac8304]

For me, even phone support wasn't that helpful. To an extent they were but I don't agree with a computer having issues within the first few months having to go through 3 repairs before they replace it. I mean, just replace the machine, fix the returned one and sell it as refurbished. Now if I get a fix I basically have a refurbished machine for full-retail price. Not cool with me. I coulda saved a lot of money by just buying refurbished to start with in that case. Especially if you have AppleCare+. Even if they just had this option for the higher-end tier, like, if you spend 4k a machine and there are issues in the first 6 months, we'll replace it no questions asked 1 time. They still won't lose money.

Glad you were able to get yours working again, here's hoping that they can figure out and fix mine or replace it.