I think the actual problem is the quantity and not the quality. AI generated phishing attemps won't be higher quality in my opinion, at least for quite some time. I give you an example what I mean:
I ordered products from three different websites and booked two buses. Just for those I got exactly 27! emails from the vendors, the shipping companies and the bus company (one of my bus reservation got changed 4 times). Without paypal! That's overwhelming! And I think when you just get the "right" malicious mail, in terms of the right faked company, I'm not able to say I'm save, despite I would say I'm totally aware of phishing mails and kinda good in tracking them down.
Let's burn those data centers down.