My son recently left Google, where as the Senior Director for Search he had spent the last few years embedded with AI projects that eventually replaced his entire team, so he is acutely aware of AI function and potential, a topic we discuss frequently.
He just started a new gig, VP for Infrastructure at a financial consulting start-up focused on high net worth clients. A primary concern of theirs? How to safeguard client investments from AI generated rip-offs.
Regarding this...we use LastPass to generate random 'dense' passwords. A European firm turned their AI loose on several password generating products, requesting it hack into created accounts protected by random generator passwords...it took seconds.
The defense for investment/banking entities is of course 'home' AI's whose job is to defend accounts against exterior AI attacks. But when AI's start collaborating on their own with their 'owners' completely unaware of it, do opposing AI's actually battle...or instead collaborate?
The rubber will really hit the road when we become aware of the first massive AI generated financial rip.
At which time it will be too late to stuff that genie back in the bottle.