Wall Street Banks Highlight New AI Risks in Recent Reports

Wall Street banks outline new AI risks including software hallucinations and cybercrime, emphasizing the need for robust governance to navigate these challenges.

Key points:

  • Major banks like Goldman Sachs and JPMorgan Chase highlight new AI risks.
  • Concerns include software hallucinations, cybercrime, and employee morale issues.
  • Recent regulations and rapid tech advancements present ongoing challenges.

Wall Street firms, including Goldman Sachs Group Inc., Citigroup Inc., and JPMorgan Chase & Co., are raising alarms over the emerging risks associated with the use of artificial intelligence in finance. These concerns, highlighted in their latest annual reports, encompass potential software hallucinations, the impact on employee morale, and the increasing sophistication of cybercriminals.

These firms have noted several risks tied to AI, including the potential for flawed AI models and the challenge of keeping up with rapid technological advancements. JPMorgan has expressed concerns about AI-driven "workforce displacement" potentially affecting staff morale and retention, while also increasing competition for skilled tech employees, as per their 2024 10-K report.

Increased AI adoption poses further risks of cyberattacks and misuse. "Having those right governing mechanisms in place to ensure that AI is being deployed in a way that's safe, fair and secure — that simply cannot be overlooked," Ben Shorten, Accenture Plc's lead for finance, risk and compliance for banking and capital markets in North America, mentioned in a recent interview.

Citigroup's report outlines the dangers of rolling out generative AI, which could produce "ineffective, inadequate or faulty" results that may impact its reputation and operations negatively. This reflects a broader industry concern over maintaining high data quality to avoid the pitfalls of outdated or biased data sets.

With the EU's Artificial Intelligence Act now in effect, introducing strict rules for AI usage, banks face a new regulatory landscape. This act significantly shapes how AI systems are marketed and used within the EU, impacting many U.S. banks with operations in the region. The outlook in the U.S. remains uncertain, adding another layer of complexity to the banks' operational environment.

As part of their strategic response, banks are not only enhancing their internal AI capabilities but also integrating third-party technologies. Morgan Stanley, for example, is employing AI tools like a ChatGPT-like interface to automate mundane tasks, thereby improving efficiency and data privacy, especially in remote work settings, according to their latest annual report.

AI's potential and pitfalls are starkly outlined by JPMorgan's CEO, Jamie Dimon, who compares AI's impact to the steam engine, suggesting it could "augment virtually every job." 

Customer Stories

See how leading enterprise in-house teams have scaled smarter with Legal.io's high-caliber flex talent.

More from Legal.io


Thomson Reuters' CoCounsel Reaches One Million Users, Signaling AI's Deepening Hold on Legal Practice

Thomson Reuters' CoCounsel AI platform has crossed the one million user threshold, reflecting a broader and accelerating shift in how legal, tax and compliance professionals work — though the company's own CTO says the product is not yet where it needs to be.

Feb 27, 2026
Read More
Remove the Term "Non-Lawyer" in Legal Settings for a More Inclusive Legal Profession

Discussing the adverse effects of the term "Non-Lawyer" and arguing for why it's time to retire this divisive label in favor of a more empowering “Legal Professional”.

Nov 23, 2023
Read More
UK Revenue Strategy Faces Headwinds From US Firm Structures

US law firms used complex multinational partnership structures to limit the impact of UK tax reforms, underscoring enforcement challenges in cross border professional services taxation.

Feb 11, 2026
Read More
2026 State of the U.S. Legal Market: A Little Bit Unstable

Record law firm profitability masks structural strain - from tech-driven efficiency to pricing pressure, shifting demand, and a coming reset.

Jan 25, 2026
Read More
Ready to hire?

Schedule a free consultation to discuss your hiring needs.

Free 15-min consultation
Legal.io Platform
5 star reviews
Hiring made smarter

Easy-to-use platform for hiring legal talent, managing spend, and optimizing your panel — plus an average savings of 50%.

Need Immediate Help?

Submit a hiring request and let our experts handle the entire process for you.