AI Use in Court: Judge Halts Proceedings Due to Fabricated Rulings
The use of language models promises significant time savings in document creation. However, relying blindly on results can lead to legal consequences, as seen in a recent case in Mississippi.
- Home
- News
- Software & Development
Don't miss any news!
The use of language models promises significant time savings in document creation. However, those who rely blindly on the results risk not only their good reputation but also tangible legal consequences.
In the federal court of the Northern District of Mississippi, a civil lawsuit over unpaid fees has collapsed. In the contractual dispute, attorney Tom Withers faced the city of Aberdeen. However, Withers did not represent himself.
According to the US online magazine 404 Media, the problem lay in the inadequate working methods of the legal representatives of both parties. Both Withers' attorneys and those of the city of Aberdeen had used generative artificial intelligence to support their legal arguments.
They incorporated the software's outputs into their briefs without verification. The result: both sides presented the court with supposed precedents that did not actually exist. The AI had simply fabricated the alleged court rulings.
Judge Sharion Aycock immediately halted the proceedings and revoked the mandates of all four attorneys involved in the case. Additionally, the court imposed fines ranging from $1,000 to $3,500 and partial two-year bans on appearing in the court district. The plaintiff, Withers, was spared from sanctions as he was not held responsible for his attorney's mistakes.
AI Systems Argument Against Each Other
The case highlights the risk of so-called hallucinations, where language models generate plausible-sounding but entirely fictitious facts. According to court records, both parties effectively pitted two chatbots against each other without subjecting the generated outputs to human review.
"In an era of rampant, unchecked AI use in the legal industry, this case is a prime example of the risks associated with rubber-stamping results unseen," Judge Aycock criticized the behavior. This systematic failure in content verification justifies the imposed penalties.
Lack of Control Mechanism for Text Generators
This is not the first time language models have caused problems in legal disputes. Last year, a case in the federal court in New York drew attention because the plaintiff's side relied on ChatGPT for research.
However, the current development in Mississippi shows a new escalation, as both sides violated fundamental legal due diligence. While AI-based tools expedite processes, they do not replace the necessary final review by human experts.
The legal expert Rob Freund, who first discovered the matter and shared it on the social media platform X, referred to the incident as a "comedy of AI errors." He pointed out that the clients essentially paid for a language model to argue against itself.
Although the imposed sanctions do not entail a complete revocation of the license, they significantly impair the professional reputation of those involved. The case emphatically demonstrates that unchecked outsourcing of responsibility to algorithms poses an enormous risk.
Top Articles