A New York lawyer is facing a court hearing of his own after his firm used AI tool ChatGPT for legal research.
A judge said the court was faced with an "unprecedented circumstance" after a filing was found to reference example legal cases that did not exist.
The lawyer who used the tool told the court he was "unaware that its content could be false".
ChatGPT creates original text on request, but comes with warnings it can "produce inaccurate information".
...
"Six of the submitted cases appear to be bogus judicial decisions with bogus quotes and bogus internal citations," Judge Castel wrote in an order demanding the man's legal team explain itself.
Over the course of several filings, it emerged that the research had not been prepared by Peter LoDuca, the lawyer for the plaintiff, but by a colleague of his at the same law firm. Steven A Schwartz, who has been an attorney for more than 30 years, used ChatGPT to look for similar previous cases.
https://www.bbc.com/news/world-us-canada-65735769
Chatbot makes dangerous error
-
- Posts: 9154
- Joined: Sat Oct 22, 2016 9:09 pm
- Location: Former full time RVers
- Affiliation: PlainRomanCatholic
- Contact:
Chatbot makes dangerous error
0 x
Max (Plain Catholic)
Mt 24:35
Proverbs 18:2 A fool does not delight in understanding but only in revealing his own mind.
1 Corinthians 3:19 For the wisdom of this world is folly with God
Mt 24:35
Proverbs 18:2 A fool does not delight in understanding but only in revealing his own mind.
1 Corinthians 3:19 For the wisdom of this world is folly with God
Re: Chatbot makes dangerous error
I have known computers will lie for years. Ever since I had it say, "Hello handsome" every time I turn on the machine.
1 x
Try hard not to offend. Try harder not to be offended.
Just because you are paranoid, doesn't mean they are not after you.
I think I am funnier than I really am.
Just because you are paranoid, doesn't mean they are not after you.
I think I am funnier than I really am.
Re: Chatbot makes dangerous error
The good thing about this is that it will have the affect of making people more wary of things like legal arguments and studies which can easily be created out of thin air by someone skilled at writing or by AI engines. Who knows how much legitimate-sounding content is routinely accepted as credible just because it sounds authoritative.
4 x
Remember the prisoners, as though you were in prison with them, and the mistreated, as though you yourselves were suffering bodily. -Heb. 13:3
-
- Posts: 4304
- Joined: Wed Nov 09, 2016 11:34 am
- Location: The flat part of Colorado
- Affiliation: MCUSA
Re: Chatbot makes dangerous error
Yup. This is one of the issues with AI -- it makes mistakes and because it sounds authoritative, people assume it's correct.
I've had ChatGTP spit out information that I know isn't true.
Always, ALWAYS verify information from ChatGTP.
I've had ChatGTP spit out information that I know isn't true.
Always, ALWAYS verify information from ChatGTP.
1 x
“It’s easy to make everything a conspiracy when you don’t know how anything works.” — Brandon L. Bradford
-
- Posts: 4304
- Joined: Wed Nov 09, 2016 11:34 am
- Location: The flat part of Colorado
- Affiliation: MCUSA
Re: Chatbot makes dangerous error
Information literacy is a skill that needs to be taught.mike wrote: ↑Mon May 29, 2023 10:04 am The good thing about this is that it will have the affect of making people more wary of things like legal arguments and studies which can easily be created out of thin air by someone skilled at writing or by AI engines. Who knows how much legitimate-sounding content is routinely accepted as credible just because it sounds authoritative.
3 x
“It’s easy to make everything a conspiracy when you don’t know how anything works.” — Brandon L. Bradford