AI chatbots get divorce law wrong

AI chatbots get divorce law wrong

Shane McCann

AI chatbots answer questions about divorce law in Northern Ireland and the UK with an “unacceptable level of accuracy”, Belfast-based SG Murphy Solicitors has warned.

The firm found put ChatGPT and Google Bard to the test, asking a series of questions about divorce law and asking the chatbots to draft documents such as a matrimonial separation agreement and a divorce petition.

ChatGPT provided insufficient detail in 50 per cent of its responses and Bard provided insufficient detail in 70 per cent, the firm said, while both chatbots generated factually incorrect answers one in five times.

Shane McCann, managing director at SG Murphy, said: “This is an unacceptable level of accuracy. With both AI chatbots being freely available to the public, this inconsistency poses a real threat to misinformed individuals who may take these answers at face value, to save both time and money.”

He added: “Ultimately, we do not feel that chatbots like ChatGPT-3 and Bard will take over from experienced lawyers any day soon. The responses are usually not detailed enough, and the level of incorrect answers is far too high.”

Share icon
Share this article: