The Long Road from Reliance on ChatGPT to Rule 11 Sanctions
In February 2022, Steven Schwartz of the Levidow Firm filed suit in the Supreme Court of the State of New York on behalf of a personal injury claimant. This case was removed to the United States District Court for the Southern District of New York. Since Schwartz was not admitted to practice in that district, another attorney from the same firm, Peter LoDuca, filed notice of appearance in the case. Schwartz continued to perform all the substantive legal work for the federal case, with LoDuca merely signing and filing documents authored by Schwartz.
In the course of litigation, Schwartz prepared and LoDuca signed and filed a response to the defendant’s motion to dismiss. This responsive filing, a so-called “Affirmation in Opposition,” was wrongly filed in accordance with New York state and not federal court requirements. It cited and quoted from purported judicial decisions that were said to be published in the Federal Reporter, the Federal Supplement Reporter, and Westlaw. Although LoDuca signed and filed the affirmation, he made no effort to verify the form of the filing or any case law cited therein.
Two weeks later, on March 15, 2023, the defendant filed a response, “impliedly assert[ing]” that cases cited in the plaintiff’s affirmation did not exist and stating that the few cases which the defendant was able to locate did not stand for the propositions for which they were cited. The Court conducted its own search for the cited materials but was unable to locate multiple authorities cited. Neither LoDuca, Schwartz, nor the firm they worked for sought to withdraw the filing or provide any explanation.
In April 2023, the Court ordered plaintiffs to file an affidavit that annexed copies of the cited decisions that raised concerns. Eventually, LoDuca filed an affidavit authored by Schwartz that annexed ChatGPT-generated excerpts of all but one of the fake opinions, which was described as an unpublished opinion. The affidavit was vague about the source of the excerpted materials, stating that the purported opinions represented only what was made available by online database, without identifying any “online database” by name or admitting reliance on ChatGPT.
The Court’s review found that while the fake opinions had some traits that were superficially consistent with actual judicial decisions, (e.g., citing to plausible panels of federal judges, credible docket numbers, and purported citations to case law), blatant stylistic and reasoning flaws on the face of the excerpts made it clear that they could not have issued from a US appeals court. One fake opinion, for example, started off discussing wrongful death claims related to the death of “George Scaria Varghese” only to abruptly shift to discussing claims of “Anish Varghese” who was denied boarding on a flight. The excerpts additionally conflated facts and jurisdictions, contained erroneous citations, and advanced procedural history “border[ing] on nonsensical.”
Thus, the Court’s sanctions opinion sharply focused on the importance of protecting the adversarial process from fake submissions. The Court plainly stated that “if the matter had ended with [the lawyers] coming clean about their actions shortly after they received the defendant’s March 15 brief questioning the existence of the cases, or after they reviewed the Court’s Orders of April 11 and 12 requiring production of the cases, the record now would look quite different.”
Appreciation for the Rule of Law as a Safeguard during Uncertain Times
The sanctions opinion shows that even in cases of clear and obvious failing of technical competence, the Court’s interest remains focused on ensuring the Rule of Law. Rule of Law is defined as the restriction of the arbitrary exercise of power by subordinating it to well-defined and established laws. Traditional principles of the Rule of Law relevant to the Court’s opinion include: the principles of stare decisis, legal certainty, and legal predictability. The Court’s decision connects these principles to legal practice by citing to rules of professional conduct.
“The Anglo-American common-law tradition is built on the doctrine of stare decisis (‘stand by decided matters’), which directs a court to look to past decisions for guidance on how to decide a case before it. This means that the legal rules applied to a prior case with facts similar to those of the case now before a court should be applied to resolve the legal dispute.” Stare decisis is one of the main reasons why lawyers cite to other cases in their briefs and writings, because judges are required to align their decisions with relevant and authoritative precedents. Stare decisis relies entirely on the existence of authentic precedent authored by judges. When stare decisis is undermined, legal certainty is undermined as well. Legal certainty is the principle that requires that the law be clear, precise, and unambiguous, and its legal implications foreseeable. Fake cases disrupt clear laws, provoke ambiguity, and prevent assessment of foreseeable legal implications. Legal certainty implies legal predictability—that adjudication must be predictable. This means that laws must be clear, stable, and intelligible so that those concerned can with relative accuracy calculate the legal consequences of their actions as well as the outcome of legal proceedings.
Justice John Marshall Harlan considered the importance of giving the public a “clear guide,” the value of helping individuals “to plan their affairs,” the benefits of “expeditious adjudication,” and “the necessity of maintaining public faith in the judiciary as a source of impersonal and reasoned judgements” as providing strong indication that courts should respect their own precedents. Perhaps echoing Justice Harlan’s approach, the Court here provides useful illustration of the contemporary impacts:
Many harms flow from the submission of fake opinions. The opposing party wastes time and money in exposing the deception. The Court’s time is taken from other important endeavors. The client may be deprived of arguments based on authentic judicial precedents. There is potential harm to the reputation of judges and courts whose names are falsely invoked as authors of the bogus opinions and to the reputation of a party attributed with fictional conduct. It promotes cynicism about the legal profession and the American judicial system. And a future litigant may be tempted to defy a judicial ruling by disingenuously claiming doubt about its authenticity.
Highlighting the connection between harmful systemic impacts and relevant procedural and ethical legal practice rules, citing Rule 11 of the Federal Rules of Civil Procedure, the Court found that filing papers “without taking the necessary care in their preparation” was an “abuse of the judicial system” subject to Rule 11 sanction. Further, the Court cited Rule 3.3(a)(1) of the New York Rules of Professional Conduct, 22 N.Y.C.R.R. § 1200.0 (NYRPC), which states, “A lawyer shall not knowingly make a false statement of fact or law to a tribunal or fail to correct a false statement of material fact or law previously made to the tribunal by the lawyer.” In highlighting the appropriateness of reliance on other lawyers, databases, and technology, the Court implicitly points to Rule 5.1 NYRPC that imposes obligations on lawyers, particularly firms and direct supervisors, to make reasonable efforts to ensure conformity with these and other rules. The Court even went to the extent of discussing potential violations of criminal law, noting that knowingly passing off false documents as authentic ones issued by the courts of the United States implicates the federal criminal statute prohibiting such conduct. The Court ultimately found that since no fake signatures or seals were submitted, the criminal statute was not invoked, despite noting the strong resonance between the crimes the statute seeks to prevent and the circumstances of the case.
Lawyers in the United States, regardless of where they are barred, have an obligation to uphold principles of Rule of Law. This means while lawyers have an obligation to zealously represent their clients, they are required to fulfill this obligation in a manner that upholds the integrity and fair functioning of the legal system. When it comes to citing precedents, this means that lawyers have an obligation to advance arguments grounded in authentic legal precedent. This includes the obligation to check citations and to locate and review full decisions. This principle extends to all actors in the legal system, whether they are judges, attorneys, or pro se litigants. The adversarial system depends on transparent and open development of the law by judges through an adversarial process. Reliance on fake decisions not only undermines the potential for a fair fight between the parties, but it also undermines the value, certainty, and predictability of a decision.
Generative AI is a type of AI system “capable of generating text, images, or other media in response to prompts. Generative AI models learn the patterns and structure of their input training data, and then generate new data that has similar characteristics.” Consumer-grade generative AI tools, now in the hands of millions of people across the globe, are transforming the way people work, create, and interact with one another.
The law frequently lags behind technological, political, social, and economic developments. This is because creating laws and regulations specific to the new context and challenges takes time, diverse inputs, and planning. When technological change provokes political, social, and economic uncertainty, it also provokes tremendous legal uncertainty—as the nature of legal problems that people face are also transformed. As technology triggers rapid changes, the gap between the law and newly evolving legal problems becomes exponentially bigger.
This lag between technology and the law can often create anxiety around technological change and development. The Court’s sanctions order and opinion shows how a sound appreciation for the principles of Rule of Law can act as a safeguard or safe harbor during times of uncertainty provoked by technological change. In the context of technological change and lagging legal change, new laws, regulations, policies, and guidelines are reliably derived from existing laws, regulations, policies, and guidelines and, therefore, will unwaveringly uphold basic principles of the Rule of Law. Knowledge of and appreciation for what is existing (here the rules of professional responsibility) can help lawyers better navigate uncertainty, avoid sanction, and achieve more favorable results for their clients.