LLM-and-Law

This repository is dedicated to summarizing papers related to large language models with the field of law

Applications of Large Language Models in Legal Tasks

[1] Legal Prompt Engineering for Multilingual Legal Judgement Prediction

[2] Can GPT-3 Perform Statutory Reasoning?

[3] Legal Prompting: Teaching a Language Model to Think Like a Lawyer

[4] Large Language Models as Fiduciaries: A Case Study Toward Robustly Communicating With Artificial Intelligence Through Legal Standards

[5] ChatGPT Goes to Law School

[6] ChatGPT, Professor of Law

[7] ChatGPT & Generative AI Systems as Quasi-Expert Legal Advice Lawyers - Case Study Considering Potential Appeal Against Conviction of Tom Hayes

[8] ‘Words Are Flowing Out Like Endless Rain Into a Paper Cup’: ChatGPT & Law School Assessments

[9] ChatGPT by OpenAI: The End of Litigation Lawyers?

[10] Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans

[11] ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmark paper

[12] How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization? paper

[13] Explaining Legal Concepts with Augmented Large Language Models (GPT-4) paper

[14] Garbage in, garbage out: Zero-shot detection of crime using Large Language Models paper

[15] Legal Summarisation through LLMs: The PRODIGIT Project paper

[16] Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task paper

[17] PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models

[18] Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise paper

[19] Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration paper

[20] From Text to Structure: Using Large Language Models to Support the Development of Legal Expert Systems paper

[21] Boosting legal case retrieval by query content selection with large language models paper

[22] LLMediator: GPT-4 Assisted Online Dispute Resolution paper

[23] Employing Label Models on ChatGPT Answers Improves Legal Text Entailment Performance paper

[24] LLaMandement: Large Language Models for Summarization of French Legislative Proposals paper

[25] Logic Rules as Explanations for Legal Case Retrieval paper Our new paper, welcome to pay attention !!!

[26] Enhancing Legal Document Retrieval: A Multi-Phase Approach with Large Language Models paper

[27] BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models paper

[28] A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law paper

[29] Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure paper

[30] More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs paper

[31] Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model paper

[32] Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learning paper

[33] GOLDCOIN: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory paper

[34] Enabling Discriminative Reasoning in Large Language Models for Legal Judgment Prediction paper

[35] Large Language Models for Judicial Entity Extraction: A Comparative Study paper

[36] Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarization paper

[37] LawLLM: Law Large Language Model for the US Legal System paper

[38] Legal syllogism prompting: Teaching large language models for legal judgment prediction paper

[39] Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models paper

[40] Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools paper

[41] KRAG Framework for Enhancing LLMs in the Legal Domain paper

[42] Legal Evalutions and Challenges of Large Language Models paper

[43] Analyzing Images of Legal Documents: Toward Multi-Modal LLMs for Access to Justice paper

[44] Automating Legal Concept Interpretation with LLMs: Retrieval, Generation, and Evaluation paper

[45] Domaino1s: Guiding LLM Reasoning for Explainable Answers in High-Stakes Domains paper

[46] RELexED: Retrieval-Enhanced Legal Summarization with Exemplar Diversity paper

[47] Courtroom-LLM: A Legal-Inspired Multi-LLM Framework for Resolving Ambiguous Text Classifications paper

[48] LegalViz: Legal Text Visualization by Text To Diagram Generation paper

[49] Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning paper

[50] Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning paper

[51]

Legal Agent

[1] SimuCourt: Building Judicial Decision-Making Agents with Real-world Judgement Documents paper

[2] Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration paper

[3] Multi-Agent Simulator Drives Language Models for Legal Intensive Interaction paper

Legal Problems of Large Language Models

[1] Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models

[2] Persistent Anti-Muslim Bias in Large Language Models

[3] Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models

[4] The Dark Side of ChatGPT: Legal and Ethical Challenges from Stochastic Parrots and Hallucination

[5] The GPTJudge: Justice in a Generative AI World paper

[6] Is the U.S. Legal System Ready for AI's Challenges to Human Values? paper

[7] Questioning Biases in Case Judgment Summaries: Legal Datasets or Large Language Models? paper

[8] Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models

[9] A Legal Framework for Natural Language Processing Model Training in Portugal paper

[10] LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domain paper

[11] Bias in Large Language Models: Origin, Evaluation, and Mitigation paper

[12] An Information Theoretic Approach to Operationalize Right to Data Protection paper

[13] Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench paper

Data Resources for Large Language Models in Law

[1] CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction

[2] When does pretraining help? assessing self-supervised learning for law and the casehold dataset of 53,000+ legal holdings

[3] LeCaRD: a legal case retrieval dataset for Chinese law system

[4] LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

[5] Legal Extractive Summarization of U.S. Court Opinions

[6] Awesome Chinese Legal Resources github

[7] MultiLegalPile: A 689GB Multilingual Legal Corpus paper

[8] The Cambridge Law Corpus: A Corpus for Legal AI Research

[9] TransformLLM: Adapting Large Language Models via LLM-Transformed Reading Comprehension Text paper

[10] Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges paper

[11] ChineseSafe: A Chinese Benchmark for Evaluating Safety in Large Language Models paper

[12] Augmenting Legal Decision Support Systems with LLM-based NLI for Analyzing Social Media Evidence paper

[13] CaseSumm: A Large-Scale Dataset for Long-Context Summarization from U.S. Supreme Court Opinions paper

Law LLMs

[1] LawGPT_zh github

[2] LaWGPT github

[3] Lawyer LLaMA github

[4] LexiLaw github

[5] LexGPT 0.1: pre-trained GPT-J models with Pile of Law paper

[6] TOWARDS THE EXPLOITATION OF LLM-BASED CHATBOT FOR PROVIDING LEGAL SUPPORT TO PALESTINIAN COOPERATIVES paper

[7] ChatLaw: Open-Source Legal Large Language Model with Integrated External Knowledge Bases paper

[8] DISC-LawLLM github

[9] InternLM-Law: An Open Source Chinese Legal Large Language Model paper

[10] SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain paper

[11] LAWGPT: KNOWLEDGE-GUIDED DATA GENERATION AND ITS APPLICATION TO LEGAL LLM paper

Evaluation:

[1] Measuring Massive Multitask Chinese Understanding paper

[2] LawBench: Benchmarking Legal Knowledge of Large Language Models github

[3] Large Language Models are legal but they are not: Making the case for a powerful LegalLLM paper

[4] Better Call GPT, Comparing Large Language Models Against Lawyers paper

[5] Evaluating GPT-3.5's Awareness and Summarization Abilities for European Constitutional Texts with Shared Topics paper

[6] Evaluation Ethics of LLMs in Legal Domain paper

[7] GPTs and Language Barrier: A Cross-Lingual Legal QA Examination paper

[8] LawBench: Benchmarking Legal Knowledge of Large Language Models paper

[9] LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models paper

[10] LegalAgentBench: Evaluating LLM Agents in Legal Domain paper

The survey paper is shown in paper

Acknowledgement

Please cite the following papers as references if this repository helps you (*ゝω・)ﾉThanks!

@article{sun2023short,
  title={A short survey of viewing large language models in legal aspect},
  author={Sun, Zhongxiang},
  journal={arXiv preprint arXiv:2303.09136},
  year={2023}
}