
ALT Promises and pitfalls of artificialintelligence for legal applicationsSayash Kapoor∗, Peter Henderson∗∗, Arvind Narayanan∗∗∗AbstractIs AI set to redefine the legal profession? We argue that this claim is not supported by the current evidence.We dive into AI’s increasingly prevalent roles in three types of legal tasks: information processing, tasksinvolving creativity, reasoning, or judgment, and predictions about the future. We find that the ease ofevaluating legal applications varies greatly across legal tasks based on the ease of identifying correctanswers and the observability of information relevant to the task at hand. Tasks that would lead to themost significant changes to the legal professional are not only harder to evaluate; they are also most proneto overoptimism about AI capabilities. We make recommendations for better evaluation and deploymentof AI in legal contexts.











