AI
THEME: TECHNOLOGY
18 November 2024 Financial Analysts Journal Volume 81, Issue 1

How Much Does ChatGPT Know about Finance?

  1. Douglas (DJ) Fairhurst
  2. Daniel Greene
Finance applications of large language models (LLMs) have implications for practitioners and researchers. Analysis shows that some models and methods are associated with higher levels of accuracy, making use of LLMs task specific, not job specific.
Read the Complete Article in the Financial Analysts Journal CFA Institute Member Content
woman reviewing a report
Publish in the Financial Analysts Journal

Interested in having your article published in the Financial Analysts Journal? Submit your article here.

Abstract

This paper analyzes more than 10,000 large language model (LLM) responses to finance-related prompts and identifies tradeoffs that can guide both academics and practitioners in using these models for finance applications. Using novel data, we show that some models and methods of interactions are appropriate for users who place a high value on accuracy (i.e., correctness), while others are better for generating responses that are similar to human expert-written text. We identify which finance tasks are associated with higher levels of LLM accuracy and show that the appropriate use of LLMs is task-specific, not job-specific.

We're using cookies, but you can turn them off in Privacy Settings. Otherwise, you are agreeing to our use of cookies. Learn more in our Privacy Policy.