Jack Marley-Payne

About

I am director of research at Financial Life Cycle Education, where I research finance, education and equity--and the interactions between them.

Research

Content Analysis of LLM Financial Advice Responses

This study presents a preliminary content analysis of responses generated by leading LLMs answering common personal finance questions. Our focus is providing an assessment of the responses in terms of the quality of the financial advice provided. Using an automated classification pipeline built around the Anthropic API, we coded all statements in each response by communicative type and applied sub-analyses including fact-checking, sentiment analysis and jargon counting. We found that all models provided a high volume of advisory and factual statements, skewed confident in tone, and included high levels of jargon. They made limited efforts to seek the additional context that best practices in financial advising would recommend acquiring before distributing advice. Factual accuracy was generally high, with errors being the exception not the rule.

Is Answering "Don't Know" Better Than Answering Incorrectly in Financial Literacy Tests? Differentiating Incorrect and Don't Know Responses When Predicting Financial Behaviors

Journal of Financial Counseling and Planning · 2025

This study investigates the implications of answering a financial question incorrectly when one has the option to select "don't know." Using data from the 2021 National Financial Capability Survey, we find that providing an incorrect response rather than selecting "don't know" is associated with an increased likelihood of engaging in both positive and negative financial behaviors, including risky investment behavior — potentially reflecting a tendency toward overconfidence.

The Roles of Math and Financial Literacy on Financial Behavior

Journal of Financial Literacy and Wellbeing · 2025

Using nationally representative survey data, this brief examines the joint and independent roles of financial and math knowledge in predicting financial behaviors. High levels of both forms of knowledge were associated with better outcomes than either alone, suggesting the two are complementary components of financial capability.

The Financial Experiences of Transgender Americans: Findings from a National Probability Sample

Consumer Interests Annual, Vol. 71 · 2025

Drawing on the TransPop Survey — the first national probability sample of transgender Americans — this study finds that transgender people are significantly more likely to exhibit indicators of financial vulnerability than the general population, and that gender-based variation in financial outcomes within the transgender community does not mirror patterns seen in the wider population.

An Ameliorative Analysis of the Concept of Education

Educational Philosophy and Theory · 2022

Applies ameliorative analysis — a framework from philosophy of language — to the concept of education. Argues that egalitarian goals are better served by a narrower concept of education tightly connected to formal schooling, which avoids muddying other aspects of the pursuit of social justice.

Rethinking Nature and Nurture in Education

Journal of Philosophy of Education, 55(1) · 2021

Argues that education debates suffer from a naïve understanding of nature versus nurture. Proposes a more rigorous framework that examines individual reactions across a range of educational environments, with implications for questions of educational justice and fair treatment of students.

Should Political Leaders Be Highly Educated?

Journal of Applied Philosophy · 2021

Challenges the liberal view that elite education is a virtue of political leaders. Argues that having the highly educated disproportionately represented in political office is incompatible with egalitarian democracy, as it systematically excludes the working class from full political participation.

Contact

If you have questions about my research or ideas for future projects, get in touch.