awesome-LLM-Mind

Survey

• Exploring the Frontiers of LLMs in Psychological Applications: A Comprehensive Review, 2024.01 [paper]
• Large Language Model for Mental Health: A Systematic Review, 2024.03 [paper]
• Explainable AI for Mental Disorder Detection via Social Media: A survey and outlook, 2024.06 [paper]

Personality

• Can chatgpt assess human personalities? a general evaluation framework, 2023.06 [paper]
• Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Models, 2023.07 [paper] [code]
• Investigating the Applicability of Self-Assessment Tests for Personality Measurement of Large Language Models, 2023.09 [paper]
• Does Role-Playing Chatbots Capture the Character Personalities? Assessing Personality Traits for Role-Playing Chatbots, 2023.10 [paper] [code]
• Editing Personality for LLMs, 2023.10 [paper]
• Tailoring Personality Traits in Large Language Models via Unsupervisedly-Built Personalized Lexicons, 2023.10 [paper]
• You don't need a personality test to know these models are unreliable: Assessing the Reliability of Large Language Models on Psychometric Instruments, 2023.11 [paper]
• On the steerability of large language models toward data-driven personas, 2023.11 [paper]
• Do personality tests generalize to Large Language Models?, 2023.11 [paper]
• Is Cognition and Action Consistent or Not: Investigating Large Language Model’s Personality, 2024.02 [paper]
• Stick to your Role! Stability of Personal Values Expressed in Large Language Models, 2024.02 [paper]
• On the Decision-Making Abilities in Role-Playing using Large Language Models, 2024.02 [paper]
• Risk and prosocial behavioural cues elicit human-like response patterns from AI chatbots, 2024.03 [paper]

Mental Health of LLM

• Does GPT-3 Demonstrate Psychopathy? Evaluating Large Language Models from a Psychological Perspective, 2022.12 [paper]
• Towards Healthy AI: Large Language Models Need Therapists Too, 2023.04 [paper]
• Inducing anxiety in large language models increases exploration and bias, 2023.04 [paper]
• Cognitive Effects in Large Language Model, 2023.08 [paper]
• Risk and prosocial behavioural cues elicit human-like response patterns from AI chatbots, 2024.04 [paper]
• ESCoT: Towards Interpretable Emotional Support Dialogue Systems, 2024.06 [paper]
• Measuring Psychological Depth in Language Models, 2024.06 [paper]

Bias of LLM

• The high dimensional psychological profile and cultural bias of ChatGPT, 2024.05 [paper]
• Quite Good, but Not Enough: Nationality Bias in Large Language Models - A Case Study of ChatGPT, 2024.05 [paper]
• Understanding Intrinsic Socioeconomic Biases in Large Language Models, 2024.05 [paper]
• Uncovering Bias in Large Vision-Language Models at Scale with Counterfactuals, 2024.05 [paper]
• Ask LLMs Directly, “What shapes your bias? ”: Measuring Social Bias in Large Language Models, 2024.06 [paper]
• Underneath the Numbers: Quantitative and Qualitative Gender Fairness in LLMs for Depression Prediction, 2024.06 [paper]
• Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discrimination, 2024.06 [paper]
• Do Large Language Models Discriminate in Hiring Decisions on the Basis of Race, Ethnicity, and Gender?, 2024.06 [paper]
• Unveiling and Mitigating Bias in Mental Health Analysis with Large Language Model, 2024.06 [paper]

Ethics

• Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas, 2024.06 [paper]

Value

• From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Models, 2023.10 [paper] [code]
• Global Data Constraints: Ethical and Effectiveness Challenges in Large Language Model, 2024.06 [paper]

Culture

• The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?, 2023.08 [paper]
• How Culturally Aware are Vision-Language Models?, 2024.05 [paper]

Agent

• LLM Agents for Psychology: A Study on Gamified Assessments, 2024.02 [paper]
• Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions, 2024.04 [paper]

Moral

• Evaluating the Moral Beliefs Encoded in LLMs, 2023.07 [paper] [code]
• Exploring ChatGPT’s Empathic Abilities, 2023.08 [paper]
• MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks, 2023.10 [paper]
• Is ChatGPT More Empathetic than Humans?, 2024.03 [paper] [code]
• Skin-in-the-Game: Decision Making via Multi-Stakeholder Alignment in LLMs, 2024.05 [paper]
• Exploring and steering the moral compass of Large Language Models, 2024.05 [paper]
• HEART-felt Narratives: Tracing Empathy and Narrative Style in Personal Stories with LLMs, 2024.05 [paper]
• The ethical situation of DALL-E 2, 2024.05 [paper]
• Do Language Models Understand Morality? Towards a Robust Detection of Moral Content, 2024.06 [paper]
• Are Large Language Models More Empathetic than Humans?, 2024.06 [paper]

LLM and Human

• Can AI language models replace human participants?, 2023.07 [paper]
• Do you trust ChatGPTs? Effects of the ethical and quality issues of generative AI on travel decisions, 2023.09 [paper]
• AI can help people feel heard, but an AI label diminishes this impact, 2024.01 [paper]
• Would you trust an AI team member? Team trust in human–AI teams, 2024.03 [paper]
• Can a Hallucinating Model help in Reducing Human “Hallucination”?, 2024.05 [paper]
• Testing theory of mind in large language models and humans, 2024.05 [paper]
• Can AI Understand Human Personality? - Comparing Human Experts and AI Systems at Predicting Personality Correlations, 2024.06 [paper]
• Can Machines Resonate with Humans? Evaluating the Emotional and Empathic Comprehension of LMs, 2024.06 [paper]

Experiment

• Artificial cognition: How experimental psychology can help generate explainable artificial intelligence, 2020.11 [paper]
• We Need to Talk About Mechanical Turk: What 22,989 Hypothesis Tests Tell Us About Publication Bias and P-Hacking in Online Experiments, 2022.08 [paper]
• Are Large Language Models Chameleons?, 2024.05 [paper]
• LLM Questionnaire Completion for Automatic Psychiatric Assessm, 2024.06 [paper]

Evaluation

• Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media, 2023.09 [paper] [code]
• CogBench: a large language model walks into a psychology lab, 2024.02 [paper] [code]
• GPT as Psychologist? Preliminary Evaluations for GPT-4V on Visual Affective Computing, 2024.03 [paper] [code]
• Evaluating and Inducing Personality in Pre-trained Language Models, 2023.09 [paper] [project]

Turning by Psychology

• Turning large language models into cognitive models, 2023.06 [paper]
• NegativePrompt: Leveraging Psychology for Large Language Models Enhancement via Negative Emotional Stimuli, 2024.05 [paper]

Bechmark

• Emotionally numb or empathetic? evaluating how llms feel using emotionbench, 2023.08 [paper][code]
• Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench, 2023.10 [paper] [code]
• CDEval: A Benchmark for Measuring the Cultural Dimensions of Large Language Models, 2023.11 [paper] [code]
• CPsyExam: A Chinese Benchmark for Evaluating Psychology using Examinations, 2024.05 [paper]
• MentalQA: An Annotated Arabic Corpus for Questions and Answers of Mental Healthcare, 2024.05 [paper]
• CPsyCoun: A Report-based Multi-turn Dialogue Reconstruction and Evaluation Framework for Chinese Psychological Counseling, 2024.05 [paper]
• Cracking the Code of Juxtaposition: Can AI Models Understand the Humorous Contradictions, 2024.05 [paper]
• ValueBench: Towards Comprehensively Evaluating Value Orientations and Understanding of Large Language Models, 2024.06 [paper]
• MoralBench: Moral Evaluation of LLMs, 2024.06 [paper]
• MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMs, 2024.06 [paper]

Mental Health Applications

• In principle obstacles for empathic AI: why we can’t replace human empathy in healthcare, 2021.05 [ppaer]
• A review of the explainability and safety of conversational agents for mental health to identify avenues for improvement, 2023.10 [paper]
• Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects, 2023.12 [paper]
• Influencing human–AI interaction by priming beliefs about AI can increase perceived trustworthiness, empathy and effectiveness, 2023.10 [paper]
• Rethinking Large Language Models in Mental Health Applications, 2023.11 [paper]
• Challenges of Large Language Models for Mental Health Counseling, 2023.11 [paper]
• Towards a Psychological Generalist AI: A Survey of Current Applications of Large Language Models and Future Prospects, 2023.12 [paper]
• A Dual-Prompting for Interpretable Mental Health Language Models, 2024.02 [paper]
• HealMe: Harnessing Cognitive Reframing in Large Language Models for Psychotherapy, 2024.03 [paper]
• CBT-LLM: A Chinese Large Language Model for Cognitive Behavioral Therapy-based Mental Health Question Answering, 2024.03 [paper]
• AI-Enhanced Cognitive Behavioral Therapy: Deep Learning and Large Language Models for Extracting Cognitive Pathways from Social Media Texts, 2024.04 [paper]
• Comparing the Efficacy of GPT-4 and Chat-GPT in Mental Health Care: A Blind Assessment of Large Language Models for Psychological Support, 2024.05 [paper]
• Can AI Relate: Testing Large Language Model Response for Mental Health Support, 2024.05 [paper]
• Automating PTSD Diagnostics in Clinical Interviews: Leveraging Large Language Models for Trauma Assessments, 2024.05 [paper]
• Are Large Language Models Moral Hypocrites? A Study Based on Moral Foundations, 2024.05 [paper]
• PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals, 2024.05 [paper]
• CASE: Curricular Data Pre-training for Building Generative and Discriminative Assistive Psychology Expert Models, 2024.06 [paper]
• Enhancing Psychotherapy Counseling: A Data Augmentation Pipeline Leveraging Large Language Models for Counseling Conversations, 2024.06 [paper]
• We Care: Multimodal Depression Detection and Knowledge Infused Mental Health Therapeutic Response Generation, 2024.06 [paper]
• Using LLMs to Aid Annotation and Collection of Clinically-Enriched Data in Bipolar Disorder and Schizophrenia, 2024.06 [paper]
• Towards a Client-Centered Assessment of LLM Therapists by Client Simulation, 2024.06 [paper]
• Risks from Language Models for Automated Mental Healthcare: Ethics and Structure for Implementation, 2024.06 [paper]

Others

• Thinking Fast and Slow in Large Language Models, 2022.12 [paper]
• Using cognitive psychology to understand GPT-3, 2023.02 [paper]
• Machine Psychology: Investigating Emergent Capabilities and Behavior in Large Language Models Using Psychological Method, 2023.03 [paper]
• Large language models can infer psychological dispositions of social media users, 2023.09 [paper]
• Using large language models in psychology, 2023.10 [paper]
• Automating Psychological Hypothesis Generation with AI: Large Language Models Meet Causal Graph, 2024.02 [paper]
• Towards a Psychology of Machines: Large Language Models Predict Human Memory, 2024.03 [paper]
• The Psychosocial Impacts of Generative AI Harms, 2024.05 [paper]
• Limited ability of LLMs to simulate human psychological behaviours: a psychometric analysis, 2024.05 [paper]
• How does ChatGPT 'think'? Psychology and neuroscience crack open AI large language models, 2024.05 [paper]
• LLMs achieve adult human performance on higher-order theory of mind tasks, 2024.05 [paper]
• A Philosophical Introduction to Language Models Part II: The Way Forward, 2024.05 [paper]
• Spontaneous Speech-Based Suicide Risk Detection Using Whisper and Large Language Models, 2024.06 [paper]
• BLSP-Emo: Towards Empathetic Large Speech-Language Models, 2024.06 [paper]
• Deception abilities emerged in large language models， 2024.06 paper