Benchmark Framework
A comprehensive evaluation framework for assessing LLMs in professional psychology contexts.
CPsyExam-KG (Knowledge)
Evaluates LLMs' understanding of psychological knowledge across multiple domains.
PCE - Psychological Counselor Examination
The professional qualification examinations for first, second, and third-tier psychological counselors are designed to assess the competence and knowledge of individuals working in the field of psychology.
TQE - Teachers' Qualification Examination
The Teachers' Qualification Examination is a standardized assessment for individuals who wish to teach in primary, middle, and high schools, as well as in vocational schools and higher education institutions.
GEE - Graduate Entrance Examinations
Contains subjects like general psychology, social psychology, experimental psychology, contemporary educational psychology, psychology and educational measurement, developmental psychology, modern psychology, and educational statistics.
SSE - Self-study Examination
Assesses knowledge in educational psychology, medical psychology, advertising psychology, and journalism psychology. For individuals who are self-studying or not enrolled in a formal educational program.
CPsyExam-CA (Case Analysis)
Includes case-oriented questions focusing on method, diagnosis and treatment required during counselling.
Method
Assesses the LLM's ability to use the corresponding methodology in a specific case.
Diagnosis
Pays attention to the LLM's ability to diagnose the visitor's illness.
Treatment
Evaluates LLM's ability to treat patients.