AI 检索质量审计报告

样例对象:教育研究检索(Teaching & Learning)· 生成于 2026-11-03 12:59
测试问题:20 道真实教师提问 · 数据源:OpenAlex 开放学术库(2.5 亿篇)

一、结果概览

20/20
前 3 条任一命中
20/20
第 1 条即命中
0
污染(撞到无关领域)
3/8
人工抽检发现偏题
最值得说的一条:污染率 = 0。
教育问题和计算机术语大量撞词(class → class imbalance,collaborative → collaborative filtering, retrieval → information retrieval),最容易出的错是"看起来对、其实不相干"。 这次 20 道题里,一次都没有跑到那些领域去。
但 100% 不能当成"完美"。
关键词判据只验证"词出现了",验证不了"内容对不对"。我们人工抽检了 8 条,发现 2 条跑偏、1 条偏一点。机器全绿,人工不全绿 —— 这个差距本身就是审计的价值。
如果只看自动化数字,这份报告会得出"20/20 全对"的错误结论。

二、逐题结果(人工抽检过的标出结论)

#问题 / 第 1 条返回判定
q01
how to improve reading comprehension in primary school
Improving Reading Comprehension Achievements of Pupils in Public Primary Schools
「Improving Reading Comprehension Achievements of Pupils in Public Primary Schools」——题目完全对准。
人工:对
q02
does phonics instruction help struggling readers
Theoretical Review of Phonics Instruction for Struggling/ Beginning Readers of E
未抽检
q03
effect of class size on student achievement
The effect of class size on student achievement: evidence from Bangladesh
「The effect of class size on student achievement: evidence from Bangladesh」——正是要的,且带实证。
人工:对
q04
how does feedback improve student learning
HOW ONLINE FACULTY IMPROVE STUDENT LEARNING PRODUCTIVITY
返回「HOW ONLINE FACULTY IMPROVE STUDENT LEARNING PRODUCTIVITY」——讲的是在线教师的生产力,与 feedback 机制无关。关键词 `feedback`/`student learning` 都出现了,所以机器判据放过了它。
人工:跑偏
q05
metacognition strategies for secondary school students
Enhancing EFL Creative Reading Skills through a Metacognition-Based Strategy amo
返回「Enhancing EFL Creative Reading Skills through a Metacognition-Based Strategy」——元认知沾边,但场景是 EFL 创意阅读,不是中学生的一般学习策略。
人工:偏一点
q06
does homework improve academic outcomes
Does Homework Improve Academic Achievement? A Synthesis of Research, 1987–2003
「Does Homework Improve Academic Achievement? A Synthesis of Research」——正是要的(还是综述)。
人工:对
q07
teacher professional development impact on pupil attainment
Evaluating the Impact of Teacher Professional Development on Pupil Attainment in
「Evaluating the Impact of Teacher Professional Development on Pupil Attainment」——题目完全对准。
人工:对
q08
early years intervention for disadvantaged children
Prevention and Intervention Strategies for Promoting Resilience in Disadvantaged
未抽检
q09
how to support students with dyslexia in the classroom
Dyslexia in the L2 Classroom: Recognizing and Supporting Undiagnosed Students in
「Dyslexia in the L2 Classroom: Recognizing and Supporting Undiagnosed Students」——对准。
人工:对
q10
does collaborative learning work better than individual work
COLLABORATIVE LEARNING AND INDIVIDUAL WORK PERFORMANCE IN COWORKING SPACES
返回「COLLABORATIVE LEARNING AND INDIVIDUAL WORK PERFORMANCE IN COWORKING SPACES」——研究的是共享办公空间里的人,不是课堂里的学生。
人工:跑偏
q11
math mastery approach primary school evidence
Effects of Mastery Learning Approach on Secondary School Students’ Physics Achie
未抽检
q12
impact of school closures on learning loss
Learning loss due to school closures during the COVID-19 pandemic
未抽检
q13
how effective is retrieval practice for memory
Examining the episodic context account: does retrieval practice enhance memory f
未抽检
q14
parental involvement and academic achievement meta-analysis
Parental Involvement and Academic Achievement: A Meta-analysis
未抽检
q15
does mindfulness reduce test anxiety in students
The Effectiveness of Daily Mindful Breathing Practices on Test Anxiety of Studen
未抽检
q16
effective strategies for teaching english as a second language
EFFECTIVE STRATEGIES FOR TEACHING ENGLISH AS A SECOND LANGUAGE: A METHODOLOGICAL
未抽检
q17
impact of teacher expectations on student performance
Teacher Expectations And Student Performance: Understanding The Impact On Educat
未抽检
q18
how to reduce behaviour problems in the classroom
The interactionalist classroom management – a way to reduce the behaviour proble
未抽检
q19
is there evidence that smaller classes help disadvantaged pupils
Underachievement among disadvantaged pupils in Dutch primary education
未抽检
q20
does social and emotional learning improve academic outcomes
Social and Emotional Learning as a Public Health Approach to Education
未抽检

三、人工抽检发现的三个问题

四、结论

五、这份报告怎么复跑