1. BACKGROUND TO TEM 1
1.1 The ELT Syllabus 1
1.2 Objectives of the TEM Tests 1
1.3 History of the TEM Tests 1
1.4 Organization of the TEM Tests 6
2. VALIDATION STUDY 8
2.1 Aims of the Validation Study Project 8
2.2 Formulation of the Project Proposal 8
2.3 Organization of the Validation Project 9
2.4 Description of the Study 10
3. VALIDATION INSTRUMENTS 12
3.1 Test Specifications 12
3.2 Prototype Tests (TEM4/8-95) 13
3.3 External Measures 14
3.4 Questionnaires 14
4. INTERNAL STATISTICAL VALIDATION 18
4.1 TEM4-95 18
4.2 TEM8-95 30
5. EXTERNAL STATISTICAL VALIDATION 43
5.1 Concurrent Validity 43
5.2 Predictive Validity 48
5.3 Perceived Validity 48
6. ADMINISTRATIVE PROCEDURES OF THE TEM TESTS 53
6.1 The Testing Team in SISU 53
6.2 Item Writing 53
6.3 Trialling 55
6.4 Item Moderation 56
6.5 Marker Standardization 56
6.6 Score Reporting 60
6.7 Statistical Analysis 60
6.8 Organizational Structures for the TEM Test Administration 61
7. OVERALL SUMMARY 62
APPENDICES 65
Appendix Ⅰ Tables of Test Formats (1990-1996) 67
Appendix Ⅱ Prototype Tests(TEM4/8-95) 75
Appendix Ⅲ Project Framework 128
Appendix Ⅳ TEM Project Schedule 1993-1996 130
Appendix Ⅴ Test Specifications (TEM4/8) 134
Appendix Ⅵ Teachers' Assessment Form 169
Appendix Ⅶ TEM4 Questionnaires (to Teachers/Candidates/Administrators) 171
Appendix Ⅷ TEM8 Questionnaires (to Teachers/Candidates/Administrators) 189
Appendix Ⅸ Table 1: CITC and AIID for Listening (Original) 213
Appendix Ⅹ Table 1: CITC and AIID for Listening 233
Appendix Ⅺ List of PAR4/8 Universities 258
Appendix Ⅻ Table 1: Correlation of PAR4 with TEM4 259
Appendix ⅩⅢ TEM4 Replies to Open-ended Questions 270
Appendix ⅩⅣ TEM8 Replies to Open-ended Questions 276
Appendix ⅩⅤ TEM4 Summary Table of Objective Questions 282
Appendix ⅩⅥ TEM8 Summary Table of Objective Questions 290
Appendix ⅩⅦ Item Writer Training Package 297
Appendix ⅩⅧ Dictation Marking Scheme 300
Appendix ⅩⅨ Translation Marking Scheme 301
Appendix ⅩⅩ Composition/Note-writing Marker Training Pack 304
Appendix ⅩⅩⅠComposition/Note-writing Marker Reliability Study Data 309