EDU431 : Test Development & Evaluation

Course Overview

Course Synopsis

This course introduces key concepts and methods of educational assessment including tools like portfolios rubrics and standardized tests. It focuses on applying developing and analyzing assessment instruments to improve teaching and learning. Students learn to design valid and reliable assessments aligned with national standards and diverse learner needs. The course also emphasizes ethical practices data use for instructional improvement and integration of modern assessment technologies.

Course Learning Outcomes

The course introduces broad concepts theories and practices in test development and assessment in education

  • Explain key concepts frameworks and assessment methods anecdotal records peer appraisal portfolios etc. by describing their theoretical foundations advantages and limitations in educational settings.
  • Apply assessment tools test development theories and standardized testing by interpreting item analysis scoring rubrics and test results in alignment with assessment standards.
  • Develop valid and reliable assessment tools by designing diverse question formats with clarity fairness and effectiveness.
  • Utilize assessment results by analysing data to refine teaching strategies and student learning for accurate and secure test administration.
  • Design assessment strategies by aligning with national policies selecting appropriate test items methods to diverse learning needs and different assessment formats for effective student evaluation.
  • Integrate ethical considerations regulatory guidelines advanced methodologies and technology by applying best practices in test administration assessments for validity and continuous professional development.


Course Calendar

1 Measurement, Assessment and Evaluation
2 Classroom Assessment
3 Types of Assessment
4 Use of Assessment in Classroom Instruction Placement and Diagnostic
5 Use of Assessment in Classroom Instruction – Formative and Summative Assessment
6 Types of Assessment Methods of Interpreting Results

7 Role of national curriculum in assessment
8 Connecting all four levels in curriculum
9 Curriculum Development at Higher Education Level

10 Taxonomies of Educational Objectives and Assessment
11 Bloom’s Taxonomy and SOLO Taxonomy
12 SOLO Taxonomy
13 Depth of Knowledge
14 Bloom's Taxonomy
15 Bloom’s Taxonomy (Continued)
16 Revised version of Bloom’s Taxonomy
17 Instructional Objectives
Assignment

18 Educational Decisions making
19 Types of test
20 Norm- Referenced Assessment (NRT)
21 Criterion Referenced Assessment
22 Characteristics of Criterion Referenced Assessment
23 Difference between NRT and CRT
24 Formative Assessment
25 Functions of Formative Assessment
26 Summative Assessment
27 Functions of Summative Assessment

28 Table of specification
29 Concept of table of specification
30 Elements and Appropriateness in Table of Specification
31 Balance among Learning Objectives and their Weight in table of specification
32 Balance among the Levels of Learning Objectives in Table of Specification
Quiz 1

33 Selecting Pre-designed test
34 Standards for selecting appropriate test
35 Standards for selecting appropriate test (Continue)
36 Fairness in selecting appropriate tests
GDB

37 Characteristics of Good Test
38 Nature of validity
39 Evidences of validity: Content validity
40 Evidences of validity: Construct validity
41 Evidences of validity: Criterion validity
42 Evidences of validity: Consequence validity
43 Nature of reliability
44 Method of estimating reliability
45 Method of estimating reliability: Test-retest
46 Method of estimating reliability: Equivalent form Method
47 Method of estimating reliability: Split Half Method
48 Method of estimating reliability: Kuder-Richardson Method
Quiz 2

49 Anecdotal records
50 Effective use of Anecdotal Records
51 Advantages and limitations of Anecdotal Records
52 Peer appraisal
53 Portfolio
54 Purpose of Portfolio
Mid term

55 Selection of item in a test
56 Characteristics of MCQs
57 Uses of MCQs
58 Uses of MCQs (Continue 1)
59 Uses of MCQs (Continue 2)
60 Advantages and Limitations of MCQs
61 Advantages and Limitations of MCQs (continue 1)
62 Advantages and Limitations of MCQs (continue 2)
63 Suggestions for constructing MCQs
64 Suggestions for constructing MCQs (continue 1)
65 Suggestions for constructing MCQs (continue 2)
66 Suggestions for constructing MCQs (continue 3)
67 Suggestions for constructing MCQs (continue 4)
68 Suggestions for constructing MCQs (continue 5)
69 Suggestions for constructing MCQs (continue 6)
70 Suggestions for constructing MCQs (continue 7)
71 True/ False items
72 Uses of True/ False items
73 Advantages and limitations of True-false
74 Suggestions for Constructing True-false (alternative form) items
75 Suggestions for Constructing True-false items (Continue 1)
76 Suggestions for Constructing True-false items (Continue 2)
77 Suggestions for Constructing True-false items (Continue 3)
78 Suggestions for Constructing True-false items (Continue 4)
79 Suggestions for Constructing True-false items (Continue 5)
80 Suggestions for Constructing True-false items (Continue 6)
81 Matching Exercises
82 Uses of Matching Exercises
83 Advantages and limitations of Matching Exercises
84 Suggestions for constructing Matching Exercises
85 Suggestions for constructing Matching Exercises (Continue 1)
86 Suggestions for constructing Matching Exercises (Continue 2)
87 Suggestions for constructing Matching Exercises (Continue 3)
88 Developing short answer/completion questions
89 About developing short answer/completion questions
90 Uses of short answer/completion questions
91 Advantages of short answer/completion questions
92 Suggestions for constructing short answer/completion questions
93 Suggestions for constructing short answer/completion questions (Continue 1)
94 Suggestions for constructing short answer/completion questions (Continue 2)
95 Suggestions for constructing short answer/completion questions (Continue 3)
96 Suggestions for constructing short answer/completion questions (Continue 4)

97 Creating Constructed Response Test Items
98 Guidelines for constructing Restricted response essay type items
99 Extended response essay type Items
100 Guidelines for writing essay type items
101 Scoring Rubrics for Essay Type Items
102 Types of Scoring Rubrics
103 Holistic Scoring Rubric

104 Theories of test development
105 Item Analysis: Information provided by item analysis
106 Appropriate time for Item Analysis
107 Test theories in item analysis
108 Item Difficulty in Classical Test Theory (CTT)
109 Item Discrimination in CTT
110 Item Characteristic Curve (ICC) in Item Response Theory
111 Item Difficulty in Item Response Theory
112 Item Discrimination in Item Response Theory (IRT)
113 Probability of Guessing in Item Response Theory (IRT)
Quiz 3

114 Concept and importance of assembling and administration of tests
115 Assembling Test: Recording items
116 Assembling Test: Packing the test
117 Assembling Test: Packing the test (Continue 1)
118 Assembling Test: Packing the test (Continue 2)
119 Assembling Test: Packing the test (Continue 3)
120 Assembling Test: Reproducing the test
121 Assembling Test: Things to remember when administering test
122 Assembling Test: Things to remember when administering test (Continue 1)
123 Assembling Test: Things to remember when administering test (Continue 2)
124 Assembling Test: Things to remember when administering test (Continue 3)

125 Scoring Criteria: Scoring Rubric
126 Scoring Rubric for Essay Type Questions
127 Elements of Rubric
128 Holistic Scoring Rubric.
129 Approaches to Apply Holistic Scoring Rubric
130 Analytic Scoring Rubric
131 Advantages and disadvantages of Analytic Rubric

132 Standardized Achievement Test
133 Characteristics of Standardized Achievement Test
134 Standardized Test versus Informal Classroom Test
135 Standardized test batteries and guidelines for SAT batteries
136 SAT in specific area, separate content oriented test, reading test
137 Concept of Interpreting Test Scores
138 Method of Interpreting Test Scores
139 Criterion-referenced Interpretation
140 Guidelines for Criterion-referenced Interpretation
141 Norm-referenced Interpretation

142 High Stake Testing
143 High Stake Testing in Pakistan
144 Recommendations for Effective HST
145 Preparation for Effective HST
146 Institutions involve in assessment
147 Institutions involve in assessment.
148 National Education Assessment System
Final term