Олег Давидович: 1 версия импортирована

2024-10-21T08:53:04Z

1 версия импортирована

← Предыдущая версия	Версия от 08:53, 21 октября 2024
(нет различий)

1>Mudrd8mz: Text replacement - "class="nicetable"" to "class="wikitable""

2021-07-14T13:24:39Z

Text replacement - "class="nicetable"" to "class="wikitable""

Новая страница

'''These statistics are designed for use with summative tests where students have just one attempt and complete that attempt.'''

== Test statistics ==

''Average grade'': For discriminating, deferred feedback, tests aim for between 50% and 75%. Values outside
these limits need thinking about. Interactive tests with multiple tries invariably lead to higher averages.

''Median grade'': Half the students score less than this figure.

''Standard deviation'': A measure of the spread of scores about the mean. Aim for values between 12% and
18%. A smaller value suggests that scores are too bunched up.

''Skewness'': A measure of the asymmetry of the distribution of scores. Zero implies a perfectly symmetrical
distribution, positive values a ‘tail’ to the right and negative values a ‘tail’ to the left.

[[Image:Skewness.jpg]]

Aim for a value of -1.0. If it is too negative, it may indicate lack of discrimination between students who do better than average. Similarly, a large positive value (greater than 1.0) may indicate a lack of discrimination near the pass fail border.

''Kurtosis'': Kurtosis is a measure of the flatness of the distribution.

A normal, bell shaped, distribution has a kurtosis of zero. The greater the kurtosis, the more peaked is the
distribution, without much of a tail on either side.

Aim for a value in the range 0-1. A value greater than 1 may indicate that the test is not discriminating
very well between very good or very bad students and those who are average.

''Coefficient of internal consistency (CIC)'': It is impossible to get internal consistency much above 90%.
Anything above 75% is satisfactory. If the value is below 64%, the test as a whole is unsatisfactory and
remedial measures should be considered.

A low value indicates either that some of the questions are not very good at discriminating between
students of different ability and hence that the differences between total scores owe a good deal to chance
or that some of the questions are testing a different quality from the rest and that these two qualities do not
correlate well – i.e. the test as a whole is inhomogeneous.

''Error ratio (ER)'': This is related to CIC according to the following table: it estimates the percentage of the
standard deviation which is due to chance effects rather than to genuine differences of ability between
students. Values of ER in excess of 50% cannot be regarded as satisfactory: they imply that less than half
the standard deviation is due to differences in ability and the rest to chance effects.

{| class="wikitable"
|-
! CIC
! ER
|-
| 100
| 0
|-
| 99
| 10
|-
| 96
| 20
|-
| 91
| 30
|-
| 84
| 40
|-
| 75
| 50
|-
| 64
| 60
|-
| 51
| 700
|}

''Standard error (SE)'': This is SD x ER/100. It estimates how much of the SD is due to chance effects and is a
measure of the uncertainty in any given student’s score. If the same student took an equivalent test, his
or her score could be expected to lie within ±SE of the previous score. The smaller the value of SE the
better the test, but it is difficult to get it below 5% or 6%. A value of 8% corresponds to half a grade
difference on a typical scale – if the SE exceeds this, it is likely that a substantial proportion of the
students will be wrongly graded in the sense that the grades awarded do not accurately indicate their true
abilities.

== Question statistics ==

''Facility index (F)'': The mean score of students on the item.

{| class="wikitable"
|-
! F
! Interpretation
|-
| 5 or less
| Extremely difficult or something wrong with the question.
|-
| 6-10
| Very difficult.
|-
| 11-20
| Difficult.
|-
| 20-34
| Moderately difficult.
|-
| 35-64
| About right for the average student.
|-
| 66-80
| Fairly easy.
|-
| 81-89
| Easy.
|-
| 90-94
| Very easy.
|-
| 95-100
| Extremely easy.
|}

''Standard deviation (SD)'': A measure of the spread of scores about the mean and hence the extent to which
the question might discriminate. If F is very high or very low it is impossible for the spread to be large.
Note however that a good SD does not automatically ensure good discrimination. A value of SD less than
about a third of the question maximum (i.e. 33%) in the table is not generally satisfactory.

''Random guess score (RGS)'': This is the mean score students would be expected to get for a random guess at
the question. Random guess scores are only available for questions that use some form of multiple choice.
All random guess scores are for deferred feedback only and assume the simplest situation e.g. for multiple
response questions students will be told how many answers are correct.

Values above 40% are unsatisfactory – and show that True/False questions must be used sparsely in summative tests.

''Intended weight'': The question weight expressed as a percentage of the overall test score.

''Effective weight'': An estimate of the weight the question actually has in contributing to the overall spread of
scores. The effective weights should add to 100% - but read on.

The intended weight and effective weight are intended to be compared. If the effective weight is greater
than the intended weight it shows the question has a greater share in the spread of scores than may have
been intended. If it is less than the intended weight it shows that it is not having as much effect in
spreading out the scores as was intended.

The calculation of the effective weight relies on taking the square root of the covariance of the question
scores with overall performance. If a question’s scores vary in the opposite way to the overall score, this
would indicate that this is a very odd question which is testing something different from the rest. And the
computer cannot calculate the effective weights of such questions resulting in warning message boxes
being displayed.

''Discrimination index'': This is the correlation between the weighted scores on the question and those on the
rest of the test. It indicates how effective the question is at sorting out able students from those who are
less able. The results should be interpreted as follows

{| class="wikitable"
|-
! Index
! Interpretation
|-
| 50 and above
| Very good discrimination
|-
| 30 – 50
| Adequate discrimination
|-
| 20 - 29
| Weak discrimination
|-
| 0 - 19
| Very weak discrimination
|-
| -ve
| Question probably invalid
|}

''Discrimination efficiency'': This statistic attempts to estimate how good the discrimination index is relative
to the difficulty of the question.

An item which is very easy or very difficult cannot discriminate between students of different ability,
because most of them get the same score on that question. Maximum discrimination requires a facility
index in the range 30% - 70% (although such a value is no guarantee of a high discrimination index).

The discrimination efficiency will very rarely approach 100%, but values in excess of 50% should be
achievable. Lower values indicate that the question is not nearly as effective at discriminating between
students of different ability as it might be and therefore is not a particularly good question.

--[[User:Phil Butcher|Phil Butcher]] 15:53, 27 September 2010 (UTC)

Development:Quiz report statistics - История изменений

Олег Давидович: 1 версия импортирована

1>Mudrd8mz: Text replacement - "class="nicetable"" to "class="wikitable""