Re: [Tikiwiki-devel] Quiz Development

[Michael S. Z. <ms...@go...>]

Random thoughts...

On Sun May 9 2004 19:23, Greg Martin wrote:
> George, in my real life I work for a major testing company.  There are few
> effective ways to prevent wholesale harvesting of questions without having
> huge pools of questions and ensuring no questions get's used more than one
> testing cycle.
>

'huge pools of questions...'
Well, actually, each question would need to be used only once.
Once it appears on any single questionare, never appear again.
Yup, that is a lot of questions.
So, how do you do that (without more teachers than students)...

> For somewhat lesser requirements, I suggest you add a feature to collect
> questions as a pool and have the quiz engine present them as a random
> collection rather than sequentially.  
>

'collect questions as a pool...'
That might be the direction of the answer...
For each question on a subject, require an answer;
plus
two or more "original" questions on the subject.
Then it is only a logistical problem to find a way to review all of
the "original" questions.

It is one level of understanding a subject to be able to answer
a question;
It is a higher level of understanding that subject to form a
good question (with possible answers).  

So the good questions submitted would become a "credit multiplier" 
of the test score.  Questions mined (or copied from another student)
would be a "credit penalty".

To deal with the logistics of question review...
while breaking the "appears only once" rule...
That could become another "extra credit" task of the students...
To give their scores of how "good" a question would be if used
on some future test (far in the future).

Mike