|
From: <gus...@us...> - 2003-08-30 15:21:43
|
Update of /cvsroot/aimmath/moodle/lang/en/help/aim_quiz
In directory sc8-pr-cvs1:/tmp/cvs-serv27625/lang/en/help/aim_quiz
Added Files:
admin_quiz.html admin_sourcedir.html admin_sourcefile.html
admin_subject.html analyze_question.html analyze_quiz.html
analyze_subject.html review_quiz.html review_subject.html
try_question.html try_quiz.html
Log Message:
I have made things more moodly by 1) putting the AiM pages into boxes with white background and 2) adding help icons to administrative links. The help files are copied from AiM's teacher.html and still need to be adapted.
--- NEW FILE: admin_quiz.html ---
<a name='admin_quiz'><h2>The quiz administration page</h2></a>
<p>
The quiz admin pages can be accessed from the <a
href='#admin_subject'>subject admin page</a>.
</p>
<p>
The toolbar at the top of the subject admin page has links allowing
you to save or reload options for the quiz, to <a href='#try_quiz'>try
it</a>, to <a href='#admin_sourcedir'>browse the source files</a> for
the questions in the quiz, and to <a href='#analyze_quiz'>view the
results</a>.
The options that can be changed are as follows:
<ul>
<li><b>The title:</b> a descriptive title for the quiz.
</li>
<li><b>The due date:</b> the date after which students will be
allowed to see the solutions, but will not be allowed to change
their answers. You can set this to 'none' if desired.
</li>
<li><b>The weight:</b> if the subject has quizzes
<tt><font color='green'>q<sub>1</sub>,...,q<sub>n</sub></font></tt>
with weights
<tt><font color='green'>w<sub>1</sub>,...,w<sub>n</sub></font></tt>,
and a student's marks are
<tt><font color='green'>m<sub>1</sub>,...,m<sub>n</sub></font></tt>,
then the overall score is taken to be
<tt><font color='green'>w<sub>1</sub>m<sub>1</sub>+...+w<sub>n</sub>m<sub>n</sub></font></tt>.
</li>
<li><b>The access level:</b> this can be 'all', 'registered' or
'none'. If it is 'registered', then guests cannot access the quiz;
if it is 'none', then no students can access the quiz. The quiz
selection page shown to students will not include quizzes that they
do not have permission to access.
</li>
<li><b>The mode:</b> this can be 'practice', 'assessment' or
'strict'. In <em>practice mode</em>, students can try the questions
repeatedly and the system will tell them whether their answers are
right or wrong (except for multiple choice questions), and may give
some additional feedback. At any stage, students can ask to see the
solutions. After that, they can try the quiz again, but it will be
randomized differently. The due date has no effect. In
<em>assessment mode</em>, the system will again tell students
whether their answers are correct, but it will not allow them to
see the solutions until the due date has passed, at which point they
will not be allowed to change their answers. <em>Strict mode</em>
is similar except that before the due date, the system will give the
students no feedback at all about the correctness of their answers
(although it will still give feedback about syntax and type
checking.)
</li>
</ul>
<a name='quiz_table'><h3>The question table:</h3></a>
After the quiz options form, there is a table of questions.
<p>
Some quizzes (for example, those under constructions) may be hidden
from students. By default, these are also not shown in the subject
administration page; however, you can include them by clicking 'Show
unused questions'. Unless <a href='#selector'>selector functions</a>
are in use, all visible questions will be included in the quiz, and
hidden questions will be excluded. There is also a link at the top of
the quiz marked 'Use all questions', which forces all available
questions to be unhidden and included in the quiz.
</p>
<p>
Unless the <a href='#selector'>random question order</a> flag is
set, questions will appear in the quiz in the same order that they
appear in the table. This order can be changed by editing the
question numbers. For example, suppose that question 1 is called
easy_sum, question 2 is called hard_sum, and question 3 is called FLT.
If you change the 3 to 1.5 and then click 'Save Options', then the
page will be regenerated with easy_sum as question 1, FLT as question
2, and hard_sum as quiz 3.
</p>
<p>
Each question has various links attached to it.
<ul>
<li>The 'Edit' link leads to the <a href='#admin_sourcefile'>source
file editing page</a>, which allows you to edit and recompile the
source file in which the question was defined. This will only work
if the compiled file contains information about its ancestry, and
you still have the source file.
</li>
<li>The 'Try' link leads to the <a href='#try_question'>question
trial</a> page, which has many convenient facilities for testing and
editing.
</li>
<li>The 'Results' link leads to the <a
href='#analyze_question'>question analysis page</a>, which has
powerful facilities for analyzing how students performed and the
kinds of errors that they made.
</li>
<li>The 'Hide' link ensures that the question is not included in the
quiz, and the 'Delete' link deletes the compiled question file.
The corresponding source file is not deleted, however.
</li>
</ul>
<a name='selector'><h3>Selection and reordering:</h3></a>
After the question table, there are some facilities for random
selection and reordering of questions. Firstly, you can check the
'random question order' box to say that order of the questions should
be randomly reshuffled before the quiz is sent to the student.
Secondly, there is a text area in which you can enter arbitrary Maple
text to define a selector function or a list of selector functions.
If the box is empty, then all questions are used. If there is a
single selector function <font color='green'><tt>p</tt></font>, then
all questions <font color='green'><tt>Q</tt></font> for which
<font color='green'><tt>p(Q)=true</tt></font> are used. If there is a
list
<font color='green'><tt>[p<sub>1</sub>,...,p<sub>n</sub>]</tt></font>
of selector functions, then n questions <font
color='green'><tt>Q<sub>1</sub>,...,Q<sub>n</sub></tt></font> are
selected randomly, such that <font
color='green'><tt>p<sub>i</sub>(Q<sub>i</sub>)</tt></font> holds for
all i and all the <font color='green'><tt>Q<sub>i</sub></tt></font>
are different. An error is returned if it is not possible to choose
such a list. The list is then shuffled if random reordering is turned
on. In all these functions, the argument <font
color='green'><tt>Q</tt></font>, is an object of the class
`aim/Question`. Most commonly, the function will just look at
<font color='green'><tt>Q['Keywords']</tt></font>, which is the list
of strings specified as keywords in the question file.
--- NEW FILE: admin_sourcedir.html ---
<a name='admin_sourcedir'><h2>The source directory page</h2></a>
This can be accessed from the <a href='#admin_quiz'>quiz admin
page</a>. It displays a list of <a href='format.html'>question source
files</a>, which may define one or more questions. Each source file
has links as follows:
<ul>
<li>The 'Edit' link leads to the <a href='#admin_sourcefile'>source
file editing page</a>, which allows you to edit and recompile the
file. In fact, the file is automatically recompiled every time you
visit this page. Note that there is also a link in the toolbar
allowing you to recompile all files simultaneously. A box will pop
up to alert you if any files cause problems, and then you can edit
and compile them individually.
</li>
<li>The 'Download' link allows you to download the source file to
your own computer (and thus use a proper editor to change it).
</li>The 'Copy', 'Rename' and 'Delete' links have the obvious
function.
</li>
<li>At the bottom of the page there is a form that you can use to
create a new source file, or to upload one from your own computer.
(Even if you are logged on to the server, this is a convenient way
to ensure that things get put in the right place.)
</li>
</ul>
--- NEW FILE: admin_sourcefile.html ---
<a name='admin_sourcefile'><h2>The source editing page</h2></a>
<p>
This can be accessed from various places, including the <a
href='#admin_quiz'>quiz home page</a> and the <a
href='#try_question'>question trial page</a>.
</p>
<p>
The main part of the page is a text area in which you can edit the
source code for a question or a list of questions. Every time you
visit the page, AiM will attempt to recompile the file. Underneath
the editing area, you will see the results. For each question that
compiled successfully, there is a link to the <a
href='#try_question'>question trial page</a> that you can use to check
that the question is working properly. For each question that did not
compile successfully, there is an error message, which may or may not
be comprehensible. If AiM is able to determine the precise location
of the error, it will be marked with a blinking red marker.
</p>
<p>
After you have edited the file, you can click on 'Save and Recompile'
to save the changes and compile the file again. Alternatively, you
can discard your changes by clicking on 'Reload'. There is another
use for this: if you are working on the server, you can edit the
source file directly using a proper editor, save your changes, and
then click 'Reload' to make AiM notice the changes and recompile the
file.
</p>
<p>
The toolbar also contains a 'Download' button allowing you to save the
source file to your own hard disk.
</p>
--- NEW FILE: admin_subject.html ---
<a name='admin_subject'><h2>The subject administration page</h2></a>
<p>
The toolbar at the top of the subject admin page has links allowing
you to save or reload options for the subject and to <a
href='help.php?module=aim_quiz&file=analyze_subject.html'>view the results</a>.
The options that can be changed are as follows:
<ul>
<li><b>The title:</b> a descriptive title for the course.
</li>
<li><b>The admin email address:</b> for technical questions specific
to this subject (including questions about registration and
passwords).
</li>
<li><b>The teacher email address:</b> for mathematical questions
about this subject.
</li>
<!--
<li><b>The total value:</b> AiM can automatically assign an overall
numerical mark for all the quizzes in the subject. If you specify a
total value, then overall marks will be scaled out of that value.
If you leave the box blank, then the total value will just be the
sum of the weighted values of the various quizzes. <font
color='red'>(not currently implemented)</font>
</li>
-->
<li><b>The security level:</b> If this is set to "high", you will
need to reenter your password for every operation that you perform.
If it is set to "low", then your password will be stored in the
browser, in a form which is not at all difficult to extract. Thus,
if you use a publicly accessible terminal, you will need to be very
careful to close the browser when you have finished.
</li>
<!--
<li><b>The registration policy:</b> If this is set to "assigned", then
the system will expect you to supply a list of student ID's, with
names, email addresses and passwords. Guest access may or may not
be allowed as well. The other possible value is "self", which
should allow students to register themselves, but this is <font
color='red'>not yet implemented</font>.
</li>
-->
<li><b>The guest policy:</b> If this is set to "yes", then guests can
access the subject anonymously. Answers that they supply will not
be recorded on disc (although the hidden parameter mechanism means
that they will be stored in the guest's browser until s/he closes it
down). There is an option on the <a href='#admin_quiz'>quiz
administration page</a> allowing you to disallow guests from
accessing particular quizzes.
</li>
<li><b>The password</b>
</li>
</ul>
<a name='quiz_table'><h3>The quiz table:</h3></a>
After the subject options form, there is a table of quizzes.
<p>
Some quizzes (for example, those under constructions) may be hidden
from students. By default, these are also not shown in the subject
administration page; however, you can include them by clicking 'Show
hidden quizzes'.
</p>
<p>
Quizzes are listed on the <a href='#admin_subjecthome'>subject home
page</a> in the same order as they appear in the table. This order
can be changed by editing the quiz numbers. For example, suppose
that Addition is quiz 1, Multiplication is quiz 2, and Division is
quiz 3. If you change the 3 to 1.5 and then click 'Save Options',
then the page will be regenerated with Addition as quiz 1, Division
as quiz 2, and Multiplication as quiz 3.
</p>
<p>
Each quiz has various links attached to it.
<ul>
<li>The 'Try' link leads to the <a href='#try_quiz'>quiz trial</a>
page; this provides more information than you would get by simply
logging on as a student, and it works even when the quiz is hidden
from students.
</li>
<li>The 'Edit' link leads to the <a href='#admin_quiz'>quiz admin</a>
page, which allows you to set options for the quiz and perform
various operations on the questions.
</li>
<li>The 'Source' link leads to the <a href='#admin_sourcedir'>source
directory page</a>, allowing you to browse the <a
href='#format.html'>question source files</a> for the quiz.
</li>
<li>The 'Results' link leads to the <a href='#analyze_quiz'>quiz
results page</a>.
</li>
<li>The 'Hide' link hides the quiz from students, whereas the
'Delete' link deletes everything associated with it: source files,
question files, student records, the lot.
</li>
</ul>
<p>
You can create a new quiz by entering a name in the box at the bottom
of the table, and clicking 'Create'. The name should be short and
alphanumeric so that it can be used to construct file names. This
will pop up a new <a href='#admin_quiz'>quiz admin page</a>, allowing
you to set the quiz options (including a more verbose title if
required) and so on. Note that newly created quizzes are hidden by
default. You will need to reload the subject administration page and
unhide the new quiz before it will be visible to students.
</p>
<a name='student_finder'><h3>The student finder:</h3></a>
At the bottom of the subject admin page there is a form allowing you
to find a student in the register. There are boxes for the ID,
first name, surname and email address. Enter whatever information you
know, and click the 'Find' link to pop up a <a
href='#admin_student'>student admin page</a> (or possibly a list of
choices, if there were multiple hits). Wildcards are not supported.
--- NEW FILE: analyze_question.html ---
<a name='analyze_question'><h2>The question results page</h2></a>
<p>
This can be accessed from various places, including the <a
href='#admin_quiz'>quiz admin page</a> and the <a
href='#analyze_quiz'>quiz results page</a>.
</p>
<p>
The purpose of the page is to present summary information about
attempts that students have made at a particular question. This is
based on a table that, like the subject and quiz results tables, is
not automatically updated when you visit the page. You can click the
'Reanalyze' link to update the table; a line near the top of the page
will tell you when this was last done. The 'Resummarize' link allows
you to change how the information in the table is summarized; for
this, the table itself does not need to be updated.
</p>
<p>
The results summary is shown at the bottom of the page. Initially, it
will just say something like "x 123", meaning that there are
123 attempts at the question to consider. (Here, successive identical
attempts by the same student are only counted once.) To get more
interesting information, you need to use the 'Constraints' form and
the 'Splitting keys' form.
</p>
<p>
The constraints form allows you to restrict attention to a subset of
the attempts that have been made.
<ul>
<li>By setting the 'Validity' selection box to 'valid', you can
restrict attention to attempts that were syntactically valid.
The other possibilities are 'invalid' or 'either'.
</li>
<li>Recall that students are allowed to submit answers to be checked
for validity, without having them marked. In fact, AiM computes
the mark anyway, but does not use it to determine the student's
final score. By default, attempts are included in the analysis
whether or not the student asked for them to be marked. You can
restrict attention to attempts that received an official mark by
setting the 'Marking' selection box to 'marked'.
</li>
<li>Using the 'Raw mark' selection box, you can restrict attention to
attempts that received a mark of zero, or a nonzero mark, or less
than the full mark, or the full mark. The word 'raw' means that
these are the marks before applying penalties for previous
incorrect attempts.
</li>
<li>Students will generally make many attempts at any given question,
and by default, they are all included in the analysis. You can
use the 'Finality' selection box to look only at final attempts.
</li>
</ul>
</p>
<p>
The splitting keys form can be used to specify how the attempts should
be divided up.
<ul>
<li>Suppose you set the left hand box to 'Validation note' and leave
the others at 'none', and then click 'Resummarize'. The
resulting page will list all the validation notes that occurred,
with their frequencies. These will generally be AiM-generated
notes, like "bad brackets" or "parse error", so you will get a
feel for how much trouble the students are having with Maple
syntax.
</li>
<li>Similarly, you could set the left hand box to 'Answer note' to
count the number of answers in various different classes. These
notes can be set using the function `aim/SetAnswerNote` in your
marking procedure. Using facilities in the package `aim/Int`,
for example, you can arrange for the note to be set to 'Naive
substitution type 1' whenever a student says that the integral of
f(x)<sup>n</sup> is f(x)<sup>n+1</sup>/(n+1); you would then be
able to count the number of errors of this type.
</li>
<li>You can also split the attempts according to their question
notes. These notes are generally set by a note> flag in a
question file; they depend only on the question and on how it was
randomized, not on the answer offered by the student. The note>
flag will often be arranged so that the question note completely
determines the question version.
</li>
<li>You can split attempts according to the students' answers, but
it may not be helpful to compare answers to different versions of
the question. In this case, you can set the first selection box
to 'Question note' and the second box to 'Answer'. The resulting
page will list all the question notes that occurred, and for each
question note, will list all the corresponding answers and their
frequencies. In some cases it may be informative to look at the
'Raw answer' (ie the string as typed by the student) rather than
the 'Answer' (constructed by parsing the raw answer and doing
some very mild simplification).
</li>
<li>The process can be iterated to split the attempts using up to
four different keys. The possible keys are the question note,
the validation note, the answer note, the raw answer, the answer
and the raw mark.
</li>
</ul>
</p>
--- NEW FILE: analyze_quiz.html ---
<a name='analyze_quiz'><h2>The quiz results page</h2></a>
<p>
The quiz results page can be accessed from the <a
href='#admin_quiz'>quiz admin page</a> or the <a
href='#admin_subject'>subject admin page</a> or the <a
href='#analyze_subject'>subject results page</a>.
</p>
<p>
This pages shows a table of students' results on this quiz. When
there are hundreds of students, it takes some time to scan through all
the results directories to prepare this table, so it is not
automatically kept up to date. At the top of the page you can see the
time at which the table was last updated, and you can refresh it by
clicking the 'Reanalyze' link on the toolbar. The toolbar also has a
link that you can click to download the results as a
tab-separated-values file, which can be imported into most spreadsheet
programs.
</p>
<p>
The table mostly contains numbers, but for students with a mark of
zero there are various special symbols to indicate whether they
actually attempted the question, submitted any syntactically valid
answers, and so on. The codes are explained at the bottom of the
table.
</p>
<p>
Along the left edge of the table, there are links allowing you to <a
href='#review_quiz'>review</a> all the results for a particular
student. Along the top edge, there are links to a table of questions
at the bottom of the page. This table in turn contains descriptions
of the questions, together with links to the <a
href='#admin_sourcefile'>source editing pages</a>, the <a
href='#try_question'>trial pages</a>, and the <a
href='#analyze_question'>results pages</a> for the various questions.
At the top of the results table, there are also links allowing you to
re-sort the table in name order, in order of student ID's, or in
descending mark order.
</p>
--- NEW FILE: analyze_subject.html ---
<a name='analyze_subject'><h2>The subject results page</h2></a>
<p>
The subject results page can be accessed from the <a
href='help.php?module=aim_quiz&file=admin_subject'>subject admin page</a>.
</p>
<p>
This pages shows a table of students' results in this subject. When
there are hundreds of students, it takes some time to scan through all
the results directories to prepare this table, so it is not
automatically kept up to date. At the top of the page you can see the
time at which the table was last updated, and you can refresh it by
clicking the 'Reanalyze' link on the toolbar. The toolbar also has a
link that you can click to download the results as a
tab-separated-values file, which can be imported into most spreadsheet
programs.
</p>
<p>
The table mostly contains numbers, but for students with a mark of
zero there are various special symbols to indicate whether they
actually accessed the quiz, submitted any nonempty answers, and so
on. The codes are explained at the bottom of the table.
</p>
<p>
Along the left edge of the table, there are links allowing you to <a
href='help.php?module=aim_quiz&file=review_subject'>review</a> all the results for a particular
student. Along the top edge, there are links to a table of quizzes at
the bottom of the page. This table in turn contains links to the <a
href='help.php?module=aim_quiz&file=admin_quiz'>admin pages</a>, the <a href='help.php?module=aim_quiz&file=try_quiz'>trial
pages</a>, and the <a href='help.php?module=aim_quiz&file=analyze_quiz'>results pages</a> for the
various quizzes. At the top of the results table, there are also
links allowing you to re-sort the table in name order, in order of
student ID's, or in descending mark order.
</p>
--- NEW FILE: review_quiz.html ---
<a name='review_quiz'><h2>The quiz review page</h2></a>
<p>
This page can be used to review the answers and marks of a particular
student on a particular version of a particular quiz. The details at
the top include the seed that was used for randomization. The toolbar
contains links to the <a href='#admin_subject'>quiz admin page</a> and
the <a href='#admin_student'>student admin page</a>, as well as a link
allowing you to send email to the student (if their address is in the
register). There is also a link allowing you to include the quiz
solutions. They are not shown by default, so that you can access this
page with the student looking over your shoulder if you wish.
</p>
<p>
The body of the page contains the quiz, essentially in the form that
it was shown to the student. However, there are no boxes in which to
enter answers. Instead, there is a table showing all the different
raw answers that were entered by the student. For each answer, the
table shows
<ul>
<li>The text of the answer</li>
<li>Whether the answer was syntactically valid</li>
<li>Whether the student asked for the answer to be marked, or merely
validated
</li>
<li>The raw mark for this answer (ie the mark before subtraction of
penalties for previous incorrect attempts)
</li>
<li>The number of successive times that this answer was submitted
(presumably while the student was altering answers to other
questions in the quiz).
</li>
<li>A link allowing you to try the question, with randomization set
up so that you get the same version as the student, and the
student's answer filled in
</li>
</ul>
At present there is no facility to change the student's answers or
marks.
</p>
--- NEW FILE: review_subject.html ---
<a name='review_subject'><h2>The subject review page</h2></a>
<p>
This page can be used to review the results for a particular student
on all the quizzes in the subject. The toolbar contains links to the
<a href='#admin_subject'>subject admin page</a> and the <a
href='#admin_student'>student admin page</a>, as well as a link
allowing you to send email to the student (if their address is in the
register). The body of the page is a table of quizzes that the
student has attempted, showing the marks obtained, and a link you can
follow to see the details of their answers. For quizzes in practice
mode, there may be records for several different versions of the
quiz. The record listed first is always for the most recent version,
but the others are in no particular order. You can click on the quiz
titles to go to the relevant <a href='#admin_quiz'>quiz admin
pages</a>.
</p>
--- NEW FILE: try_question.html ---
<a name='try_question'><h2>The question trial page</h2></a>
<p>
This can be accessed from various places, including the <a
href='#admin_quiz'>quiz home page</a> and the <a
href='#review_quiz'>quiz review page</a>.
</p>
<p>
This page is broadly the same as what a student would see when
attempting the question, with some modifications. Firstly, the seed
used to randomize the question is displayed at the top, in an editable
box. If you access the trial page from the quiz review page, then the
seed will be set so that you see the same version of the question as
the student whose results you were reviewing. In other cases, the
seed will be chosen randomly.
</p>
<p>
Next, when you first access the page, the answer box will be filled in
automatically. If you come from the review page, you will see the
answer provided by the student whose results you are reviewing. If
you come from anywhere else, the answer box will initially contain the
right answer.
</p>
<p>
Below the answer box, you will see two links allowing you to mark the
question, or to generate a new version with a different seed. If you
change the seed by hand, then the value that you entered will be used;
otherwise, a new value will be generated randomly.
</p>
<p>
Below that, you will see the usual feedback about the correctness or
otherwise of the answer. You may also see a question note, validation
note or answer note, which may have been generated explicitly by code
in the question source file, or by AiM's internal mechanisms.
</p>
<p>
Finally, the right answer and solution are always displayed.
</p>
--- NEW FILE: try_quiz.html ---
<a name='try_quiz'><h2>The quiz trial page</h2></a>
This can be accessed from the <a href='#admin_subject'>subject admin
page</a> or the <a href='#admin_quiz'>quiz admin page</a>. It is
essentially just an amalgam of the <a href='#try_question'>question
trial</a> pages for the various questions, so it will not be discussed
in more detail.
|
