<?xml version="1.0"?>
<feed xmlns="http://www.w3.org/2005/Atom" xml:lang="ru">
	<id>http://wiki.mipt.ru/index.php?action=history&amp;feed=atom&amp;title=Development%3AQuiz_UI_redesign%2Fusability_testing_of_August_2008%2FExecutive_summary</id>
	<title>Development:Quiz UI redesign/usability testing of August 2008/Executive summary - История изменений</title>
	<link rel="self" type="application/atom+xml" href="http://wiki.mipt.ru/index.php?action=history&amp;feed=atom&amp;title=Development%3AQuiz_UI_redesign%2Fusability_testing_of_August_2008%2FExecutive_summary"/>
	<link rel="alternate" type="text/html" href="http://wiki.mipt.ru/index.php?title=Development:Quiz_UI_redesign/usability_testing_of_August_2008/Executive_summary&amp;action=history"/>
	<updated>2026-05-06T23:02:14Z</updated>
	<subtitle>История изменений этой страницы в вики</subtitle>
	<generator>MediaWiki 1.42.1</generator>
	<entry>
		<id>http://wiki.mipt.ru/index.php?title=Development:Quiz_UI_redesign/usability_testing_of_August_2008/Executive_summary&amp;diff=11658&amp;oldid=prev</id>
		<title>Олег Давидович: 1 версия импортирована</title>
		<link rel="alternate" type="text/html" href="http://wiki.mipt.ru/index.php?title=Development:Quiz_UI_redesign/usability_testing_of_August_2008/Executive_summary&amp;diff=11658&amp;oldid=prev"/>
		<updated>2024-10-21T08:53:01Z</updated>

		<summary type="html">&lt;p&gt;1 версия импортирована&lt;/p&gt;
&lt;table style=&quot;background-color: #fff; color: #202122;&quot; data-mw=&quot;interface&quot;&gt;
				&lt;tr class=&quot;diff-title&quot; lang=&quot;ru&quot;&gt;
				&lt;td colspan=&quot;1&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;← Предыдущая версия&lt;/td&gt;
				&lt;td colspan=&quot;1&quot; style=&quot;background-color: #fff; color: #202122; text-align: center;&quot;&gt;Версия от 08:53, 21 октября 2024&lt;/td&gt;
				&lt;/tr&gt;&lt;tr&gt;&lt;td colspan=&quot;2&quot; class=&quot;diff-notice&quot; lang=&quot;ru&quot;&gt;&lt;div class=&quot;mw-diff-empty&quot;&gt;(нет различий)&lt;/div&gt;
&lt;/td&gt;&lt;/tr&gt;&lt;/table&gt;</summary>
		<author><name>Олег Давидович</name></author>
	</entry>
	<entry>
		<id>http://wiki.mipt.ru/index.php?title=Development:Quiz_UI_redesign/usability_testing_of_August_2008/Executive_summary&amp;diff=11657&amp;oldid=prev</id>
		<title>1&gt;Pilpi в 15:04, 23 августа 2008</title>
		<link rel="alternate" type="text/html" href="http://wiki.mipt.ru/index.php?title=Development:Quiz_UI_redesign/usability_testing_of_August_2008/Executive_summary&amp;diff=11657&amp;oldid=prev"/>
		<updated>2008-08-23T15:04:29Z</updated>

		<summary type="html">&lt;p&gt;&lt;/p&gt;
&lt;p&gt;&lt;b&gt;Новая страница&lt;/b&gt;&lt;/p&gt;&lt;div&gt;&amp;#039;&amp;#039;&amp;#039;Return to: [[Development:Quiz_UI_redesign|Quiz UI redesign]] |  [[Development:Quiz_Usability_portal|Quiz Usability portal]]&amp;#039;&amp;#039;&amp;#039;&lt;br /&gt;
&lt;br /&gt;
For novices, adding single questions to a quiz is now a breeze in terms of the Quiz edit UI, although there are issues with [[Development:Usability_testing_in_August_2008/Issues_found#Make_question_text_compulsory_default_field.2C_and_question_name_optional|question names]] and [[Development:Usability_testing_in_August_2008/Issues_found#Simplify_question_forms_.28progressive_disclosure.29|question forms]]. &lt;br /&gt;
&lt;br /&gt;
What is important to note when reading the issues is that all minor errors of the users are reported. In usability tests, we expect a certain amount of issues that arise from different amounts of experience using computers and also from different circumstances of the moment. As the concepts are not trivial, it is not a catastrophe if a user cannot perform a task at first time – users do realize that using something for the first time takes &amp;#039;&amp;#039;some&amp;#039;&amp;#039; amount of learning.&lt;br /&gt;
&lt;br /&gt;
I had one test subject on August 14&amp;lt;sup&amp;gt;th&amp;lt;/sup&amp;gt;, who had a complete design of an exam with him/her. This was a simple exam with &amp;lt;10 non-random questions of types essay, true/false and multiple choice. With the actual quiz editing form, s/he succeeded spectacularly: The problems that occurred were related to the names of the questions in Finnish (True/False was untranslated) and to the question forms.&lt;br /&gt;
&lt;br /&gt;
Main findings:&lt;br /&gt;
* The &amp;#039;&amp;#039;basic ideas &amp;#039;&amp;#039;help text of Quiz is helpful, if users find it. It is not easy enough to find as the default font for help is smaller than 1em. It needs an introduction to quiz pages.&lt;br /&gt;
* The Question bank window is not prominent enough, and it is not obvious to a novice what its purpose is. To a degree, this is acceptable since it is advanced functionality and that is why it is hidden by default, but it needs to be easier to identify (its title bar is way too subtle now)&lt;br /&gt;
* The Question bank window does not sufficiently respond to changes introduced from outside the window.&lt;br /&gt;
* Further tweak the graphical appearance of the UI closer to the OOo prototype.&lt;br /&gt;
* make it clear to users in the context of selecting a question type, what each question type means.&lt;br /&gt;
&lt;br /&gt;
=== Creating random questions can be yet simplified (but is still an advanced operation) ===&lt;br /&gt;
&lt;br /&gt;
When it comes to the editing UI itself, it works well otherwise but it is still too difficult for novices to create random questions. This is in part the fault of the somewhat complex conceptual system, but the UI could still make it more straightforward. The problem is, as the concepts are complex, making the UI simpler than the concepts would mislead users to false beliefs about the underlying conceptual system. A completely separate wizard/assistant might help alleviate this.&lt;br /&gt;
&lt;br /&gt;
During the tests it seemed though that with the new UI, users do not need to understand the concepts and their relationships thoroughly to successfully create random questions. Still, creating random questions is painful and with many of the six subjects that went through the actual test (todo: verify how many), I had to help them by telling them which on-screen instructions to focus on, even though they had read the “basic instructions of creating quizzes” introductory text. &lt;br /&gt;
&lt;br /&gt;
Nevertheless, all of the subjects eventually created one or two random questions with two essay questions in them successfully.&lt;br /&gt;
&lt;br /&gt;
== Issues that were solved from previous iteration ==&lt;br /&gt;
The following issues did not reappear in the final usability tests. Of course in theory it is impossible to prove they might &amp;#039;&amp;#039;sometime &amp;#039;&amp;#039;still appear. Issue numbers are from previous [[Development:Quiz_UI_redesign_-_prototype_testing_report|testing report]].&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_2]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_3]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_4]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_6]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_13]] (the test started from course front page)&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_16]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_22]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_24]] (for javascripted users, there is no button)&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_30]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_31]]&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
&lt;br /&gt;
== Issues from previous iteration that are still problematic ==&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_7]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_9]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_11]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_17]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_19|19]], [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_21|21]], &lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_20]]&lt;br /&gt;
&lt;br /&gt;
*[[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_25]]&lt;br /&gt;
&lt;br /&gt;
== Issues not directly related to quiz UI redesign - previous iteration, still issues ==&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_10]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_nr1]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_nr2]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_nr4]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_nr6]]&lt;br /&gt;
&lt;br /&gt;
* [[Development:Quiz_UI_redesign_-_prototype_testing_report#Issue_nr7_.28formerly_27.29]]&lt;/div&gt;</summary>
		<author><name>1&gt;Pilpi</name></author>
	</entry>
</feed>