ontoucp.org

discourse analysis and modeling questionnaire

This questionnaire helps us to evaluate the intuitivity of the discourse modeling language and consists of four sections: general information, discourse model analysis, discourse modeling and further comments. Please fill in the „General Information“ section (1-3) that provide us with information on the background knowledge of the test person. If you have analyzed a provided discourse model, fill in the „Discourse Model Analysis“ section (4-13). If you have also model a discourse, please fill in also the „Discourse Modeling“ section (14-24).

General Information					top
1	How much experience in „User Interface Implementation“ do you have?	very much			almost none
2	How much experience in „Interaction Design“ do you have?	very much			almost none
3	What is your profession?
3a	What is your name?
3b	What is your email?
Discourse Model Analysis					top
4	Rate the overall difficulty to understand the discourse model of the provided example.	very easy			very difficult
5	Rate the intuitiveness/comprehensibility of the following RST relations (if your example does not include all relations, omit the rating for the ones not present in the example):
	Annotation	very intuitive / comprehensible			not comprehensible at all
	Background
	Condition
	Contrast
	Elaboration
	Joint
	Result
	Sequence
	Title
6	Rate the intuitivity/comprehensibility of the following Communicative Acts (if your example does not include all communicative acts, omit the rating for the ones not present in the example):
	ClosedQuestion	very intuitive / comprehensible			not comprehensible at all
	OpenQuestion
	Answer
	Informing
	Request
	Accept
	Reject
	Offer
7	Do you believe that there are too many types of RST Relations?	yes		no
8	Do you believe that there are too many types of communicative acts?	yes		no
9	Which modeling concept is the hardest one to understand?
10	Would you categorize the discourse specification language as a declarative or procedural language?	declarative		procedural
11	Is the graphical notation of the language easy to understand?	very easy			very difficult
12	How easy can you trace back parts of the resulting example user interface to the elements in the discourse model?	very easy			very difficult
13	Do you believe that there are discourse model elements that cannot be associated with any widgets of the generated user interface example? If so, which ones?	yes		no
13
Discourse Modeling					top
14	What was your ratio between the effort spent on getting familiar with the language and the effort spent on the actual modeling process?	1:1	2:1	3:1	4:1
14		other ratio:
15	How high do you estimate the quality of your created model?	high			low
16	How often did your model undergo substantial changes?	often			never
17	If your model underwent substantial changes, what was the reason for the changes?
18	Which was the most difficult problem to solve during modeling?
19	How difficult was the selection between different communicative acts (e.g. choosing between Question and Offer or Request and Offer or Answer and Accept)?	very easy			very difficult
20	How difficult was the selection of appropriate RST relations?	very easy			very difficult
21	Please provide us with a rationale for each selected RST relation type.
22	Did you have enough kinds of communicative acts during modeling? If not, which kind of communicative act did you miss?	yes		no
22		Missed:
23	Did you have enough kinds of RST relations during modeling? If not, which kind of RST relation did you miss?	yes		no
23		Missed:
24	Did you have any problems building up a tree structure? If yes, which ones (e.g., which relation becomes the root of the tree)?	yes		no
24		Problems:
25	Please provide your discourse model:	Discourse model file (.discourse): Diagram File (.discourse_diagram):
Further Comments					top
26