
Annotation Instructions - Concept Map Creation

Input:
- topic description
- top 50 propositions ranked by importance

Goal: create a concept map for the topic by connecting propositions to form a graph, i.e. by identifying arguments in different propositions that describe the same concept

Example:
Proposition 1: Barack Obama		is married to		Michelle Obama
Proposition 2: the US-president		gradudated from		Harvard Law
-> we could connect at the first argument, since they both refer to Barack Obama, creating a graph with 3 nodes and 2 edges

Instructions:
1) When attaching a new proposition, choose one of the two possible labels (the one present in the graph or the one of the added proposition). Make sure it is meaningful for all edges that will be connected to that node. Usually, that means prefering the more general/abstract expression.
2) Add propositions until the graph has 25 nodes.
3) When choosing the next proposition, find a good trade-off between importance and connectedness. That means, while we want to prefer propositions ranked most important, we might need to add less important ones to make sure the whole graph is connected.
4) It can be helpful to create several unconnected parts during graph construction and connect them later.
5) In addition to the available propositions, the annotator is allowed to create at most 3 synthetic edges where he/she freely defines the label. They should be used to make obvious commonsense connections not covered by the propositions (e.g. add connection "is a" between "kindergarten child" and "child") if that helps to connect otherwise not connected parts of the graph.

Suggested procedure (corresponding commands in paranthesis):
- get familiar with topic and all available propositions (props)
- inspect automatically identified groups, esp. the biggest (group 0/1/...)
- add a first proposition (attach <id> s None t)
- iteratively
 - add new propositions to the graph -> either attach or connect 
 - use suggest-function to find new propositions to add
 - check list of all propositions when no connection can be suggested and/or to check the most important ones are used
- add synthetic edges if necessary
