Added PATCH folder for demo paper PATCH.

PATCH2013-Demo/abstract.tex

@@ -0,0 +1,6 @@
+\begin{abstract}
+% A digital collection that can be accessed online, searched and linked to other collections is an important focus for many cultural heritage institutions. 
+Diversity and profundity of the topics in cultural heritage institutions' collections make experts from outside the institution indispensable for acquiring qualitative annotations. We define the concept of nichesourcing and present challenges in the process of obtaining qualitative annotations from people in these niches. We believe that experts provide better annotations if this process is personalized. We present a framework, called Accurator, that allows to realize and evaluate strategies and applications for personalized nichesourcing.
+
+\keywords{cultural heritage, nichesourcing, annotation framework, qualitative annotations}
+\end{abstract}

PATCH2013-Demo/architecture.tex

@@ -0,0 +1,23 @@
+\section{Accurator framework}
+\label{architecture}
+To approach these challenges and evaluate our hypotheses, we develop the Accurator framework. Our main assumption is that making use of personalized nichesourcing increases the quality of annotations. We believe that we can identify automatically niche candidate users and create their user profiles. Based on the user profiles we can recommend relevant tasks to the user and apply trust mechanisms to improve the recommendations. Figure 1 shows the Accurator workflow. 
+
+\begin{figure*}[hbt]
+	\centering
+	\includegraphics[width=0.93\textwidth]{accurator_diagram.jpg}
+  	\caption{Accurator personalized nichesourcing workflow}
+\end{figure*}
+
+The process starts (see Figure 1a) with searching the social web for user-generated content that is relevant for a specific topic. We calculate the relevance of the content creators with respect to the topic and exploit social relations to identify a topical niche. When a person starts using Accurator, a user profile (see Figure 1b) is built based on available data.
+
+Next (see Figure 1c) is the recommendation of collection items to a user. The recommendation strategy is based on specific patterns in the data, the user profile, and the current annotation quality of an item. Accurator allows to easily change between different strategies to cater for users diversity.
+The choice of recommended items will affect the calculated interest of that user.
+
+Figure 1d shows the interface where users add their annotations to an item. The presented fields depend on the topic and the user's expertise on that topic. 
+Accurator can be configured to use domain vocabularies to support the user. Figure 1e shows the interface in which users can evaluate the annotations of other users. This task is only available to users who are trustworthy and have a certain level of expertise. The result of a review affects 1) the quality of an annotation, 2) the expertise level of the user and 3) the trustworthiness of another user.
+
+Accurator is built using Cliopatria to store RDF, GWT for the user interface and GAE for hosting. Accurator is now used for experimentation with artwork data from the Rijksmuseum Amsterdam and a demo is available at 
+\\ \url{http://rma-accurator.appspot.com}.
+
+
+

PATCH2013-Demo/bibliography.bib

@@ -0,0 +1,48 @@
+@inproceedings{ He2013,
+      author = "Jiyin He and Jacco van Ossenbruggen and Arjen de Vries",
+      title = "Do you need experts in the crowd? A case study in image annotation for marine biology",  
+	booktitle="Open Research Areas in Information Retrieval (OAIR 2013), the 10th International Conference in the RIAO series",
+	year = "2013",
+	note = "to appear"
+	}
+	
+@article{greg2011your,
+  title={Your paintings: public access and public tagging},
+  author={Greg, A},
+  journal={Journal of the Scottish Society for Art History},
+  volume={16},
+  pages={48--52},
+  year={2011}
+}
+
+@inproceedings{oomen2011crowdsourcing,
+  title={Crowdsourcing in the cultural heritage domain: opportunities and challenges},
+  author={Oomen, Johan and Aroyo, Lora},
+  booktitle={Proceedings of the 5th International Conference on Communities and Technologies},
+  pages={138--149},
+  year={2011},
+  organization={ACM}
+}
+
+@inproceedings{von2004labeling,
+  title={Labeling images with a computer game},
+  author={Von Ahn, Luis and Dabbish, Laura},
+  booktitle={Proceedings of the SIGCHI conference on Human factors in computing systems},
+  pages={319--326},
+  year={2004},
+  organization={ACM}
+}
+
+@inproceedings{DBLP:conf/um/DijkshoornOAH12,
+  author    = {Chris Dijkshoorn and
+               Jasper Oosterman and
+               Lora Aroyo and
+               Geert-Jan Houben},
+  title     = {Personalization in crowd-driven annotation for cultural
+               heritage collections},
+  booktitle = {UMAP Workshops},
+  year      = {2012},
+  ee        = {http://ceur-ws.org/Vol-872/patch2012_paper_3.pdf},
+  crossref  = {DBLP:conf/um/2012w},
+  bibsource = {DBLP, http://dblp.uni-trier.de}
+}

PATCH2013-Demo/conclusion.tex

@@ -0,0 +1 @@
+\section{Conclusion}\label{conclusion}

PATCH2013-Demo/demo_paper.aux

@@ -0,0 +1,13 @@
+\relax 
+\@writefile{toc}{\contentsline {title}{Accurator}{1}}
+\@writefile{toc}{\authcount {1}}
+\@writefile{toc}{\contentsline {author}{Chris Dijkshoorn}{1}}
+\@writefile{toc}{\contentsline {section}{\numberline {1}Introduction}{1}}
+\newlabel{introduction}{{1}{1}}
+\@writefile{toc}{\contentsline {section}{\numberline {2}Research Challenges}{2}}
+\newlabel{use_case}{{2}{2}}
+\@writefile{toc}{\contentsline {section}{\numberline {3}Accurator framework}{2}}
+\newlabel{architecture}{{3}{2}}
+\bibstyle{splncs03}
+\bibdata{bibliography}
+\@writefile{lof}{\contentsline {figure}{\numberline {1}{\ignorespaces Accurator personalized nichesourcing workflow}}{3}}

PATCH2013-Demo/demo_paper.tex

@@ -0,0 +1,48 @@
+\documentclass{llncs}
+
+%Packages
+\usepackage{amssymb}
+\setcounter{tocdepth}{3}
+\usepackage{graphicx}
+\usepackage{url}
+
+\begin{document}
+\mainmatter  
+
+\title{Personalized Nichesourcing: Acquisition of Qualitative Annotations from Niche Communities}
+\titlerunning{Personalized Nichesourcing: Acquisition of Qualitative Annotations from Niche Communities}
+
+
+\author{Chris Dijkshoorn\inst{1}, Mieke Leyssen\inst{2}, Archana Nottamkandath\inst{1}, Jasper Oosterman\inst{3}, Myriam Traub\inst{2}, Lora Aroyo\inst{1}, Wan Fokkink\inst{1}, Geert-Jan Houben\inst{3}}
+\authorrunning{Dijkshoorn et. al.}
+\tocauthor{Chris Dijkshoorn}
+\institute{The Network Institute\\ Department of Computer Science\\ VU University, Amsterdam, the Netherlands\\\email{[email protected]}}
+\toctitle{Accurator}
+
+
+\institute{The Network Institute, VU University, Amsterdam, the Netherlands
+\email{\{c.r.dijkshoorn, a.nottamkandath, lora.aroyo, w.j.fokkink\}@vu.nl}
+\and Centrum Wiskunde en Informatica, Amsterdam, the Netherlands\\
+\email{\{leyssen, traub\}@cwi.nl}
+\and Web Information Systems, Delft University of Technology, the Netherlands\\
+\email {\{j.e.g.oosterman, g.j.p.m.houben\}@tudelft.nl}
+}
+
+\maketitle
+
+\input{abstract}
+
+\input{introduction}
+
+\input{use_case}
+
+\input{architecture}
+
+
+\textbf{\\Acknowledgements.}  This publication is supported by the Dutch national program COMMIT. We like to thank the members of the SEALINCMedia worktable and in particular the Rijksmuseum for their support.
+
+
+\bibliographystyle{splncs03}
+\bibliography{bibliography}
+
+\end{document}

PATCH2013-Demo/introduction.tex

@@ -0,0 +1,12 @@
+\section{Introduction}\label{introduction}
+Access and retrieval mechanisms for archives and museums typically rely on a rich description of the collection. 
+Most cultural heritage institutions employ professional experts to describe their collections by manually compiling metadata for each item. 
+For large and diverse collections the knowledge of experts from other domains is indispensable.
+Cultural heritage institutions therefore seek to understand whether and how they can make use of external users to produce these annotations.
+
+The work we present aims at understanding which strategies and techniques lead to high-quality annotations by (crowds of) users that are external to the museum experts. 
+The first challenge in the project is to identify the niche of relevant experts and to motivate them to contribute to the annotation of collection items. 
+Next, personalization mechanisms must make sure that the experts are shown items that correspond to their expertise. 
+The quality of the annotations and annotators is to be evaluated using trust algorithms. As a final challenge, all these aspects must be presented in an appropriate interface.
+
+To evaluate our hypotheses, we develop a framework to support crowd annotation processes, called Accurator.