The importance of worker Reputation information of in Microtask-Based crowd work Systems

The importance of worker Reputation information of in Microtask-Based crowd work Systems
Author(s):
D.Ajay kumar, M.PADMAVATHAMMA
Keywords:
a-priori, micro task, a-posteriori, message passing
Abstract
This paper presents we first formalize the optimal task assignment problem when workers’ reputation estimates are available, as the maximization of a monotone (submodular) function subject to Matroid constraints. Then, being the optimal problem NP-hard, we propose a simple but efficient greedy heuristic task allocation algorithm. We also propose a simple “maximum a-posteriori” decision rule and a decision algorithm based on message passing. Finally, we test and compare different solutions, showing that system performance can greatly benefit from information about workers’ reputation. In this our main findings are that: i) even largely inaccurate estimates of workers’ reputation can be effectively exploited in the task assignment to greatly improve system performance; ii) the performance of the maximum a-posteriori decision rule quickly degrades as worker reputation estimates become inaccurate; iii) when workers’ reputation estimates are significantly inaccurate, the best performance can be obtained by combining our proposed task assignment algorithm with the message-passing decision algorithm
Article Details
Unique Paper ID: 145841 Publication Volume & Issue: Volume 4, Issue 11 Page(s): 968 - 971
Article Preview & Download

Share This Article

NCSEM 2024

National Conference on Sustainable Engineering and Management - 2024

Last Date: 15th March 2024

IJIRT.org enables door in research by providing high quality research articles in open access market.

Send us any query related to your research on editor@ijirt.org