2016•IIASA PURE (International Institute of Applied Systems Analysis)Requires access

A method for increasing the accuracy of image annotating in crowd-sourcing

Oleg Nurmukhametov, Artem Baklanov

Open publisher page 0 citations

Abstract

Crowdsourcing is a new approach to solve tasks when a group of volunteers replaces experts. Recent results show that crowdsourcing is an efficient tool for annotating large datasets. Geo-Wiki is an example of successful citizen science projects. The goal of Geo-Wiki project is to improve a global land cover map by applying crowdsourcing for image recognition. In our research, we investigate methods for increasing reliability of data collected during The Cropland Capture Game (Geo-Wiki). In this regard, we performed analysis of all main steps of the crowdsourcing campaign: image processing and aggregation of collected votes. During the research, we used methods of Computer Vision and Machine Learning. This allowed us to increase accuracy of the aggregated votes from 76% to 87%. Copyright © by the paper's authors.

Open-access reader

About this research paper

What this paper is about

Crowdsourcing is a new approach to solve tasks when a group of volunteers replaces experts. Recent results show that crowdsourcing is an efficient tool for annotating large datasets. Geo-Wiki is an example of successful citizen science projects. The goal of Geo-Wiki project is to improve a global land cover map by applying crowdsourcing for image recognition. In our research, we investigate methods for increasing reliability of data collected during The Cropland Capture Game (Geo-Wiki). In this regard, we performed analysis of all main steps of the crowdsourcing campaign: image processing and aggregation of collected votes. During the research, we used methods of Computer Vision and Machine Learning. This allowed us to increase accuracy of the aggregated votes from 76% to 87%. Copyright © by the paper's authors.

Why it matters

A significance statement is not available in the OpenAlex record.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Crowdsourcing is a new approach to solve tasks when a group of volunteers replaces experts. Recent results show that crowdsourcing is an efficient tool for annotating large datasets. Geo-Wiki is an example of successful citizen science projects. The goal of Geo-Wiki project is to improve a global land cover map by applying crowdsourcing for image recognition. In our research, we investigate methods for increasing reliability of data collected during The Cropland Capture Game (Geo-Wiki). In this regard, we performed analysis of all main steps of the crowdsourcing campaign: image processing and aggregation of collected votes. During the research, we used methods of Computer Vision and Machine Learning. This allowed us to increase accuracy of the aggregated votes from 76% to 87%. Copyright © by the paper's authors.

Key concepts: Crowdsourcing, Crowd sourcing, Computer science, Citizen science, Reliability (semiconductor), Data science, Image (mathematics), World Wide Web

Related papers

Back to paper searchBrowse research topicsOriginal source
A method for increasing the accuracy of image annotating in crowd-sourcing — Research Paper | ScholarLens