8000 How to pre screen or filter qualifying workers for a task? · Issue #3891 · boto/boto · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
This repository was archived by the owner on May 10, 2024. It is now read-only.
This repository was archived by the owner on May 10, 2024. It is now read-only.
How to pre screen or filter qualifying workers for a task?  #3891
Open
@shubhamagarwal92

Description

@shubhamagarwal92

Hi, I am using boto mturk api for crowdsourcing.

Is it possible to filter and identify qualifying AMT workers using very small test cases before they start the actual HIT? I know there are some way arounds:

  • Use a 2-HIT process. First, use a cheap HIT where we test and identify qualifying workers and then eligible workers see the actual task
  • Have small test/qualifying examples in your task and if they answer them correctly, then use this data as clean and quality controlled. (I am using this strategy but it leads to throwing away some part of collected raw data.)

Is it possible that before the crowdworkers actually start working on the task, they provide answers to default questions and if they correctly do it, then they actually start working on the task? This would avoid wasting their time and our money.

Can we use our same HTML that we define for our task? I guess we have some kind of process in the interface but not through the api as mentioned here:

https://forums.aws.amazon.com/thread.jspa?messageID=879829

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0