Papers

More detailed information is available in our papers:

• CHI ‘17: VoxPL: Programming with the Wisdom of the Crowd Daniel W. Barowy, Emery D. Berger, Daniel G. Goldstein, and Siddharth Suri

  • talk slides

• CACM RH ‘16: AutoMan: A Platform for Integrating Human-Based and Digital Computation (Research Highlight) Daniel W. Barowy, Charlie Curtsinger, Emery D. Berger, and Andrew McGregor

• OOPSLA ‘12: AutoMan: A Platform for Integrating Human-Based and Digital Computation Daniel W. Barowy, Charlie Curtsinger, Emery D. Berger, and Andrew McGregor

  • talk slides

• Tech report UMass CS TR 2011-44

• Second Workshop on Computational Social Science and the Wisdom of Crowds, ‘11

  • NIPS poster

  • NIPS workshop paper

There are two versions of the original AutoMan paper, a shortened Research Highlight that appeared in the June 2016 issue of the Communications of the ACM and a longer version that appeared at OOPSLA 2012. You should probably start with the CACM version which has a bit more polish and some updated results.

The VoxPL paper describes our approach to automate the original wisdom of the crowd task, estimation. We introduce a novel quality control algorithm and describe how we rebuilt AutoMan’s architecture to handle these new kinds of tasks.

Full citations are given below:

VoxPL

@inproceedings{Barowy:2017:VPW:3025453.3026025,
 author = {Barowy, Daniel W. and Berger, Emery D. and Goldstein, Daniel G. and Suri, Siddharth},
 title = {VoxPL: Programming with the Wisdom of the Crowd},
 booktitle = {Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems},
 series = {CHI '17},
 year = {2017},
 isbn = {978-1-4503-4655-9},
 location = {Denver, Colorado, USA},
 pages = {2347--2358},
 numpages = {12},
 url = {http://doi.acm.org/10.1145/3025453.3026025},
 doi = {10.1145/3025453.3026025},
 acmid = {3026025},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {crowdprogramming, crowdsourcing, domain-specific languages, quality control, scalability, wisdom of the crowd},
}

AutoMan (Communications of the ACM Research Highlight)

@article{Barowy:2016:API:2942427.2927928,
 author = {Barowy, Daniel W. and Curtsinger, Charlie and Berger, Emery D. and McGregor, Andrew},
 title = {AutoMan: A Platform for Integrating Human-based and Digital Computation},
 journal = {Commun. ACM},
 issue_date = {June 2016},
 volume = {59},
 number = {6},
 month = may,
 year = {2016},
 issn = {0001-0782},
 pages = {102--109},
 numpages = {8},
 url = {http://doi.acm.org/10.1145/2927928},
 doi = {10.1145/2927928},
 acmid = {2927928},
 publisher = {ACM},
 address = {New York, NY, USA},
}

AutoMan (original)

@inproceedings{Barowy:2012:API:2384616.2384663,
 author = {Barowy, Daniel W. and Curtsinger, Charlie and Berger, Emery D. and McGregor, Andrew},
 title =  {{AutoMan} : a platform for integrating human-based and digital computation},
 booktitle = {Proceedings of the ACM International Conference on Object-Oriented Programming Systems Languages and Applications},
 series = {OOPSLA '12},
 year = {2012},
 isbn = {978-1-4503-1561-6},
 location = {Tucson, Arizona, USA},
 pages = {639--654},
 numpages = {16},
 url = {http://doi.acm.org/10.1145/2384616.2384663},
 doi = {10.1145/2384616.2384663},
 acmid = {2384663},
 publisher = {ACM},
 address = {New York, NY, USA},
 keywords = {crowdsourcing, programming languages, quality control},
}

Contact information:

Dan Barowy, [email protected] Emery Berger, [email protected]