Mesgari, Mostafa, Okoli, Chitu, Mehdi, Mohamad, Nielsen, Finn Årup and Lanamäki, Arto (2014) “The sum of all human knowledge”: A systematic review of scholarly research on the content of Wikipedia. Journal of the American Society for Information Science and Technology . ISSN 1532-2882 (In Press)
Preview |
Text (Accepted version with author-identified corrections) (application/pdf)
1MBWikiLit_Content_-_open_access_version.pdf - Accepted Version Available under License Spectrum Terms of Access. |
Abstract
Wikipedia might possibly be the best-developed attempt thus far of the enduring quest to gather all human knowledge in one place. Its accomplishments in this regard have made it an irresistible point of inquiry for researchers from various fields of knowledge. A decade of research has thrown light on many aspects of the Wikipedia community, its processes, and content. However, due to the variety of the fields inquiring about Wikipedia and the limited synthesis of the extensive research, there is little consensus on many aspects of Wikipedia’s content as an encyclopedic collection of human knowledge. This study addresses the issue by systematically reviewing 110 peer-reviewed publications on Wikipedia content, summarizing the current findings, and highlighting the major research trends. Two major streams of research are identified: the quality of Wikipedia content (including comprehensiveness, currency, readability and reliability) and the size of Wikipedia. Moreover, we present the key research trends in terms of the domains of inquiry, research design, data source, and data gathering methods. This review synthesizes scholarly understanding of Wikipedia content and paves the way for future studies.
Divisions: | Concordia University > John Molson School of Business > Decision Sciences and Management Information Systems |
---|---|
Item Type: | Article |
Refereed: | Yes |
Authors: | Mesgari, Mostafa and Okoli, Chitu and Mehdi, Mohamad and Nielsen, Finn Årup and Lanamäki, Arto |
Journal or Publication: | Journal of the American Society for Information Science and Technology |
Date: | 30 April 2014 |
Keywords: | Wikipedia, systematic literature review, encyclopedias, quality, comprehensiveness, currency, readability and style, reliability, accuracy, size of Wikipedia, featured articles, open content |
ID Code: | 978618 |
Deposited By: | CHITUANYA OKOLI |
Deposited On: | 12 May 2014 17:40 |
Last Modified: | 18 Jan 2018 17:47 |
Additional Information: | This is a postprint of an article accepted for publication in Journal of the American Society for Information Science and Technology copyright © 2014 (American Society for Information Science and Technology). The paper can be cited as: Mesgari, Mostafa, Chitu Okoli, Mohamad Mehdi, Finn Årup Nielsen and Arto Lanamäki (2014). “The sum of all human knowledge”: A systematic review of scholarly research on the content of Wikipedia. Journal of the American Society for Information Science and Technology (Forthcoming since April 2014). |
References:
Adamic, L. A., Xiao Wei, Jiang Yang, Gerrish, S., Nam, K. K., & Clarkson, G. S. (2010). Individual focus and knowledge contribution. First Monday, 15(3). Retrieved from http://firstmonday.org/ojs/index.php/fm/article/view/2841/2475Adar, E., Skinner, M., & Weld, D. S. (2009). Information arbitrage across multi-lingual Wikipedia. In 2nd ACM International Conference on Web Search and Data Mining, WSDM’09, February 9, 2009 - February 12, 2009 (pp. 94–103). Barcelona, Spain: Association for Computing Machinery. Retrieved from http://dx.doi.org/10.1145/1498759.1498813
Altmann, U. (2005). Representation of Medical Informatics in the Wikipedia and its Perspectives. Studies in Health Technology and Informatics, 116, 755–760.
Anthony, D., Smith, S. W., & Williamson, T. (2009). Reputation and Reliability in Collective Goods. Rationality and Society, 21(3), 283–306. doi:10.1177/1043463109336804
Arazy, O., & Kopak, R. (2011). On the measurability of information quality. Journal of the American Society for Information Science and Technology, 62(1), 89–99. doi:10.1002/asi.21447
Arazy, O., Nov, O., Patterson, R., & Yeo, L. (2011). Information Quality in Wikipedia: The Effects of Group Composition and Task Conflict. Journal of Management Information Systems, 27(4), 71–98.
Bekker-Nielsen, T. (2011). Historie på Wikipedia. Noter, 188, 48–52.
Blumenstock, J. E. (2008). Size Matters: Word Count as a Measure of Quality on Wikipedia. In Proceedings of the 17th International World Wide Web Conference (WWW2008). April 21-25, 2008. Beijing, China.
Bragues, G. (2009). Wiki-Philosophizing in a Marketplace of Ideas: Evaluating Wikipedia’s Entries on Seven Great Minds. MediaTropes eJournal, 2(1), 117–158.
Brandes, U., Kenis, P., Lerner, J., & van Raaij, D. (2009). Network analysis of collaboration structure in Wikipedia. In Proceedings of the 18th international conference on World wide web (pp. 731–740). New York, NY, USA: ACM. doi:10.1145/1526709.1526808
Brown, A. R. (2011). Wikipedia as a Data Source for Political Scientists: Accuracy and Completeness of Coverage. PS: Political Science & Politics, 44(02), 339–343. doi:10.1017/S1049096511000199
Caddick, S. (2006). Wiki and other ways to share learning online. Nature, 442(7104), 744–744. doi:10.1038/442744c
Carillo, K., & Okoli, C. (2011). Generating quality open content: A functional group perspective based on the time, interaction, and performance theory. Information & Management, 48(6), 208–219. doi:doi: 10.1016/j.im.2011.04.004
Chesney, T. (2006). An empirical examination of Wikipedia’s credibility. First Monday, 11(11). Retrieved from http://firstmonday.org/article/view/1413/1331
CityNews.ca. (2008, November 26). Why Wikipedia Is Wrong When It Comes To Prescription Medicine. CityNews. Toronto. Retrieved from http://www.citynews.ca/2008/11/26/why-wikipedia-is-wrong-when-it-comes-to-prescription-medicine/
Clark, M., Ruthven, I., & Holt, P. O. (2009). The evolution of genre in Wikipedia. Journal for Language Technology and Computational Linguistics, 24(1), 1–22.
Clauson, K. A., Polen, H. H., Boulos, M. N. K., & Dzenowagis, J. H. (2008). Scope, completeness, and accuracy of drug information in Wikipedia. The Annals of Pharmacotherapy, 42(12), 1814–1821. doi:10.1345/aph.1L474
Dalby, A. (2007). Wikipedia(s) on the language map of the world. English Today, 23(02), 3. doi:10.1017/S0266078407002027
Den Besten, M., & Dalle, J.-M. (2008). Keep it simple: A companion for Simple Wikipedia? Industry and Innovation, 15(2), 169–178.
Devgan, L., Powe, N., Blakey, B., & Makary, M. (2007). Wiki-Surgery? Internal validity of Wikipedia as a medical and surgical reference. Journal of the American College of Surgeons, 205(3, supplement), S76–S77. doi:10.1016/j.jamcollsurg.2007.06.190
DiStaso, M. W., & Messner, M. (2010). Forced transparency: Corporate image on Wikipedia and what it means for public relations. Public Relations Journal, 4(2), 1–23.
Dondio, P., & Barrett, S. (2007). Computational trust in Web content quality: a comparative evalutation on the Wikipedia project. Informatica, 31(2), 151–60.
Duguid, P. (2006). Limits of self-organization: Peer production and "laws of quality. First Monday, 11(10). Retrieved from http://firstmonday.org/ojs/index.php/fm/article/view/1405/1323
Ehmann, K., Large, A., & Beheshti, J. (2008). Collaboration in context: comparing article evolution among subject disciplines in Wikipedia. First Monday, 13(10). Retrieved from http://firstmonday.org/article/view/2217/2034
Elia, A. (2009). Quantitative data and graphics on lexical specificity and index of readability: The case of Wikipedia. RaeL: Revista Electronica de Linguistica Aplicada, (8), 248–271. doi:Article
Elvebakk, B. (2008). Philosophy democratized? A comparison between Wikipedia and two other Web-based philosophy resources. First Monday, 13(2). Retrieved from http://firstmonday.org/article/view/2091/1938
Emigh, W., & Herring, S. C. (2005). Collaborative Authoring on the Web: A Genre Analysis of Online Encyclopedias. In Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS’05) - Track 4 - Volume 04 (p. 99.1). Washington, DC, USA: IEEE Computer Society. doi:10.1109/HICSS.2005.149
Fallis, D. (2008). Toward an Epistemology of Wikipedia. Journal of the American Society for Information Science and Technology, 59(10), 1662–1674. doi:10.1002/asi.20870
Giles, J. (2005). Internet encyclopaedias go head to head. Nature, 438(7070), 900–901. doi:10.1038/438900a
Goldspink, C. (2009). Social self-regulation in computer mediated communities: the case of Wikipedia. International Journal of Agent Technologies & Systems, 1(1), 19–33.
Goldspink, C. (2010). Normative behaviour in Wikipedia. Information, 13(5), 652–673.
Greenstein, S. (2007). Wagging Wikipedia’s long tail. IEEE Micro, 27(2), 6+79.
Gregor, S. (2006). The nature of theory in information systems. MIS Q., 30(3), 611–642.
Haigh, C. A. (2010). Wikipedia as an evidence source for nursing and healthcare students. Nurse Education Today. doi:10.1016/j.nedt.2010.05.004
Halavais, A., & Lackaff, D. (2008). An analysis of topical coverage of Wikipedia. Journal of Computer Mediated Communication, 13(2), 429–440. doi:10.1111/j.1083-6101.2008.00403.x
Harding, A. (2008, November 25). Wikipedia often omits important drug information: study. Reuters. New York. Retrieved from http://www.reuters.com/article/2008/11/25/us-wikipedia-information-idUSTRE4AN7BO20081125
Huvila, I. (2010). Where does the information come from? Information source use patterns in Wikipedia. Information Research, 15(3), 24 pp.
Jancarik, A., & Jancarikova, K. (2010). Wiki Tools in the Preparation and Support of e-Learning Courses. Electronic Journal of E-Learning, 8(2), 123–32.
Jones, J. (2008). Patterns of revision in online writing: A study of Wikipedia’s featured articles. Written Communication, 25(2), 262–289. doi:10.1177/0741088307312940
Jullien, N. (2012). What we know about Wikipedia. A review of the literature analyzing the project(s). Available at SSRN 2053597. Retrieved from https://papers.ssrn.com/sol3/Delivery.cfm/SSRN_ID2053597_code728676.pdf?abstractid=2053597&mirid=2
Kim, J. Y., Gudewicz, T. M., Dighe, A. S., & Gilbertson, J. R. (2010). The pathology informatics curriculum wiki: Harnessing the power of user-generated content. Journal of Pathology Informatics, 1. doi:10.4103/2153-3539.65428
Kimmerle, J., Moskaliuk, J., Harrer, A., & Cress, U. (2010). VISUALIZING CO-EVOLUTION OF INDIVIDUAL AND COLLECTIVE KNOWLEDGE. Information, Communication & Society. Retrieved from http://www.informaworld.com/10.1080/13691180903521547
Kittur, A., Chi, E. H., & Suh, B. (2009). What’s in Wikipedia?: mapping topics and conflict using socially annotated category structure. In Proceedings of the 27th international conference on Human factors in computing systems (pp. 1509–1512). New York, NY, USA: ACM. doi:10.1145/1518701.1518930
Kittur, A., & Kraut, R. E. (2008). Harnessing the wisdom of crowds in wikipedia: Quality through coordination. In 2008 ACM Conference on Computer Supported Cooperative Work, CSCW 08, November 8, 2008 - November 12, 2008 (pp. 37–46). San Diego, CA, United states: Association for Computing Machinery. doi:10.1145/1460563.1460572
Klemp, N. J., & Forcehimes, A. T. (2010). From Town-Halls to Wikis: Exploring Wikipedia’s Implications for Deliberative Democracy. Journal of Public Deliberation, 6(2), 4.
Korosec, L., Limacher, P. A., Lüthi, H. P., & Brändle, M. P. (2010). Chemical Information Media in the Chemistry Lecture Hall: A Comparative Assessment of Two Online Encyclopedias. CHIMIA International Journal for Chemistry, 64(5), 309–314. doi:10.2533/chimia.2010.309
Krötzsch, M., Vrandecic, D., Volkel, M., Haller, H., & Studer, R. (2007). Semantic Wikipedia. Web Semantics, 5(4), 251–261. doi:10.1016/j.websem.2007.09.001
Lam, S. T. K., & Riedl, J. (2011). The past, present, and future of Wikipedia. Computer, 44(3), 87–90.
Lam, S. T. K., Uduwage, A., Dong, Z., Sen, S., Musicant, D. R., Terveen, L., & Riedl, J. (2011). WP:Clubhouse? An exploration of Wikipedia’s gender imbalance. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration (pp. 1–10). New York, NY, USA: ACM. doi:10.1145/2038558.2038560
Lanamäki, A., Okoli, C., Mehdi, M., & Mesgari, M. (2011). Protocol for Systematic Mapping of Wikipedia Studies. In Proceedings of IRIS 2011 – The 34th Information Systems Research Seminar in Scandinavia. Turku, Finland.
Laurent, M. R., & Vickers, T. J. (2009). Seeking health information online: does Wikipedia matter? Journal of the American Medical Informatics Association, 16(4), 471–479. doi:10.1197/jamia.M3059
Lavsa, S. M., Corman, S. L., Culley, C. M., & Pummer, T. L. (2011). Reliability of Wikipedia as a medication information source for pharmacy students. Currents in Pharmacy Teaching and Learning, 3(2), 154–158. doi:10.1016/j.cptl.2011.01.007
Leithner, A., Maurer-Ertl, W., Glehr, M., Friesenbichler, J., Leithner, K., & Windhager, R. (2010). Wikipedia and osteosarcoma: a trustworthy patients’ information? Journal of the American Medical Informatics Association, 17(4), 373–374. doi:10.1136/jamia.2010.004507
Lewandowski, D., & Spree, U. (2011). Ranking of Wikipedia articles in search engines revisited: Fair ranking for reasonable quality? Journal of the American Society for Information Science and Technology, 62(1), 117–132. doi:10.1002/asi.21423
Lih, A. (2004). Wikipedia as participatory Journalism: Reliable Sources? Metrics for evaluating collaborative media as a news resource. In 5th International Symposium on Online Journalism. Retrieved from http://jmsc.hku.hk/faculty/alih/publications/utaustin-2004-wikipedia-rc2.pdf
Lindsey, D. (2010). Evaluating quality control of Wikipedia’s feature articIes. First Monday, 15(4). Retrieved from http://firstmonday.org/ojs/index.php/fm/article/view/2721/2482
Luyt, B. (2011). The nature of historical representation on Wikipedia: Dominant or alterative historiography? Journal of the American Society for Information Science and Technology, 62(6), 1058–1065. doi:10.1002/asi.21531
Luyt, B., & Tan, D. (2010). Improving Wikipedia’s Credibility: References and Citations in a Sample of History Articles. Journal of the American Society for Information Science and Technology (Print), 61(4), 715–722. doi:10.1002/asi.21304
Luyt, B., Tay, C. H. A., Lim, H. T., & Cheng, K. H. (2008). Improving wikipedia’s accuracy: Is edit age a solution? Journal of the American Society for Information Science and Technology, 59(2), 318–330. doi:10.1002/asi.20755
Magnus, P. D. (2008). Early response to false claims in Wikipedia. First Monday, 13(9). Retrieved from http://firstmonday.org/article/view/2115/2027
Magnus, P. D. (2009). On Trusting Wikipedia. Episteme - Edinburgh, 6(1).
Martin, O. S. (2010). A Wikipedia Literature Review. arXiv:1110.5863. Retrieved from http://arxiv.org/abs/1110.5863
McGuinness, D. L., Zeng, H., Silva, P. P. da, Ding, L., Narayanan, D., & Bhaowal, M. (2006). Investigations into Trust for Collaborative Information Repositories: A Wikipedia Case Study. In Proceedings of the Workshop on Models of Trust for the Web. Edinburgh, United Kingdom. Retrieved from http://ebiquity.umbc.edu/_file_directory_/papers/274.pdf
Mercer, J. (2007). Wikipedia and “open source” mental health information. Scientific Review of Mental Health Practice, 5(1), 88–92. doi:Article
Milne, D., Medelyan, O., & Witten, I. H. (2006). Mining Domain-Specific Thesauri from Wikipedia: A Case Study. In Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence (pp. 442–448). doi:10.1109/WI.2006.119
Monaci, S. (2009). Quality assessment process in Wikipedia’s Vetrina: the role of the community’s policies and rules. Observatorio (OBS*), 3(1). Retrieved from http://obs.obercom.pt/index.php/obs/article/viewArticle/240
Niederer, S., & Dijck, J. van. (2010). Wisdom of the crowd or technicity of content? Wikipedia as a sociotechnical system. New Media & Society, 12(8), 1368–1387. doi:10.1177/1461444810365297
Nielsen, F. Å. (2007). Scientific citations in Wikipedia. First Monday, 12(8). Retrieved from http://firstmonday.org/article/view/1997/1872
Nielsen, F. Å. (2008). Clustering of scientific citations in Wikipedia. In Wikimania. Retrieved from http://arxiv.org/abs/0805.1154
Nielsen, F. Å. (2012, February 6). Wikipedia Research and Tools: Review and Comments. SSRN. Retrieved from http://ssrn.com/abstract=2129874
Okoli, C. (2009). A brief review of studies of Wikipedia in peer-reviewed journals. In Digital Society, 2009. ICDS’09. Third International Conference on (pp. 155–160). Retrieved from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4782868
Okoli, C., Mehdi, M., Mesgari, M., Nielsen, F. Å., & Lanamäki, A. (2014). Wikipedia in the eyes of its beholders: A systematic review of scholarly research on Wikipedia readers and readership. Journal of the American Society for Information Science and Technology, Forthcoming.
Okoli, C., Mehdi, M., Mesgari, M., Nielsen, F., & Lanamäki, A. (2012, October 24). The People’s Encyclopedia Under the Gaze of the Sages: A Systematic Review of Scholarly Research on Wikipedia. SSRN Scholarly Paper, Montreal. Retrieved from http://papers.ssrn.com/abstract=2021326
Okoli, C., & Schabram, K. (2009a). Protocol for a systematic literature review of research on the Wikipedia. In Proceedings of the International Conference on Management of Emergent Digital EcoSystems (MEDES) (p. 73). Lyon, France: Association for Computing Machinery. Retrieved from http://dl.acm.org/citation.cfm?id=1643912
Okoli, C., & Schabram, K. (2009b). Protocol for a systematic literature review of research on the Wikipedia. Sprouts: Working Papers in Information Systems, 9(65). Retrieved from http://sprouts.aisnet.org/9-65
Okoli, C., & Schabram, K. (2010). A guide to conducting a systematic literature review of information systems research. Retrieved from http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1954824
Okoli, C., Schabram, K., & Kader, B. A. (2009). From the Academy to the Wiki: Practical Applications of Scholarly Research on Wikipedia. In Proceedings of Wikimania. Buenos Aires: Wik. Retrieved from http://chitu.okoli.org/images/stories/bios/pro/research/open/Okolietal2009Wikimania.pdf
Ortega, F. (2009). Wikipedia. A quantitative analysis (Doctoral thesis). Universidad Rey Juan Carlos, Madrid, Spain. Retrieved from http://libresoft.es/Members/jfelipe/thesis-wkp-quantanalysis/view
Page, R. (2010). Wikipedia as an encyclopaedia of life. Organisms Diversity & Evolution, 10(4), 343–349. doi:10.1007/s13127-010-0028-9
Pender, M. P., Lasserre, K. E., Kruesi, L. M., Mar, C. D., & Anuradha, S. (2008). Putting Wikipedia to the test: a case study. In The Special Libraries Association Annual Conference. Retrieved from http://espace.library.uq.edu.au/eserv/UQ:193433/SLA_Paper.pdf
Poderi, G. (2009). Comparing featured article groups and revision patterns correlations in Wikipedia. First Monday, 14(5). Retrieved from http://firstmonday.org/ojs/index.php/fm/article/view/2365/2182
Priedhorsky, R., Chen, J., Lam, S. T. K., Panciera, K., Terveen, L.,
Available Versions of this Item
- “The sum of all human knowledge”: A systematic review of scholarly research on the content of Wikipedia. (deposited 12 May 2014 17:40) [Currently Displayed]
Repository Staff Only: item control page