-
Notifications
You must be signed in to change notification settings - Fork 6
Description
For all to read, but particularly those working on the future end paper. @Masssly and @hargup, These were the critiques of our original paper in our Revise and Resubmit stage:
COMMENTS FOR THE AUTHOR:Reviewer #1: With all its merits as an innovative research project, the "WIGI" index article suffers from two main critical flaws that undermine the interesting attempt to explore the gender inequality as represented in Wikipedia's biographies: over-generalizations and over-statements. Thus I suggest the author(s) to revise them accordingly.
First, the author(s) must specify clearly the scope and the unit of analysis of the research, otherwise the generalizations made, implicitly or explicitly in the article, will continue to undermine the validity of the main arguments and confuse the readers. Since the scope of research is Wikipedia biographies that are coded in Wikidata project, it must be pointed out the gaps between the actual and the expected scope of research. The actual scope is the biographies that are coded (and thus represented) in Wikidata, which may or may out be the same of the scope covered by the Wikipedia biographies. Also, it must be pointed out that the scope of Wikipedia biographies may be partial as well when considering the totality of available world's biographies. Such clarifications will enhance the analytical strengths and limitations of the approach. Instead of arguing for "an academic index allowing comparative study of gender inequality through space and time", the authors should use
more adequate and moderate arguments such as "a set of indicators that allow the measurement and monitoring the representative inequality of gender in biographies across countries and throughout time". The key terms are representation and biographies. Without these specification key terms, over-generalizations are made.Second, while the author(s) comparative strategies (including using Inglehart-Welzel cultural clusters) serve very well in reducing the complexity of the datasets for interesting insights, the discussions and conclusions made tend to over-state what the findings may imply. For instance, the found relatively high ranking of the Confucian and South Asian clusters were described by the author(s) as "surprising", and then the author(s) proceed to propose the Celebrity Hypothesis (7.11) to explain such a surprise. What the author(s) should do and must do is instead use this opportunity to discuss the methodological issue that gender representative inequality may be quantitatively reduced by more presence of celebrity in biographies, but such phenomena may conceal, rather than reveal the actual social gender inequality for cross-cultural comparisons. In other words, the author(s) should continue to advance the discussions on the found patterns to show that different
aggregation/comparison strategies may reveal/conceal certain aspects of inequality. Attention must be paid to specify which aspects and how.The two main points above lead to a critical question on the use of the term "index". The author(s) may want to refer the following sources:
- Robert J. Rossi; Kevin J. Gilmartin (1980). The handbook of social indicators: sources, characteristics, and analysis. Garland STPM Press. p. 175. ISBN 978-0-8240-7135-6.
- Fanchette, Serge, 1974. Social Indicators: Problems of Methodology and Selection' In Social Indicators: Problems of Definition and Selection. Paris: UNESCO Press.
and realize that an "index" refers to a specific "weighted combination of two or more indicators".
There is little discussions on how the so-called WIGI index may be weighted combinations of some kind. What the paper has already achieved successfully is to derive a set of gender representation inequality indicators in various aggregated time and country categories, which in turn provide interesting findings about the Wikipedia/Wikidata themselves. However, these outcomes are not yet weighted in combinations to derive an "index" about societies in general. Though I did not mean to say that an index is necessary for the article to succeed, it is important to manage the readers' expectation adequately. The authors' may want to give some thoughts about what this paper has already achieved and what they want to invite the readers of "Social Indicators" to contribute the further development of the work presented here. I personally think that my suggested description "a set of indicators that allow the measurement and monitoring the representative inequality of gender in
biographies across countries and throughout time" is more adequate. The author(s) can further discuss, as they have done partially in the paper, the limitations and possible extensions of the current research efforts. For instance, the low percentage of country information (23.47%) in Table 1 seriously undermines any further attempts to conduct cross-country comparisons (not to mention the aggregated outcomes based on nine world cultures consistently), including the ranking in Table 2. The author(s) may want to suggest a few research strategies in the future to tackle such a major data problem.This work gas pioneered work in measuring and monitoring biographies in Wikipedia/Wikidata projects. A successful revision will require the author(s) to better defend their contribution in showing the representation inequality, instead of the overstated claim on "worldwide longitudinal gender inequality trends". Given the fact that many of the data points' country information are missing, the author(s) should acknowledge such a fact and try to turn this point of weakness into a point of strength in signaling the incomplete area for Wikipedia's improvement in the area. In other words, instead of suggesting the Wikipedia/Wikidata outcomes can be "indicative" or "reflective" of social phenomena, the author(s) should focus on the "representative" nature of Wikipedia/Wikidata in documenting social outcomes. The proposed celebrity hypothesis also highlights the "representative" dimension. In other words, instead of claiming that Wikipedia/Wikidata may reveal and/or reflect the
world's gender inequality, it may be more defensible that the proposed efforts help to identify the representative inequality across different cultural, linguistic and social categories as represented in Wikipedia/Wikidata projects.