Attributes of the Rigor Metric
(ZELIK et al., 2007)
Hypothesis Exploration describes the extent to which multiple hypotheses were considered in explaining data. In a low-rigor process there is minimal weighing of alternatives. A high-rigor process, in contrast, involves broadening of the hypothesis set beyond an initial framing and incorporating multiple perspectives to identify the best, most probable explanations.
Information Search relates to the depth and breadth of the search process used in collecting data. A low-rigor analysis process does not go beyond routine and readily available data sources, whereas a high-rigor process attempts to exhaustively explore all data potentially available in the relevant sample space.
Information Validation details the level at which information sources are corroborated and cross-validated. In a low-rigor process little effort is made to use converging evidence to verify source accuracy, while a high-rigor process includes a systematic approach for verifying information and, when possible, ensures the use of sources closest to the areas of interest.
Stance Analysis is the evaluation of data with the goal of identifying the stance or perspective of the source and placing it into a broader context of understanding. At the low-rigor level an analyst may notice a clear bias in a source, while a high-rigor process involves research into source backgrounds with the intent of gaining a more subtle understanding of how their perspective might influence their stance toward analysis-relevant issues.
Sensitivity Analysis considers the extent to which the analyst considers and understands the assumptions and limitations of their analysis. In a low-rigor process, explanations seem appropriate and valid on a surface level. In a high-rigor process the analyst employs a strategy to consider the strength of explanations if individual supporting sources were to prove invalid.
Specialist Collaboration describes the degree to which an analyst incorporates the perspectives of domain experts into their assessments. In a low-rigor process little effort is made to seek out such expertise, while in a high-rigor process the analyst has talked to, or may be, a leading expert in the key content areas of the analysis.
Information Synthesis refers to how far beyond simply collecting and listing data an analyst went in their process. In the low-rigor process an analyst simply complies the relevant information in a unified form, whereas a high-rigor process has
extracted and integrated information with a thorough consideration of diverse interpretations of relevant data.
Explanation Critique is a different form of collaboration that captures how many different perspectives were incorporated in examining the primary hypotheses. In a low-rigor process, there is little use of other analysts to give input on explanation quality. In a high-rigor process peers and experts have examined the chain of reasoning and explicitly identified which inferences stronger and which are weaker.
Attention: same word in Portuguese and English. Same meaning for rigor. /
Atenção: mesma palavra em português e inglês. Mesmo significado para rigor.
Keywords: definition of model,
information analysis,
model,
rigour
Palavras-chave: cognação,
cognato
ZELIK, Daniel et al. Understanding rigor in information analysis. In: 8th International Conference on Naturalistic Decision Making, Pacific Grove, CA. 2007. p. 1-8. Available from <
https://www.academia.edu/download/39555602/Understanding_rigor_in_information_analy20151030-7250-1ylmxei.pdf >. access on 20 January
2023.
https://scholar.google.com.br/scholar?q=definition+of+rigor&hl=pt-BR&as_sdt=0&as_vis=1&oi=scholart
http://www.google.com.br/search?hl=pt-BR&q=orientation+community+rigor&btnG=Pesquisar
http://www.google.com.br/search?hl=pt-BR&q=orienta%C3%A7%C3%A3o+comunidade+rigor&btnG=Pesquisar
Number of topics:
26
Number of topics:
33
Number of topics:
8
Number of topics:
8
--
GregorioIvanoff - 20 Jun 2019
to top