Chapter 10 - Evaluating and Interpreting Information

Summary:
A vast amount of information is floating  around and it's our responsibility to sort through it so that the information can be used effectively and accurately.  All information is equal and should be interpreted that way. The Key Points explain how.

Key Points:

Evaluate the Sources:

• Determine the currency of the source
• Technology
• People
• Assess the reputation of a printed source
• Possibly refereed
• Assess the dependability of an Internet or database source
• Anyone can publish information
• Consider the sponsorship and the motives for the study
•  Check who is supplying those writing and their interests
• Cross check the source against other, similar sources
•  Verify, with other sources, your information
• Guidelines for Evaluating Sources from the Web
• Consider the sites domain type and sponsor
• Identify the purpose of the site
• Look beyond the style of the site
• Assess the site's/material's currency
• Assess the author's credentials
• Decide whether the assertions/claims make sense
• Compare the site with other sources
• Look for other indicators of quality 

Evaluate the Evidence:

• Determine the sufficiency of the evidence
• Differentiate hard from soft evidence
• Hard Evidence - facts. expert opinions, verifiable statistics
• Soft Evidence - uninformed opinion or speculation
• Decide whether the presentation of evidence is balanced and reasonable
• Consider how the facts are being framed
• Frame of Reference - a set of ideas, beliefs, or views that influences our interpretation or acceptance of other ideas

Interpret Your Findings:

• Identify Your Level of Certainty
• The conclusive answer
• The probable answer
• The inconclusive answer
• Examine the Underlying Assumptions
• Be Alert for Personal Bias
• Consider Other Possible Interpretations

Avoid Errors in Reasoning:

• Faulty Generalizations
• Limited observation to sweeping conclusion
• Hosty Generalization
• Overstated Generalization
• Faulty Causal Reasoning
• Trying to prove why something happened by taking a incorrect correlation and applying it
• Faulty Statistical Reasoning
• The Sanitized Statistic
• The Meaningless Statistic
• The Undefined Average
• The Distorted Percentage Figure
• The Bogus Ranking
• Confusion of Correlation with Causation
• The Biased Meta-Analysis
• The Fallible Computer Model
• Misleading Terminology

Acknowledge the Limits of Research:

• Obstacles to Validity and Reliability
• Flaws in Research Study
• Epidemiological Studies
• Laboratory Studies
• Human Exposure Studies
• Measurement Errors
• Deceptive Reporting
• Guidelines for Evaluating and Interpreting Information
• Evaluate the Sources
• Check the posting or publication date
• Asses the reputation of each printed source
• Asses the quality of each electronic source
• Identify the study's sponsor
• Look for corroborating sources
• Evaluate the Evidence
• Decide whether the evidence is sufficient
• Look for a fair and balanced presentation
• Try to verify the evidence
• Interpret Your Findings
• Don't expect "certainty"
• Examine the underlying assumptions
• Identify your personal bias
• Consider alternate interpretations
• Check for Weak Spots
• Scrutinize all generalizations
• Treat causal claims skeptically
• Look for statistical fallacies
• Consider the limits of computer analysis
• Look for misleading terminology
• Interpret the reality behind the numbers
• Consider the study's possible limitations
• Look for the whole story