Evaluating evidence found on the Internet

AORN Journal, Nov, 2000 by Suzanne C. Beyea

Section 1 Is the publication reliable?   No   Partially   Yes

 1. Are the aims clear?                   1   2   3   4    5

    Hint: Look for a clear indication at the beginning of
          the publication of

          what it is about;

          what it is meant to cover (and what topics are
          meant to be excluded); and

          who might find it useful.

    If the answer to question 1 is No, go directly to
    question 3.

 2. Does it achieve its aims?             1   2   3   4    5

    Hint: Consider whether the publication provides the
    information it aimed to as outlined in question 1.

 3. Is it relevant?                       1   2   3   4    5

    Hint: Consider whether

          the publication addresses the questions that readers
          might ask, and

          recommendations and suggestions concerning treatment
          choices are realistic or appropriate.

 4. Is it clear what sources of           1   2   3   4    5
    information were used to compile
    the publication (other than the
    author or producer)?

    Hint:
          Check whether the main claims or statements made
          about treatment choices are accompanied by a
          reference to the sources used as evidence
          (eg, a research study or expert opinion).

          Look for a means of checking the sources used, such
          as a bibliography/reference list, addresses of the
          experts or organizations quoted, or external links
          to the online resources.

 5. Is it clear when the information      1   2   3   4    5
    used or reported in the
    publication was produced?

    Hint: Look for

          dates of the main sources of information used to
          compile the publication,

          date of any revisions of the publication
          (but not dates of reprinting in the case of
          print publications), and

          date of  publication (copyright date).

    Rating note: The hints are placed in order of importance
    in order to score a full 5, the dates relating to the
    first hint should be found.

 6. Is it balanced and unbiased?          1   2   3   4    5

    Hint: Look for

          a clear indication of whether the publication is
          written from a personal or objective point of view;

          evidence that a range of sources of information
          was used to compile the publication
          (eg, more than one research study or expert); and

          evidence of external assessment of the publication.

    Be wary if

          the publication focuses on the advantages or
          disadvantages of one particular treatment choice
          without reference to other possible choices;

          the publication relies primarily on evidence from
          single cases (which may not be typical of people
          with this condition or of responses to a particular
          treatment); and

          the information is presented in a sensational,
          emotive, or alarmist way.

 7. Does it provide details of            1   2   3   4    5
    additional sources of support and
    information?

    Hint: Look for suggestions for further reading or for
    details of other organizations providing advice and
    information about the condition and treatment choices.

 8. Does it refer to areas of             1   2   3   4    5
    uncertainty?

    Hint:

          Look for discussion of the gaps in knowledge or
          differences in expert opinion concerning treatment
          choices.

          Be wary if the publication implies that a treatment
          choice affects everyone in the same way (eg, 100%
          success rate with a particular treatment).

Section 2 How good is the quality of     No   Partially   Yes
information on treatment choices?

 9. Does it describe how each             1   2   3   4    5
    treatment works?

    Hint: Look for a description of how a treatment acts on
    the body to achieve its effect.

10. Does it describe the benefits of      1   2   3   4    5
    each treatment?

    Hint: Benefits can include controlling or getting rid
    of symptoms, preventing recurrence of the condition, and
    eliminating the condition, both short-term and long-term.

11. Does it describe the risks of each    1   2   3   4    5
    treatment?

    Hint: Risks can include side-effects, complications, and
    adverse reactions to treatment, both short-term and
    long-term.

12. Does it describe what would happen    1   2   3   4    5
    if no treatment was used?

    Hint: Look for a description of the risks and benefits of
    postponing treatment, of watchful waiting (ie, monitoring how
    the condition progresses without treatment), or of
    permanently forgoing treatment.

13. Does it describe how the treatment    1   2   3   4    5
    choices affect overall quality of
    life?

    Hint: Look for

          description of the effects of the treatment choices
          on day-to-day activity, and

          description of the effects of the treatment choices
          on relationships with family members, friends,
          and career.

14. Is it clear that there may be more    1   2   3   4    5
    than one possible treatment
    choice?

    Hint: Look for

          a description of who is most likely to benefit from
          each treatment choice mentioned and under what
          circumstances; and

          suggestions of alternatives to consider or investigate
          further (including choices not fully described in the
          publication) before deciding whether to select or
          reject a particular treatment choice.

15. Does it provide support for shared    1   2   3   4    5
    decision-making?

    Hint: Look for suggestions of things to discuss with family
    members, friends, physicians, or other health professionals
    concerning treatment choices.

Section 3 Overall rating of the
publication

16. Based on the answers to all of the above questions, rate the
    overall quality of the publication as a source of
    information about treatment choices.

Low serious or   Moderate potentially
extensive        important but not      High minimal
shortcomings     serious shortcomings   shortcomings

    1                2   3   4               5