How to Read a Paper

A Practical Three-Pass Method for Efficient Paper Reading
Based on S. Keshav's seminal guide from the University of Waterloo

Why This Matters

Researchers spend hundreds of hours annually reading papers, yet this critical skill is rarely taught systematically. Graduate students often learn through trial and error, and experiencing frustration. This guide presents a disciplined, efficient approach. The three-pass method prevents drowning in details before gaining a bird's-eye view, allows accurate time estimation for paper review, and enables adjustment of evaluation depth based on specific needs and available time.

The Three-Pass Method

Read papers in up to three passes, with each pass accomplishing specific goals and building upon the previous pass. Click on each pass to explore the details.

1
First Pass
5-10 min
Get a bird's-eye view of the paper

Steps:

  1. Carefully read the title, abstract, and introduction
  2. Read section and sub-section headings (ignore everything else)
  3. Read the conclusions
  4. Glance over references, noting familiar ones

Outcome: Answer the Five Cs

Category
What type of paper?
Context
Related work & theory
Correctness
Valid assumptions?
Contributions
Main innovations
Clarity
Well written?
2
Second Pass
Up to 1 hour
Grasp the paper's content, but not details

Focus Areas:

  1. Look carefully at figures, diagrams, and illustrations
  2. Pay special attention to graphs - check axes labels and error bars
  3. Mark relevant unread references for further reading
  4. Jot down key points and make margin comments

Outcome:

Summarize the main thrust with supporting evidence. Appropriate for papers in your area of interest but outside your specialty.

If you don't understand: Subject may be new, unfamiliar techniques used, poor writing, or you're tired. Choose to: set aside, return later, or proceed to third pass.

3
Third Pass
1-5 hours
Understand the paper in depth

Virtual Re-implementation:

  1. Make the same assumptions as authors
  2. Attempt to re-create the work
  3. Compare your re-creation with the actual paper
  4. Identify and challenge every assumption
  5. Think about alternative presentations

Outcome:

Reconstruct the entire paper structure from memory. Identify innovations, hidden failings, assumptions, missing citations, and potential issues with experimental techniques.

Bonus: Add new proof and presentation techniques to your repertoire.

Interactive Reading Checklist

Use this checklist to track your progress through the three-pass method:

Read title, abstract, and introduction carefully
Scan all section and sub-section headings
Read conclusions section
Review references list
Answer the Five Cs (Category, Context, Correctness, Contributions, Clarity)
Examine all figures, diagrams, and graphs carefully
Check graph axes and error bars for statistical significance
Mark unread references for future reading
Take notes and make margin comments
Identify and challenge every assumption
Consider alternative presentations of ideas
Note ideas for future work
Source: Keshav, S. (2007). How to read a paper. ACM SIGCOMM Computer Communication Review, 37(3), 83-84.