01 / 08Think

Ask a better question

A friend says a new diet "works." A manager says the project is "behind." A headline says coffee is good for you. Each sentence sounds like an answer, and each one hides questions no one has asked yet. Works for whom, measured how, compared with what? Behind which date, and by how much? In a class the moment comes when a chapter ends and everything in it seemed clear. At work it comes in a meeting where everyone nods. A good question turns a sentence that sounds finished into one that can be checked. It asks what a word means, what the evidence is, and what would follow if the claim were true. This lesson asks those questions on purpose: of a text, of other people, and of your own first answer.

In five minutesTake one claim you heard today. Write three questions about it: what does the key word mean, how does anyone know, and compared with what? Then answer one of them.

Method · Socratic questioning  /  Philosophy · Teaching

01Where it comes from

The model is Socrates, the Athenian put on trial in 399 BCE. In Plato's Apology he tells the jury that an oracle called him the wisest of men. He set out to test it by questioning people known for wisdom: politicians, poets and craftsmen. Each knew less than he claimed. Socrates at least knew what he didn't know (see Voices). In the same speech he questions his accuser Meletus in court, one short question at a time. Scholars call this kind of testing the elenchus, from the Greek for examination or refutation. Modern research came at questioning from the classroom. From the 1970s on, education researchers taught students to write their own questions about what they read or heard, with prompts such as who, why and how, or stems such as "What is the main idea of...?" [1][2]. Barak Rosenshine and colleagues reviewed those studies in 1996 [1].

Also called The Socratic method, elenchus, self-questioning, question generation, question stems.

Knowing what you don't know

for he knows nothing, and thinks that he knows; I neither know nor think that I know.

Socrates, in Plato, Apology 21d, in The Defense · tr. Benjamin Jowett

Socrates has just questioned a politician with a name for wisdom and found the reputation larger than the knowledge. The man hated him for it. Socrates claims only a small advantage: he does not mistake what he doesn't know for knowledge. He started from a claim about himself, the oracle's, and set out to test it. His questions serve to find out what is actually known.

Read it in full: Apology, The Defense

One more question

But that, my good sir, is not my meaning. I want to know who the person is, who, in the first place, knows the laws.

Socrates, in Plato, Apology 24d to 24e, in The Defense · tr. Benjamin Jowett

Meletus has charged Socrates with corrupting the young. Socrates asks who improves them. Meletus answers "The laws," which sounds like an answer and names no one. Socrates asks again, for a person. The exchange runs on through the judges, the audience and the assembly, until Meletus says every Athenian improves the young except Socrates. Each answer meets one short question.

Read it in full: Apology, The Defense

02The method

Socratic questioning

  1. Write the claim or question you are working on in one sentence at the top of a page.
  2. Ask what each key word means here. Circle any word two people could read differently.
  3. Ask for the evidence. How do we know? Compared with what? Who measured it, and how?
  4. Ask what follows. If this is true, what else must be true? What would we expect to see if it were false?
  5. Take the answer you get and ask one more question of it, the way Socrates asked Meletus which person knows the laws.
  6. For anything you study, write your own questions with stems such as "Why does...?", "How is... related to...?" and "What would happen if...?" Answer them without notes.

03An example

What it looks like done

Worked on The second sentence of the Enchiridion, chapter 1: "Not in our power are the body, property, reputation, offices"

Questions

1. What does "in our power" mean here: fully, or partly?

2. Is the body really out of my power, when I choose what I eat and how I train?

3. How does Epictetus know? Is this an argument or a starting rule?

4. Compared with what? What does he put on the other list?

5. If he is right, what would follow about a bad review at work?

6. What would I expect to see if he were wrong?

Answers from memory

1. Not sure. He seems to mean what is fully mine to decide. Check the text.

2. I choose the actions. The result, my weight or an injury, is not fully mine. So he may mean the outcome, not the effort.

3. It reads as a starting rule. He gives no evidence in this chapter.

4. Opinion, desire, aversion: "whatever are our acts."

5. The review is not in my power. My reply to it is.

6. Someone who controls a thing on his second list completely. Reputation comes closest, and even that depends on others.

The text: The Enchiridion, Chapter 1

04Try it · 20 minutes

For a class

Read the first part of Socrates' defense in Plato's Apology, through his questioning of Meletus. Fifteen minutes. List every question Socrates asks Meletus, and mark each one: does it ask for a meaning, for evidence, or for what follows? Then write five questions of your own about the last textbook chapter you read, using the stems in step 6, and answer them from memory.

Open it in the reader: Apology, The Defense

For work and life

Pick a claim you heard this week and are inclined to believe: a news story about health or money, a coworker's estimate, a product review. Write it in one sentence. Spend ten minutes writing questions only, no answers: what each word means, how anyone knows, compared with what, and what would follow. Then pick the two questions that matter most and find out the answers.

The blank page for this is in the Think workbook.

05Where it goes wrong

  • Questions as attacks. Socrates' questioning made him enemies, and the Apology says so. A question asked to win sounds like a trap. Ask to find out, and say that is why you're asking.
  • Too many at once. A list of twenty questions leaves no time for any answer. Pick the two that would change the most if answered.
  • Taking the first answer. Meletus answered "The laws." Socrates asked who. First answers are often the vague ones. Ask one more question.
  • Only questioning others. The habit is easiest to point outward. Turn the same questions on your own first answer before you defend it.
  • Questions you can answer by copying. "When was it founded?" can be answered by finding one line. Stems that ask why, how, or how two ideas relate take more thought.

06Research

What research has measured

Writing your own questions

Shown that teaching students to write their own questions about what they read improves their understanding of new material.

The numbers and sources
Effect
Students taught to generate questions about what they read gained in comprehension on tests of new material. The median effect was 0.36 on standardized tests and 0.86 on tests the researchers wrote [1]. A later review of 35 experiments found self-questioning improved reading comprehension across a range of students and school settings [3].
Population
School students in the intervention studies [1]. Students from kindergarten to grade 12, with and without disabilities, in 35 experimental studies [3]. The 1996 abstract does not give a count.
Caveats
Effects were much smaller on standardized tests than on the researchers' own tests [1]. Nearly all the studies are of school reading, not adults learning at work [1][3].

Questions after a lecture

Early studies suggest that writing and answering your own questions after a lecture helps people remember it a week later.

The numbers and sources
Effect
College students who wrote and answered their own questions about a lecture recalled more of it a week later than students who reviewed their notes, and somewhat more than students who wrote summaries. Summarizers did best on the test right after the lecture [2]. In a university course, generating questions improved recall after one week compared with restudying, about as much as answering practice questions did [4].
Population
College students in three study groups [2]. Students in one university lecture course [4]. The abstracts do not give participant counts.
Caveats
Two studies, each in one setting. In the second, the benefit for applying knowledge to new problems appeared only in an added Bayesian analysis [4].

07Check yourself

Answer from memory first. The next lesson asks these again.

Why ask what a claim is being compared with?

A claim like "it works" or "it's behind" only means something next to a baseline: another diet, the planned date, doing nothing. Naming the comparison turns a vague claim into one that can be checked.

Why ask one more question of the first answer?

First answers are often vague but sound complete, as "The laws" did for Meletus. The second question asks for the specific person, number or case, and that is usually where the real gap shows.

Why write your own questions instead of reading the material again?

Writing a question makes you search the text and connect its parts to find what matters. In the studies, students who did this understood and recalled more than those who reread or reviewed notes.

Sources
  1. Rosenshine B, Meister C, Chapman S. Teaching students to generate questions: A review of the intervention studies. Review of Educational Research. 1996;66(2):181-221. https://doi.org/10.3102/00346543066002181
  2. King A. Comparison of self-questioning, summarizing, and notetaking-review as strategies for learning from lectures. American Educational Research Journal. 1992;29(2):303-323. https://doi.org/10.3102/00028312029002303
  3. Joseph LM, Alber-Morgan S, Cullen J, Rouse C. The effects of self-questioning on reading comprehension: A literature review. Reading & Writing Quarterly. 2016;32(2):152-173. https://doi.org/10.1080/10573569.2014.891449
  4. Ebersbach M, Feierabend M, Nazari KBB. Comparing the effects of generating questions, testing, and restudying on students' long-term recall in university learning. Applied Cognitive Psychology. 2020;34(3):724-736. https://doi.org/10.1002/acp.3639

MVIII puts the day in front of you each morning. Get MVIII