Critique: Why the Most Important Problems in Research Papers Often Appear Before the Results Section
As lecturers, researchers, and graduate supervisors, we spend considerable time teaching students how to conduct research.
Far less time is spent teaching them how to evaluate it.
Yet the ability to critique a study may be one of the most important scholarly skills a researcher can develop.
A critique is not a summary with comments attached.
Nor is it an exercise in fault-finding.
At its highest level, a critique is an investigation into the architecture of a knowledge claim.
It asks a deceptively simple question:
Do the conclusions genuinely follow from the evidence?
The more linguistic research I read, from formal syntax and psycholinguistics to corpus linguistics and language acquisition, the more convinced I become that the most consequential weaknesses in research are often not empirical.
The data may be perfectly reasonable.
The statistics may be technically correct.
The writing may be polished.
The problem frequently lies deeper.
It lies in the relationship between theory, methodology, evidence, and interpretation.
In other words, it lies in the architecture.
Problem 1: Theoretical Allegiance Without Theoretical Commitment
One of the most common issues in academic writing is what might be called theoretical borrowing.
A paper invokes sophisticated concepts from a particular framework, perhaps Merge, phase theory, feature valuation, construction grammar, or usage-based learning, but the research design is not actually constructed to investigate those concepts.
The theoretical framework and the methodology seem to belong to different intellectual conversations.
The crucial place to look is the transition between the literature review and the research design.
A coherent study moves naturally from theoretical assumptions to methodological decisions.
An incoherent study requires a conceptual leap that is never fully explained.
When theory and method cease to speak the same language, explanatory power begins to erode.
Problem 2: Confusing Evidence About Language Use With Evidence About Language Knowledge
One of the enduring methodological questions in linguistics concerns the relationship between what speakers know and what speakers do.
Language use is observable.
Mental representations are not.
Corpus frequencies, conversational patterns, and production data provide valuable evidence about linguistic behavior. However, they do not automatically provide direct evidence about the structure of underlying cognitive representations.
This does not diminish the importance of corpus-based research.
It simply reminds us that every method has inferential limits.
A sophisticated critique asks:
What kind of claim can this evidence legitimately support?
The quality of a study often depends less on the amount of data collected than on whether the conclusions remain within the boundaries established by that data.
Problem 3: The Sampling Problem That Rarely Receives Enough Attention
Many linguistic studies rely on practical constraints.
Researchers work with available participants, limited resources, and restricted access to populations.
This is understandable.
What deserves scrutiny is not the existence of limitations but the conclusions drawn despite them.
A sample of thirty students from a single institution may generate useful findings.
It may reveal interesting tendencies.
It may even identify important patterns.
What it cannot do is automatically support broad claims about entire speech communities, language varieties, or national populations.
The scope of a conclusion should never exceed the scope of the evidence on which it rests.
A strong critique continuously monitors this relationship.
Problem 4: Statistical Precision Is Not the Same as Explanatory Adequacy
Contemporary linguistics has become increasingly quantitative.
This development has produced important advances in experimental design and analytical rigor.
Yet statistical sophistication should not be confused with theoretical insight.
A highly sophisticated model applied to an unsuitable research question remains problematic.
Similarly, a statistically significant result does not automatically become a theoretically meaningful result.
The central question remains unchanged:
Does the analysis provide evidence for the claim being made?
Methods should serve explanations, not replace them.
Problem 5: The Quiet Expansion of Claims in the Discussion Section
Perhaps the most common weakness in research writing appears at the very end of a paper.
The data support one conclusion.
The discussion advances a slightly larger conclusion.
The conclusion section advances a larger one still.
By the final paragraph, a modest empirical finding has become a sweeping theoretical statement.
This process is rarely deliberate.
Researchers naturally want their findings to matter.
Yet scholarly rigor requires restraint.
A well-written discussion section demonstrates intellectual discipline by distinguishing clearly between:
- What the data show
- What the data suggest
- What remains uncertain
The most persuasive scholars are often those who understand the limits of their evidence.
A Framework for Reading Research Critically
Whenever I read a research paper, I increasingly find myself moving through the following sequence:
Research Question
↓
Theoretical Assumptions
↓
Methodological Design
↓
Data and Evidence
↓
Analysis
↓
Interpretation
↓
Knowledge Claim
At every stage, I ask the same question:
Does the next step logically follow from the previous one?
If the chain remains intact, the study possesses explanatory coherence.
If one link breaks, the argument becomes vulnerable regardless of how impressive the remaining sections may appear.
Why Critique Matters
Research advances not only because scholars produce new knowledge.
It advances because scholars evaluate knowledge claims carefully.
A good critique does not seek to defeat an author.
It seeks to strengthen an argument.
It identifies conceptual gaps before they become accepted assumptions.
It distinguishes evidence from speculation.
It protects a discipline from confusing methodological sophistication with explanatory success.
Most importantly, it reminds us that scholarship is not simply about generating findings.
It is about generating findings that can withstand scrutiny, and that, ultimately, is the purpose of critique.
