The Observation Method Errors I Most Often Edit in Psychology Dissertations

The Observation Method Errors I Most Often Edit in Psychology Dissertations

Observation is one of the most methodologically demanding approaches used in psychology dissertations. When applied well, it can capture real behaviour in context without relying on self-report. However, when applied poorly—or more commonly, when reported poorly—it can raise significant questions about validity, reliability, and transparency.

When editing psychology dissertations, I often find that observational studies are not necessarily poorly conducted, but they are frequently under-described. Small gaps in reporting can make it difficult for examiners to understand what actually happened during data collection.

Below are the most common observation method errors I encounter when reviewing psychology dissertations, along with ways to improve them.

1. Not Clearly Defining the Type of Observation

A frequent issue is failing to specify what kind of observation was used.

Observation can take many forms, including:

• Structured observation

• Unstructured observation

• Participant observation

• Non-participant observation

• Naturalistic observation

• Controlled observation

Yet many dissertations simply state:

Observation was used to collect data.

This does not provide enough methodological clarity.

A stronger description specifies both structure and role, for example:

A structured, non-participant observation was conducted in a classroom setting to record student engagement during group activities.

This immediately clarifies what was done and how the researcher was positioned.

2. Vague or Non-Operational Behaviour Definitions

One of the most common weaknesses in observational research is unclear definition of what is actually being observed.

Students often refer to broad concepts such as:

• “engagement”

• “interaction”

• “behaviour”

• “attention”

without defining them in observable terms.

For example, “engagement” might mean:

• Number of verbal contributions

• Eye contact with task materials

• Participation in group discussion

• Time spent on-task

Without clear operational definitions, different observers could interpret the same behaviour differently, reducing reliability.

3. Missing or Weak Observation Schedule

Structured observational studies typically rely on an observation schedule or coding framework, but this is often poorly reported or entirely absent.

Common issues include:

• No description of categories used

• No explanation of how behaviors were coded

• No pilot testing of the schedule

• No link between observation categories and research questions

A strong methodology section should briefly explain how the observation tool was developed and how it ensured consistency in data collection.

4. Lack of Clarity About the Researcher’s Role

Another frequent problem is failing to specify whether the researcher was:

• A participant observer (actively involved in the setting), or

• A non-participant observer (detached and observing only)

This distinction matters because the researcher’s presence can influence participant behaviour, often referred to as the observer effect.

When editing dissertations, I often find this point either missing entirely or inconsistently described.

A clear statement of researcher role improves transparency and methodological rigor.

5. Inadequate Description of the Setting

The observational setting is central to interpretation, but it is often described too briefly.

Important details include:

• Where the observation took place (e.g., classroom, clinic, playground, online setting)

• Whether the environment was natural or controlled

• Relevant contextual factors (e.g., class size, session structure)

• Timing and duration of observation

Without this information, it becomes difficult for readers to evaluate external validity or replicate the study.

6. No Explanation of Duration or Sampling Strategy

Many dissertations fail to report how observations were structured over time.

Key missing details include:

• Number of observation sessions

• Length of each session

• Total observation time

• Whether time sampling or event sampling was used

For example, it is important to know whether behaviour was recorded continuously or at specific intervals.

This information is essential for evaluating methodological robustness.

7. Ignoring Reliability and Consistency

Reliability is a major concern in observational research, particularly when coding behaviour.

However, many dissertations do not address:

• Inter-rater reliability (if more than one observer is used)

• Training procedures for observers

• Agreement between coders

• Procedures for resolving discrepancies

Even in single-observer studies, some acknowledgement of subjectivity is expected.

8. Ethical Issues Not Fully Addressed

Observation raises specific ethical considerations that are often underdeveloped in dissertations.

These include:

• Informed consent from participants (when applicable)

• Privacy in naturalistic settings

• Use of covert observation (and justification if used)

• Data anonymization and confidentiality

Ethical clarity is particularly important when observing vulnerable populations such as children or clinical groups.

9. Confusing Observation With Informal Description

Some dissertations describe “observations” when they are actually referring to informal note-taking or general impressions.

True observational research should involve:

• Systematic recording procedures

• Defined behavioural categories

• Consistent methods across sessions

Without these elements, the method risks being closer to anecdotal description than structured research.

10. Weak Link Between Observation and Research Questions

Finally, a common issue is a lack of connection between what is observed and what the study is trying to answer.

Effective observational research should clearly show:

• Why observation is the appropriate method

• How observed behaviors relate to research aims

• How data collection supports the research questions

Without this alignment, observation can feel methodologically disconnected from the broader dissertation.

Final Thoughts on The Observation Method Errors I Most Often Edit in Psychology Dissertations

Observation can be a highly effective method in psychology research when it is carefully designed and clearly reported. However, many of the issues I encounter when editing psychology dissertations are not related to poor observation itself, but to missing detail and unclear methodological reporting.

A strong Chapter 3 section should clearly define the type of observation used, explain what behaviors were recorded, describe the researcher’s role, and provide sufficient detail about the setting and procedure. When these elements are reported clearly and consistently, observational research becomes much easier for examiners to understand and evaluate.