Personal Documents In Sociology Research

Personal documents are secondary qualitative data, such as diaries and letters, that sociologists use to understand people’s experiences, meanings and social worlds.

Unlike official statistics, they offer a subjective, “insider” perspective on social life. Authors write them for their own purposes, not for researchers (Plummer, 2001).

Interpretivist sociologists prefer personal documents to official statistics. They prioritize validity, meaning the truthfulness and depth of the data. Reliability (consistent, replicable results) and representativeness (how typical the data is of a wider group) matter less to them.

They provide rich qualitative data on feelings, attitudes and motives for behavior, and can be contemporary or historical.

Examples of Personal Documents

  • Diaries & Letters: Intimate, day-to-day accounts of experiences and relationships.
  • Photographs: Visual snapshots of social conditions, clothing, and family structures.
  • Government Certificates: Birth, marriage, and death certificates (essential for demographic history).

  • School Reports: Documenting academic progress, social behavior, and institutional attitudes toward the individual.

  • Wills: Offer insight into family priorities, wealth distribution, and social hierarchies.

  • Rent Books: Evidence of living standards, housing stability, and economic hardship.

  • Property Deeds: Records of land ownership and social status.

  • Digital: Blogs (online diaries), social media profiles, and “scrolled back” Facebook timelines.

Personal documents already exist before the researcher arrives. Working with them is therefore unobtrusive (or nonreactive) research.

Unlike an interview or an experiment, analyzing a diary, letter or blog post cannot alter the behavior being studied.

Researchers usually work through a set of documents using content analysis, or document analysis when the texts are of this kind. The technique means deciding what to record, how to code it and how much weight it deserves for the research question.

A document’s age also matters. A text meant to describe ordinary life can, decades later, mainly show the outlook of its own era. Researchers must read it against the attitudes of its time (see Scott’s “meaning” criterion below).

Famous Sociological Case Studies

1. The Polish Peasant in Europe and America (1918–1920)

Authors: W.I. Thomas and Florian Znaniecki

  • Aim: To explore how Polish immigrants coped with the move from close-knit peasant villages to industrial America, and how attitudes and social organization interact.
  • Method: Thousands of personal letters between immigrants and their families in Poland, obtained by purchase and solicitation. These were supplemented by a solicited autobiography, parish and court records, and newspaper archives.
  • Results: Read as connected series, the letters showed social disorganization: traditional norms and obligations loosened once immigrants left the village. They also revealed a slower, uneven social reorganization, as new norms were negotiated in American cities.
  • Conclusion: Personal documents can support theory about how subjective attitudes relate to objective social values, establishing letter and life-history analysis as a primary sociological method.

Thomas later credited a discarded letter he found on the street with convincing him that even “trash” can carry deep sociological meaning.

The study is widely credited as the founding moment of personal-document research in sociology. Yet the surviving letters were ones people chose to write, keep and sell, so the sample reflects self-selection and survival bias.

2. The Jack-Roller (1930)

Author: Clifford Shaw

  • Aim: To understand delinquency from the inside, and to test whether it stemmed from a young person’s neighborhood and circumstances rather than an inherent defect.
  • Method: Shaw worked with “Stanley,” a young repeat offender in Chicago, who wrote his own life story. Shaw added case records, follow-up interviews and sociological commentary.
  • Results: Stanley traced his delinquent career to an unstable home, inconsistent supervision and early exposure to older delinquent peers and gangs in a disorganized area. It also showed how reform school and probation reshaped his identity.
  • Conclusion: Delinquency could be traced to a disorganized neighborhood’s social ecology, not a fixed individual pathology. This gave the ecological account of crime human weight beside Shaw and McKay’s quantitative zone maps (see social disorganization theory).

The study offered a “bottom-up” view of the justice system and shifted attention from biological theories of crime, such as Lombroso’s, to social ecology.

As a single case, though, it cannot show how typical Stanley’s path was. Shaw also solicited and shaped the narrative, so researcher imposition remains a risk.

3. Cheyenne Memories (1967)

Authors: John Stands In Timber and Margot Liberty

  • Aim: To preserve and present Cheyenne history and culture from the standpoint of Cheyenne oral tradition, correcting a record written almost entirely by outsiders.
  • Method: Stands In Timber recorded oral testimony and tribal memories passed down across generations. He worked with Liberty over several years to edit this material into a collectively authored oral life history.
  • Results: The account challenged “outsider” narratives, offering different versions of events such as conflicts with the US military and settlers. It also preserved cultural knowledge, such as kinship, ceremony and everyday life, that existed only in oral form.
  • Conclusion: Oral tradition, recorded as a personal and collective document, is legitimate sociological and historical data. It gives a group excluded from the official record an insider perspective on its own history.

As a collective oral record edited with an outside co-author, the account may have been reshaped by memory. The co-author’s choices about how to select and organize the material may also have shaped it.

Even so, it shows how personal and collective documents can redress the historical record’s under-representation of Indigenous voices.


Strengths of Personal Documents

1. Practical Advantages

  • Cheap and Accessible: Because the data already exists (secondary data), it saves the researcher the time and money required to collect new data.

  • Instant Access: Digital versions, like blogs, provide instantaneous techniques for gathering data without the need for time-consuming transcription.

  • Ease of Sampling: Modern researchers can use online search engines to quickly find documents based on specific locations or demographics (Grant, 2018).

2. Theoretical Advantages

Personal documents are highly valued by interpretivist sociologists who seek to understand the meanings people give to their behavior.

  • High Validity: These documents provide a rich, detailed, and valid insight into the everyday experiences and feelings of individuals in their natural environments.

  • Authentic: Personal documents are often created for the individual’s own purposes rather than for research, which can make them more authentic. 
  • Understanding “Meanings”: Interpretivist sociologists favor them because they reveal the subjective meanings people apply to their actions (verstehen, Weber’s term for empathetic, insider understanding of another person’s motives).

  • Overcoming Impression Management: Anonymous documents, like certain blogs or private diaries, can bypass impression management (trying to look good for others, or “face-work”), allowing more honest and candid accounts.

  • Capturing the “Ever-Changing Present”: Diaries, in particular, tie an experience closely to its record, reducing the risk of memory loss and retrospective reconstruction (distortion in accounts written long afterwards).

3. Unique Research Applications

  • Supplementing Quantitative Data: Qualitative documents are often used to add “human” context to official statistics.

  • Accessing “Closed” Groups: They provide a window into subcultures that are difficult to reach, such as criminal gangs or socially removed populations.

  • Historical Insight: They are often the only way sociologists can gain an insider perspective on the past.

  • Social Change: Longitudinal documents (like diaries kept over years) or life histories allow sociologists to see how individuals and societies change over time.

4. Applications Across Fields

Researchers use personal documents well beyond the classic case studies.

  • Criminology: Offenders’ life histories and written accounts help researchers study desistance from crime (stopping offending) and experiences of the justice system, alongside neighborhood-level evidence (see social disorganization theory).
  • Health research: Diaries and blogs kept by patients, carers and clinicians capture the daily experience of chronic illness, pregnancy, bereavement and caregiving, detail that structured clinical interviews often miss.
  • Historical demography: Certificates, wills, rent books and parish records let historical demographers reconstruct household composition, migration and social mobility before large-scale social surveys existed.
  • Indigenous history: Partnerships with Indigenous communities record oral testimony that would otherwise be lost, as in Cheyenne Memories, and set it against accounts written entirely by outsiders.
  • Digital ethnography: Researchers studying online communities increasingly treat blogs, social media timelines and even chat logs as personal documents, applying elicitation and scroll-back methods.

Limitations of Personal Documents

1. Practical Issues: Access and Selection

  • Barriers to Access: Many documents are regarded as private and confidential, making them difficult for researchers to obtain.

  • Incrimination Risk: In criminology, few individuals leave records of illegal acts because such documents could be used as evidence for prosecution.

  • Survival Bias: Not all documents survive over time; there is no way to guarantee that the letters or diaries that remain are representative of those that were lost or destroyed.

2. Theoretical Issues: The “Positivist” Critique

Positivists often reject personal documents because they lack the scientific rigor of quantitative methods.

  • Low Reliability: Because every diary or letter is unique, they are not standardized and cannot be easily replicated or checked for accuracy.

  • Lack of Representativeness: Historically, personal documents are often produced by literate, middle-class professionals with the leisure time to write, excluding the voices of the illiterate or the working class.

  • Generalization Problems: Due to the small, unique nature of these “samples,” it is difficult for sociologists to apply the findings to the wider population.

Plummer (2001) challenges this standard. As Plummer argues, generalizability is the wrong test, because a document’s value lies in its situated, particular access to meaning, not in law-like claims. This defense accepts the positivist description of the data but rejects the positivist criterion for judging it.

3. Validity Issues: Bias and Interpretation

  • Impression Management: Authors often “perform” for a potential audience, justifying their actions or presenting a non-objective, “polished” version of themselves.

  • Memory Distortion: Documents written long after an event (like memoirs) are susceptible to “retrospective reconstruction,” where details are forgotten or exaggerated.

  • Authenticity Doubts: There is always a risk of forgery, where documents are created to deceive the public or historians.

  • Researcher Imposition: Different sociologists may interpret the same document in conflicting ways, imposing their own meanings rather than uncovering the author’s original intent.

4. Ethical Considerations

  • Informed Consent: If the author is alive, using their private material can have negative social or legal consequences for them.

  • Privacy Expectations: Even if a document (like a blog) is technically public, the author may still have a “perceived expectation of privacy” that the researcher must respect.

Scott’s Quality Criteria

When evaluating a document’s limitations, students should apply Scott’s (1990) four criteria to determine if the source is fit for research.

1. Authenticity: Is it Genuine?

Researchers must verify that the document is an original “document of life” and not a forgery.

  • The Challenge: Digital documents like blogs can be easily faked; researchers must use technical checks to ensure a blogger is “legit” and not a simulated persona.

  • Classic Example: The “Hitler Diaries,” which were initially hailed as a historical find but later proven to be fakes created with modern paper and ink.

2. Credibility: Is it Sincere?

A document might be “authentic” (really written by the author) but still lack credibility if the author is being dishonest.

  • Impression Management: Authors often “perform” for an audience, selecting specific life episodes to appear more moral or virtuous than they really are.

  • Retrospective Reconstruction: Accounts written long after the fact (like memoirs) may be distorted by memory loss or a desire to justify past mistakes.

3. Representativeness: Is it Typical?

This refers to whether the document is representative of the wider group being studied.

  • The “Literacy Gap”: Historically, personal documents were mostly produced by middle-class professionals who had the time and education to write, excluding the voices of the poor.

  • Survival Bias: We only have access to documents that were preserved; we cannot know if the lost diaries of common criminals would have told a different story.

4. Meaning: Can we Understand it?

The researcher must interpret the “storied form” of the document without imposing their own modern biases.

  • Interpretive Struggles: Words and social values change over time. For example, a 19th-century diary entry about “family discipline” might mean something very different to a researcher today.

  • Shared Understanding: To solve this, modern researchers often use elicitation interviews, where the author stays present to explain the document’s true meaning to the sociologist.

Modern Methods: Elicitation & Digital Research

Modern sociological research has moved beyond simply “finding” old documents.

Today, researchers often collaborate with participants to produce documents or use the vast amount of data generated in digital spaces (Prior, 2003).

1. Document Elicitation Interviews

In this method, documents are used as a tool or “topic guide” to shape a conversation. Instead of the researcher being the sole “expert,” the participant leads the way by explaining their own records.

  • Pre-existing Documents: Participants bring personal items like family photographs, leaflets, or baby weight charts to an interview.

  • The Benefit of Presence: Unlike analyzing a historical diary, the author is present to explain exactly what the document means, reducing the risk of researcher misinterpretation.

  • Reducing Power Imbalance: Using a physical object can make the interview feel more like a shared conversation and less like a formal “interrogation” by an authority figure.

2. Participant-Created Documents

Researchers often ask participants to create new documents specifically for the study to capture feelings that are hard to put into words.

  • Life-History Timelines: Participants draw a line of their life, marking key events and the emotions associated with them.

  • Visual Creations: Techniques like collaging or using thought bubbles allow participants to describe complex experiences (like the “surveillance” felt during pregnancy) in a non-linear way.

  • Sandboxing: Participants select symbolic 3D objects and arrange them in a sand tray to create a “scene” representing their reality.

3. Digital Research (The Blogosphere)

Blogs and social media have transformed personal document research by providing a low-cost, global and near-instantaneous source of data (Hookway, 2008).

  • The Online Diary: Blogs are often viewed as “self-narratives” or online extensions of traditional diaries.

  • Anonymity vs. Performance: While bloggers may engage in “face-work” (trying to look good for an audience), the anonymity of the internet can also lead to highly confessional and honest writing.

  • Longitudinal Potential: Because blogs are archived by date, sociologists can track how a person’s attitudes or moral decision-making change over many years.

  • “Scrolling Back”: Some researchers use social media elicitation, where they sit with a participant and “scroll back” through their Facebook or Instagram history to trigger memories and reflections.

Critical Evaluation of Personal Documents

Interpretivist vs Positivist Views

Personal documents sit at the center of the dispute between interpretivist and positivist sociology. The same quality draws praise from one camp and criticism from the other.

  • Interpretivist view: A rich, authentic, first-person window onto the meanings people give their own lives.
  • Positivist view: That richness makes the data unstandardized, hard to replicate and difficult to generalize from, so official statistics are preferred.

The strongest defense is not that personal documents escape bias. Scott’s (1990) four criteria give researchers an explicit, checkable way to weigh a document’s authenticity, credibility, representativeness and meaning. No document is simply trustworthy or simply suspect.

The same criteria can now be applied to digital documents too, as the study of Facebook timelines below shows (Robards & Lincoln, 2017).

Personal Documents vs Other Qualitative Methods

Within the interpretivist toolkit, personal documents occupy a distinctive niche. They complement interviews and observation rather than simply replacing them.

  • Interviews: A document is written for the author’s own purposes, not in answer to a researcher’s questions, so it is less shaped by an interviewer. This naturalism is only partial, since authors still write with an audience in mind.
  • Participant observation and ethnography: Documents offer temporal reach that an observer present for only a limited fieldwork period cannot match. The cost is losing the observer’s first-hand check on what an account leaves out.
  • Official statistics: Personal documents trade replicability and the capacity to generalize for direct access to the author’s own meaning.

Thomas and Znaniecki’s letters and the Cheyenne Memories oral record both reach back to events no living researcher could have observed directly.

Researchers therefore often use personal documents to supplement other methods rather than replace them. Shaw’s autobiography alongside Shaw and McKay’s ecological zone maps is the clearest example.

Contemporary Research

The clearest recent development is not a new document type but a new way of reading one. Researchers now treat a “scrolled-back” social media timeline as a shared object of analysis. The researcher and the timeline’s author analyze it together.

Robards and Lincoln (2017) tested this idea on Facebook.

  • Aim: To test whether five or more years of Facebook use by people in their twenties could work as a longitudinal personal-document archive of growing up.
  • Method: Researchers developed the “scroll-back” method. Participants worked chronologically back through their own Facebook Timeline in an interview, acting as co-analysts of their posts, photos and comments.
  • Results: Timelines kept over several years worked as genuine longitudinal narrative texts. They let participants and researchers trace shifts in disclosure, self-presentation and major life events across young adulthood.
  • Conclusion: Sustained social media use creates personal documents with real longitudinal value. Because the author stays present to explain their own record, scroll-back also answers the “meaning” problem in Scott’s criteria.

The participants were self-selected, long-term Facebook users. The findings may not generalize to other platforms or to users who curate their profiles heavily. The authors also flag open questions about whether a Timeline shows real intentions or impression management for an anticipated audience.

This finding sits alongside older evidence on blogs (Hookway, 2008). Together, they suggest digital personal documents extend the strengths and weaknesses of paper diaries and letters rather than replacing them. Their meaning is best secured by keeping the author involved in interpreting the record.

Key Takeaways

  • Definition: Personal documents are secondary qualitative data, such as diaries, letters and blogs, that offer an “insider” view of social life.
  • Validity: Interpretivist sociologists prize them for validity, meaning rich, truthful insight into the meanings people give their own behavior.
  • Classic Studies: Thomas and Znaniecki’s letters, Shaw’s Jack-Roller and Cheyenne Memories show documents can support sociological theory.
  • Limitations: Positivists object that documents are unrepresentative, hard to replicate and prone to bias, forgery and selective survival.
  • Scott’s Criteria: Authenticity, credibility, representativeness and meaning give researchers a checklist for judging whether a document is fit for research.
  • Digital Methods: Elicitation interviews and “scroll-back” interviews keep the author present to explain their own record, including on social media.
Simply Psychology Answers
Instant answers built on 19+ years of trusted expertise.

References

Grant, A. (2018). Doing excellent social research with documents: Practical examples and guidance for qualitative researchers. Routledge.

Hookway, N. (2008). Entering the blogosphere: Some strategies for using blogs in social research. Qualitative Research, 8(1), 91–113. https://doi.org/10.1177/1468794107085298

Simply Psychology Answers
Instant answers built on 19+ years of trusted expertise.

Plummer, K. (2001). Documents of life 2: An invitation to a critical humanism (Vol. 2). Sage.

Simply Psychology Answers
Instant answers built on 19+ years of trusted expertise.

Prior, L. (2003). Using documents in social research. Sage. https://doi.org/10.4135/9780857020222

Robards, B., & Lincoln, S. (2017). Uncovering longitudinal life narratives: Scrolling back on Facebook. Qualitative Research, 17(6), 715–730. https://doi.org/10.1177/1468794117700707

Scott, J. (1990). A matter of record: Documentary sources in social research. Polity Press.

Shaw, C. R. (1930). The Jack-roller: A delinquent boy’s own story. University of Chicago Press.

Stands In Timber, J., & Liberty, M. (1967). Cheyenne memories. Yale University Press.

Thomas, W. I., & Znaniecki, F. (1918–1920). The Polish peasant in Europe and America (Vols. 1–5). Badger.

Simply Psychology Answers
Instant answers built on 19+ years of trusted expertise.
personal documents 1
More Simply Psychology Answers
Instant answers built on 19+ years of trusted expertise.
More Simply Psychology Answers
Instant answers built on 19+ years of trusted expertise.

Olivia Guy-Evans, MSc

BSc (Hons) Psychology, MSc Psychology of Education

Associate Editor for Simply Psychology

Olivia Guy-Evans is a writer and associate editor for Simply Psychology, where she contributes accessible content on psychological topics. She is also an autistic PhD student at the University of Birmingham, researching autistic camouflaging in higher education.


Saul McLeod, PhD

Chartered Psychologist (CPsychol)

BSc (Hons) Psychology, MRes, PhD, University of Manchester

Saul McLeod, PhD, is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.