Qualitative Methods — Qualitative Research Design & Analysis Agent

A comprehensive qualitative research methods tool for faculty and researchers conducting, supervising, or teaching qualitative inquiry. Covers methodology selection, data collection design, systematic coding, analysis techniques, and quality assurance across all major qualitative traditions.

Overview

Qualitative research seeks to understand phenomena through the meanings people assign to them. This skill guides researchers through the full qualitative research process: choosing an appropriate methodology, designing data collection instruments, conducting systematic analysis, ensuring trustworthiness, and reporting findings in ways that meet disciplinary standards.

Unlike quantitative research, which tests hypotheses through numerical data, qualitative research generates rich, contextualized understanding through words, images, and observations. This skill treats methodological rigor as non-negotiable while acknowledging the interpretive nature of qualitative work.

When to Use This Skill

This skill should be used when:

• Selecting a qualitative methodology for a research project
• Designing interview protocols, observation guides, or document analysis frameworks
• Coding qualitative data (transcripts, field notes, documents)
• Conducting thematic analysis, grounded theory, IPA, or other analytic approaches
• Establishing trustworthiness and quality criteria for qualitative findings
• Writing the methodology section of a qualitative paper or thesis
• Reviewing qualitative research for methodological rigor
• Teaching qualitative methods courses
• Transitioning from quantitative to qualitative or mixed-methods research
• Working with CAQDAS (Computer-Assisted Qualitative Data Analysis Software)

Does NOT Trigger

alterlab-survey-design

alterlab-paper-writer

alterlab-deep-research

Core Capabilities

1. Methodology Selection Guide

Choosing the right qualitative methodology depends on your research question, philosophical stance, and the kind of knowledge you seek.

Methodology Decision Framework:

What is your primary research interest?
│
├── LIVED EXPERIENCE of individuals
│   ├── Focus on meaning-making and interpretation
│   │   └── Interpretative Phenomenological Analysis (IPA)
│   ├── Focus on the essence/structure of experience
│   │   └── Descriptive/Transcendental Phenomenology (Husserl/Moustakas)
│   └── Focus on life stories and identity construction
│       └── Narrative Inquiry
│
├── SOCIAL PROCESSES and how they unfold
│   ├── Want to generate theory from data
│   │   └── Grounded Theory (Strauss & Corbin or Charmaz)
│   └── Want to describe a process in context
│       └── Case Study (Yin) or Ethnography
│
├── CULTURAL PATTERNS in a group or setting
│   ├── Immersive fieldwork possible (months/years)
│   │   └── Ethnography
│   └── Bounded, focused investigation
│       └── Case Study (Yin)
│
├── CONTENT/MEANING in texts or media
│   ├── Seeking patterns and themes across a dataset
│   │   └── Thematic Analysis (Braun & Clarke)
│   └── Systematic categorization of content
│       └── Content Analysis (qualitative or directed)
│
└── A BOUNDED SYSTEM (program, event, organization)
    ├── Single case with depth
    │   └── Single Case Study
    ├── Multiple cases for comparison
    │   └── Multiple Case Study
    └── Evaluating a program or intervention
        └── Case Study with evaluation framework

Methodology Comparison Table:

2. Thematic Analysis (Braun & Clarke)

The most widely used qualitative analysis method. Braun & Clarke (2006, updated 2019) provide a reflexive approach.

Six Phases of Reflexive Thematic Analysis:

Phase 1: Familiarization with the Data
│   Read and re-read transcripts
│   Note initial observations (not codes yet)
│   Immerse yourself in the data
│   Record preliminary thoughts in a research journal
│
Phase 2: Systematic Coding
│   Generate initial codes across the entire dataset
│   Code inclusively (code everything potentially relevant)
│   Codes are semantic (surface meaning) or latent (underlying assumptions)
│   One extract can have multiple codes
│   Use line-by-line or segment-by-segment approach
│
Phase 3: Generating Initial Themes
│   Collate codes into potential themes
│   Use visual methods: mind maps, affinity diagrams, tables
│   Themes are patterns of shared meaning organized around a central concept
│   Not every code becomes a theme — some are subthemes, some are discarded
│
Phase 4: Reviewing Themes
│   Check themes against coded extracts (Level 1)
│   Check themes against entire dataset (Level 2)
│   Do themes tell a coherent story?
│   Are themes distinct or overlapping?
│   Refine: split, merge, or discard themes as needed
│
Phase 5: Defining and Naming Themes
│   Write a detailed analysis of each theme
│   Identify the "essence" of each theme
│   Create concise, vivid theme names
│   Determine how themes relate to each other
│
Phase 6: Writing Up
    Weave together analytic narrative and data extracts
    Go beyond description — interpret and contextualize
    Embed extracts as evidence, not illustration only
    Relate findings to literature and research question

Coding Example:

Data Extract                          | Codes
────────────────────────────────────────────────────────
"I felt completely lost in the first   | - Disorientation
semester. Nobody told me what was      | - Lack of guidance
expected. I just figured it out by     | - Self-reliance
watching what other people did."       | - Peer learning (informal)
                                       | - Hidden curriculum

Theme Development Example:

Codes:                              → Theme:
- Lack of guidance                    "Navigating the Hidden Curriculum"
- Hidden curriculum
- Unwritten rules                   → Subtheme 1: "Figuring It Out Alone"
- Self-reliance                       (codes: self-reliance, trial and error,
- Trial and error                      absence of mentorship)
- Peer learning (informal)
- Absence of mentorship             → Subtheme 2: "Learning by Watching"
- Observing others                    (codes: peer learning, observing others,
- Mimicking successful behaviors       mimicking successful behaviors)

3. Grounded Theory

Grounded theory generates theory that is "grounded" in systematically collected and analyzed data.

Strauss & Corbin (1998) — Systematic Approach:

OPEN CODING
│   Break data into discrete parts
│   Label phenomena (concepts)
│   Group concepts into categories
│   Identify properties and dimensions of categories
│
│   Example:
│   Concept: "Time pressure"
│   Properties: Source (institutional, self-imposed), Intensity, Duration
│   Dimensions: Mild ←──────→ Severe
│
AXIAL CODING
│   Reassemble data around categories
│   Use the paradigm model:
│
│   Causal Conditions → Phenomenon → Context
│                                    → Intervening Conditions
│                                    → Action/Interaction Strategies
│                                    → Consequences
│
│   Example:
│   Causal conditions: Publish-or-perish culture
│   Phenomenon: Research anxiety
│   Context: Early-career faculty, research university
│   Intervening conditions: Mentorship availability, institutional support
│   Strategies: Strategic collaboration, prioritization, avoidance
│   Consequences: Productivity variation, burnout, career trajectory
│
SELECTIVE CODING
    Identify the core category
    Systematically relate all categories to the core
    Fill in categories that need further development
    Validate the emerging theory against data
    Write the storyline

    Example core category: "Surviving the Tenure Track"
    All other categories (research anxiety, teaching load, institutional
    politics, mentorship) relate to this central phenomenon

Charmaz (2014) — Constructivist Grounded Theory:

Key differences from Strauss & Corbin:

• Emphasizes researcher's role in constructing (not discovering) theory
• Uses initial coding and focused coding (not open/axial/selective)
• Prioritizes gerunds (action words) in coding: "struggling with," "negotiating," "adapting to"
• Memo writing is central from the very beginning
• Theoretical sampling continues until categories are saturated

Theoretical Sampling:

Initial data collection (purposive sampling)
│
├── Analyze → Emerging categories
│
├── Identify gaps in categories
│
├── Sample specifically to develop/test categories
│   (Who to interview? What to observe? What documents to examine?)
│
├── Analyze new data → Refine categories
│
├── Repeat until THEORETICAL SATURATION
│   (No new properties, dimensions, or relationships emerge)
│
└── Articulate substantive theory

4. Interpretative Phenomenological Analysis (IPA)

IPA explores how individuals make sense of significant life experiences. It is idiographic, phenomenological, and hermeneutic.

IPA Analysis Steps (Smith, Flowers & Larkin, 2009):

Step 1: Reading and Re-reading
│   Read the transcript multiple times
│   Listen to the audio recording alongside
│   Note initial observations in the margin
│
Step 2: Initial Noting
│   Three types of comments:
│   - Descriptive (content, what is said)
│   - Linguistic (language use, metaphors, pauses, laughter)
│   - Conceptual (interpretive, interrogative)
│
│   Example:
│   Transcript: "It was like hitting a brick wall"
│   Descriptive: Encountered a major obstacle
│   Linguistic: Metaphor of physical barrier — sudden, painful, solid
│   Conceptual: Sense of helplessness? Unexpected nature of the barrier?
│
Step 3: Developing Emergent Themes
│   Transform notes into concise themes
│   Themes capture psychological essence, not just content
│   Balance participant's words with analyst's interpretation
│   (The hermeneutic circle: part ↔ whole)
│
Step 4: Searching for Connections Across Themes
│   Organize emergent themes:
│   - Abstraction: Group similar themes under superordinate theme
│   - Subsumption: One theme becomes superordinate, absorbs others
│   - Polarization: Identify oppositional relationships
│   - Contextualization: Identify temporal or narrative connections
│   - Numeration: Note frequency (but do not reduce to counting)
│   - Function: Examine what themes do for the participant
│
Step 5: Moving to the Next Case
│   Bracket (as much as possible) findings from previous cases
│   Repeat Steps 1-4 for each participant individually
│
Step 6: Looking for Patterns Across Cases
    Identify recurrent themes across participants
    Note convergence and divergence
    Create a master table of themes
    Retain idiographic detail — do not flatten into generic themes

IPA Table of Themes Example:

| Superordinate Theme | Subtheme | P1 | P2 | P3 | P4 | P5 |
|--------------------|-----------|----|----|----|----|----|
| Living with uncertainty | Not knowing the future | pp.3,7 | pp.2,5 | pp.4 | — | pp.6,8 |
| | Oscillating between hope and fear | pp.8 | pp.3,9 | pp.7,10 | pp.2 | pp.5 |
| Redefining identity | Loss of former self | pp.5,12 | pp.6 | pp.8,11 | pp.3,7 | pp.9 |
| | Constructing a new normal | pp.14 | pp.11 | — | pp.9,12 | pp.11,14 |

5. Case Study Methodology (Yin, 2018)

Types of Case Study Designs:

                    Single-Case              Multiple-Case
                    ┌──────────────────┐     ┌──────────────────┐
Holistic            │ Type 1           │     │ Type 3           │
(single unit        │ Critical, unique,│     │ Replication      │
of analysis)        │ revelatory, or   │     │ logic across     │
                    │ longitudinal case│     │ cases            │
                    └──────────────────┘     └──────────────────┘
                    ┌──────────────────┐     ┌──────────────────┐
Embedded            │ Type 2           │     │ Type 4           │
(multiple units     │ Single case with │     │ Multiple cases   │
of analysis)        │ embedded sub-    │     │ each with        │
                    │ units            │     │ embedded units   │
                    └──────────────────┘     └──────────────────┘

Five Components of Case Study Design:

1. Research questions — "How" and "why" questions are best suited
2. Propositions (if any) — Direct attention to what should be examined
3. Unit of analysis — Define the "case" (individual, organization, program, event)
4. Logic linking data to propositions — Pattern matching, explanation building, time-series
5. Criteria for interpreting findings — Rival explanations, sufficient evidence

Data Collection — Six Sources of Evidence:

Chain of Evidence:

Research questions
    ↓
Case study protocol
    ↓
Citations to specific evidence in case study database
    ↓
Case study database (organized notes, documents, tabular materials)
    ↓
Case study report

6. Coding Techniques

Coding Hierarchy:

Level 1: OPEN/INITIAL CODES
│   Line-by-line or segment-by-segment labels
│   Stay close to the data
│   Example: "feeling unprepared," "seeking guidance," "peer support"
│
Level 2: FOCUSED/AXIAL CODES (Categories)
│   Group open codes into higher-level categories
│   Identify relationships between categories
│   Example: "Navigation strategies" (contains: seeking guidance, peer
│   support, trial and error, online resources)
│
Level 3: THEMES / THEORETICAL CODES
    Abstract, interpretive-level patterns
    Capture the meaning across categories
    Example: "The invisible apprenticeship" (captures how new academics
    learn the unwritten rules of their profession)

Codebook Template:

| Code | Definition | Inclusion Criteria | Exclusion Criteria | Example |
|------|-----------|-------------------|-------------------|---------|
| PEER-SUPPORT | Instances where participants describe receiving help, advice, or emotional support from peers/colleagues | Informal help, peer mentoring, collegial advice | Formal institutional mentoring programs | "My colleague down the hall basically taught me how to write a grant" |
| ISOLATION | Expressions of feeling alone, disconnected, or unsupported in professional role | Emotional isolation, geographic isolation, intellectual isolation | Temporary solitude by choice | "Nobody in my department does what I do, so there's no one to talk to" |

7. Python-Based Qualitative Analysis Workflows

For researchers who prefer open-source tools over NVivo/Atlas.ti:

Basic Text Coding with Python:

import pandas as pd
from collections import Counter

# Load transcripts
transcripts = {
    'P01': open('data/P01_transcript.txt').read(),
    'P02': open('data/P02_transcript.txt').read(),
}

# Define codebook
codebook = {
    'PEER_SUPPORT': [
        'colleague helped', 'learned from peers', 'informal mentoring',
        'asked a friend', 'peer advice'
    ],
    'ISOLATION': [
        'felt alone', 'no one to talk to', 'disconnected',
        'on my own', 'nobody understands'
    ],
    'INSTITUTIONAL_BARRIERS': [
        'red tape', 'bureaucracy', 'no support from admin',
        'policy prevented', 'institutional resistance'
    ],
}

# Simple keyword-based initial coding (supplement with manual coding)
def code_transcript(text, codebook):
    results = []
    sentences = text.split('.')
    for i, sentence in enumerate(sentences):
        sentence_lower = sentence.lower().strip()
        for code, keywords in codebook.items():
            for keyword in keywords:
                if keyword in sentence_lower:
                    results.append({
                        'sentence_num': i + 1,
                        'text': sentence.strip(),
                        'code': code,
                        'keyword_match': keyword
                    })
    return pd.DataFrame(results)

# Code all transcripts
all_coded = []
for pid, text in transcripts.items():
    coded = code_transcript(text, codebook)
    coded['participant'] = pid
    all_coded.append(coded)

coded_data = pd.concat(all_coded, ignore_index=True)

# Code frequency by participant
code_freq = coded_data.groupby(['participant', 'code']).size().unstack(fill_value=0)
print(code_freq)

Word Frequency and Collocation Analysis:

from sklearn.feature_extraction.text import CountVectorizer
import nltk
from nltk.corpus import stopwords

nltk.download('stopwords')
stop_words = set(stopwords.words('english'))

# Combine all transcripts
all_text = ' '.join(transcripts.values())

# Bigram frequency (useful for identifying recurring phrases)
vectorizer = CountVectorizer(ngram_range=(2, 3), stop_words='english', max_features=50)
bigrams = vectorizer.fit_transform([all_text])
bigram_freq = dict(zip(vectorizer.get_feature_names_out(), bigrams.toarray()[0]))
sorted_bigrams = sorted(bigram_freq.items(), key=lambda x: x[1], reverse=True)

print("Top 20 bigrams/trigrams:")
for phrase, count in sorted_bigrams[:20]:
    print(f"  {phrase}: {count}")

Thematic Network Visualization:

import networkx as nx
import matplotlib.pyplot as plt

# Define theme relationships
G = nx.Graph()

# Add nodes (themes and subthemes)
themes = {
    'Navigating Uncertainty': ['Ambiguous expectations', 'Shifting goalposts', 'Information gaps'],
    'Building Support Networks': ['Peer mentoring', 'Online communities', 'Cross-departmental allies'],
    'Identity Transformation': ['Role conflict', 'Impostor feelings', 'Growing confidence'],
}

for theme, subthemes in themes.items():
    G.add_node(theme, node_type='global_theme', size=3000)
    for sub in subthemes:
        G.add_node(sub, node_type='organizing_theme', size=1500)
        G.add_edge(theme, sub)

# Cross-theme connections
G.add_edge('Ambiguous expectations', 'Impostor feelings')
G.add_edge('Peer mentoring', 'Growing confidence')

# Visualize
colors = ['#e74c3c' if G.nodes[n].get('node_type') == 'global_theme' else '#3498db' for n in G.nodes]
sizes = [G.nodes[n].get('size', 1000) for n in G.nodes]

plt.figure(figsize=(14, 10))
pos = nx.spring_layout(G, k=2, seed=42)
nx.draw(G, pos, with_labels=True, node_color=colors, node_size=sizes,
        font_size=9, font_weight='bold', edge_color='#bdc3c7', width=2)
plt.title("Thematic Network")
plt.tight_layout()
plt.savefig('figures/thematic_network.png', dpi=300, bbox_inches='tight')

8. Trustworthiness Criteria (Lincoln & Guba, 1985)

Trustworthiness in qualitative research parallels validity and reliability in quantitative research.

Additional Quality Criterion — Authenticity (Guba & Lincoln, 1989):

• Fairness: Multiple viewpoints represented equitably
• Ontological authenticity: Participants' understanding is enhanced
• Educative authenticity: Participants understand others' perspectives better
• Catalytic authenticity: Research stimulates action
• Tactical authenticity: Participants are empowered to act

Triangulation Types:

1. Data triangulation      — Multiple data sources (interviews + documents + observations)
2. Investigator triangulation — Multiple researchers coding/analyzing
3. Theory triangulation    — Multiple theoretical lenses applied to the same data
4. Methodological triangulation — Multiple methods (interviews + surveys + observations)

Member Checking Protocol:

## Member Checking Procedure

1. Share with participants:
   - [ ] Individual transcript (for accuracy)
   - [ ] Preliminary theme descriptions (for resonance)
   - [ ] Draft findings section (for interpretation check)

2. Ask participants:
   - "Does this accurately represent your experience?"
   - "Is there anything you would change, add, or clarify?"
   - "Are there any themes that surprise you or feel incorrect?"

3. Document:
   - Changes made based on participant feedback
   - Disagreements and how they were resolved
   - Participants' emotional responses to findings

4. Reporting:
   - State how many participants reviewed findings
   - Describe the nature and extent of any changes
   - Note any discrepancies between researcher and participant interpretations

9. Reflexivity

Reflexivity is the researcher's ongoing critical self-examination of their role, assumptions, and influence on the research process.

Reflexive Journal Prompts:

## Reflexive Journal Entry — [Date]

### Before Data Collection
- What assumptions am I bringing to this interview/observation?
- How might my identity (gender, race, professional status, discipline) influence what participants share?
- What do I expect to find? How might this expectation shape my questions?

### During Data Collection
- What surprised me?
- When did I feel uncomfortable? Why?
- What did I notice about power dynamics in the interaction?
- What questions did I avoid asking? Why?

### During Analysis
- Which codes came easily? Which were difficult? Why?
- Am I privileging certain voices over others?
- What am I not seeing because of my perspective?
- How are my emerging interpretations shaped by my theoretical commitments?

### Ongoing
- How has my understanding of the phenomenon changed?
- What would a researcher from a different background see differently?
- Am I being faithful to participants' meanings, or imposing my own?

Best Practices

1. Choose methodology before collecting data. Your methodology shapes your research question, sampling, data collection, and analysis. Do not collect data and then decide how to analyze it.

2. Maintain an audit trail. Document every decision: why you chose a methodology, how you recruited participants, how codes evolved, why you merged or split themes. This is your evidence of rigor.

3. Code systematically. Whether using software or paper, code the entire dataset consistently. Do not cherry-pick excerpts that confirm your expectations.

4. Write memos throughout. Memos are where analytical thinking happens. Write early, write often, write about codes, categories, themes, puzzles, and surprises.

5. Achieve saturation thoughtfully. Saturation is not a number (e.g., "12 interviews"). It is a judgment that new data are no longer generating new insights relevant to your research question.

6. Use participants' words. Direct quotes are the evidence of qualitative research. Weave them into your analysis, not as decoration, but as the foundation of your argument.

7. Distinguish description from interpretation. Description says what the data contain. Interpretation says what the data mean. Both are needed; do not confuse them.

8. Triangulate. Use multiple data sources, methods, or analysts to strengthen credibility. No single source is sufficient.

9. Practice reflexivity. Your positionality shapes what you see and how you interpret it. Make this explicit, not as a confession, but as a methodological practice.

10. Report transparently. Include your codebook, describe your analysis process in detail, justify your sample, and acknowledge limitations. Readers should be able to evaluate your rigor.

Common Pitfalls

References

• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77-101.
• Braun, V., & Clarke, V. (2019). Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health, 11(4), 589-597.
• Charmaz, K. (2014). Constructing grounded theory (2nd ed.). Sage.
• Clandinin, D. J., & Connelly, F. M. (2000). Narrative inquiry: Experience and story in qualitative research. Jossey-Bass.
• Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). Sage.
• Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Sage.
• Smith, J. A., Flowers, P., & Larkin, M. (2009). Interpretative phenomenological analysis: Theory, method, and research. Sage.
• Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). Sage.
• Yin, R. K. (2018). Case study research and applications: Design and methods (6th ed.). Sage.

See also:

references/qualitative-frameworks.md