Methods and Acknowledgement of Limitations


Methods

Research Design

Our 2024 interviews built on the 2014 questions for pre-post comparisons, supplemented with story-based prompts and questions suggested by the participating pastors. Interviewer reflections, capturing insights beyond the interview responses, have been integrated into our data discussion.

Participant Selection

Out of 41 churches from 2014, 34 remained active in 2024. We interviewed 21 pastors available during recruitment; five others expressed interest but were unavailable or faced language barriers (no translation services were available), making the 2024 cohort less diverse. One church was excluded due to a conflict of interest with EGC.

Interviews

We conducted interviews via online survey and/or Zoom, with all sessions recorded and transcribed.

Pastors’ Consultation

Post-interview, we consulted four Boston-area church planting pastors (two white, one Black, one Korean American; with a mix of genders) from Greater Boston. Two had been interviewed, and all were personally known to EGC staff. One consultant was a new member of the EGC research team, but had not participated in the project prior to the consultation.

Data Analysis & Visualization

We employed grounded theory, quantitative visualization, keyword and narrative trend analyses, and anthropological thick description with reflexivity, applying a Fisher Exact Test when needed. Both manual coding and online tools (including AI via ChatGPT) were used, with manual verification. Visualizations were produced using Google Sheets and Canva.

Discussion & Meaning-Making

Our interpretations derive from nationwide trend comparisons, team reflections, pastor consultations, and interviewer insights. We present these as possibilities, and we include Questions for Reflection within the reports to aid readers in applying the findings to their ministry.

Informed Consent & Confidentiality

Participants were informed about the study’s purpose, confidentiality, and data use/storage, and all consented to recording and transcription. Interview data was stored in password-protected online storage (with all other documents destroyed), NDAs were signed, and findings are reported in aggregate with identifying details removed.

Study Limits and Acknowledgement of Potential Bias 

Our study focused on active Protestant church plants in greater Boston, excluding closed plants and Catholic or Orthodox churches.

With 89% of re-interviewed pastors being white in a sample size of 21, our study does not represent all racial and ethnic perspectives nor support Boston-wide generalizations. Nevertheless, the data raises meaningful questions and suggests possible trends.

Interpretive bias could have been introduced or compounded in the pastors’ consultation because the participating pastors were all personally known to EGC staff, raising the possibility of biases of social desirability, acquiescence, confirmation, or selective disclosure. 

Conducted by EGC’s Applied Research Team, this landscape research prioritizes timely, actionable insights over broad generalizability. We selectively reported data deemed current and useful for strategic church leadership, a choice that may introduce interpretive bias.

While our team spans different genders, generations, and roles, most key positions were held by white individuals, with the Director of Applied Research being Asian American. Despite ongoing cultural competence training, we acknowledge potential blind spots in interpreting diverse pastoral experiences. To counter this, our editorial process includes cultural competence screening and a consultation with pastors representing varied backgrounds (white male, white female, Black female, and Asian-American female).

We invite you to engage with these insights and reflect on the implications for your ministry. We hope the findings spark dialogue on God’s priorities for your community.