Using concept mapping methods to evaluate overdose data to action program efforts in Allegheny County, Pennsylvania

• Published in: Evaluation and program planning 2025-04, Vol.109, Article 102532
• Main Authors: Creasy, Stephanie L., Seger, Erin, Eggleston, Molly, Hawk, Mary, Egan, James E.
• Format: Article
• Language: English
• Subjects: Community-engaged evaluation; Concept mapping; Evaluation; Mixed-methods; Opioid overdose prevention
• ISSN: 0149-7189
• DOI: 10.1016/j.evalprogplan.2024.102532

The Pitt Public Health evaluation team used a mixed-methods, community-based participatory research method of concept mapping to evaluate factors affecting the Overdose Data to Action (OD2A) opioid overdose surveillance and prevention project outcomes for Allegheny County, Pennsylvania. In June 2021 we developed the focal prompt: “What factors work to help or limit OD2A program outcomes at the individual, community, and or/system level?”Community partners participated in three phases: Brainstorming, Sorting and Rating, and Interpretation. Using concept mapping software, we applied multidimensional scaling to visualize a point map displaying factors and their relative relationships, and hierarchical cluster analysis to generate concept maps displaying clusters of factors. During the brainstorming phase community partners (N = 18) generated 69 unique statements describing factors impacting OD2A work and community partners (N = 16) sorted and rated statements using concept mapping software. In the interpretation community partners (N = 26) selected the 10-cluster map as the most salient cluster solution. Using this cluster map and cluster ratings, we identified Stigma, Criminalization and Marginalization, and Racial Equity as factors of highest importance to overdose prevention success but lowest in success thus far. Using concept mapping to evaluate factors affecting OD2A outcomes was a successful method of engaging community partners in considering opportunities to strengthen OD2A and future overdose prevention efforts. •Concept mapping is useful for fostering community collaboration and consensus around opioid overdose prevention priorities and barriers to overdose prevention work.•Participants prioritized racial equity, stigma, and criminalization and marginalization as most important factors to opioid overdose prevention work.•Results can inform evaluators or grant recipients in their efforts to engage the community in identifying overdose prevention and surveillance activities.