The Eval Section - Part #3: Data Analysis for Grant Proposals
For our third installment of the four-part blog series to help de-mystify the world of data and program evaluation in federal grant proposals, our focus is on articulating your approach to data analysis—both quantitative and qualitative—in your grant proposals in the areas of human services, behavioral health, youth services, education, and housing. Topics include:
Meeting grant requirements
Defining objectives for your data analysis
Analysis: Quantitative data
Analysis: Qualitative data
Know Your Requirements
One critical mistake to avoid in grant writing is forgetting to mention the required outcomes from your grantor. Grantors will typically expect detailed plans for how data will be collected, analyzed, and reported to demonstrate your programs effectiveness, but especially expect to see this for the data that they themselves require. In your analysis section, be sure to include a description of how you will analyze data to meet the grantor’s requirements.
Defining Clear Objectives for Data Analysis
Effective data analysis begins with clearly defined objectives that align with both your project goals and the expectations set forth by the grantor. Some examples of what these goals/objectives include:
Measuring program participation - for example, how many people participated, demographics about participants, etc.
Process evaluation - for example, an evaluation of the process of implementing the program, understanding challenges and barrers
Outcomes evaluation - for example, seeing changes in knoweldge, skills, or behaviors over time
Participant experiences - for example, using interviews or focus group data to understand more deeply the particpants’ experiences in the program.
It’s good to be specific about your goals and objectives. For example, if your project focuses on improving educational outcomes for underserved youth, your data analysis objectives might include assessing changes in academic performance metrics (like attendance records, GPA, or standardized test scores) and capturing qualitative insights from student testimonials. Use this section as an opportunity to portray your organization as a knowledgable expert on your topic who has the ability to provide evidence of impact.
Analysis: Quantitative Data
Most funders will expect to see some quantitative data analysis as a part of the grant proposal - especially federal and state grantors. They will expect to see how you will use numerical data to count particpants served and quantiatively demonstrate progress toward stated goals and objectives.
Data analysis is a very technical skillset, and often grant writers might feel a bit intimidated about this section. But in general, for grant writing, you don’t have to be a stats expert to write about data analysis. Here are some examples of how you might describe your data analysis in your proposals:
Counts: Analyze participant data by counting numbers of enrolled participants, and identifying subgroups. For exampe, you might count the number of participants who enrolled in Q1)
Percents: Calculate the percentage of participants who meet a certain criteria - for example, the % of participants without health insurance
Trends: Examine trends over time using bar charts - for example, the number of service hours provided by staff by month.
Change: Explore changes in behavior and outcomes For example, if you run a nutrition program, you could explore pre- and post-program surveys measuring changes in dietary habits among participants
Visualizations: Use other data visualization tools, like pie charts, bar charts, line graphs, mapping and more. Be specific about the types of visualizations you might create, and what they might tell you about services provided.
Analysis: Qualitative Data
While quantitative data provides statistical evidence of impact, qualitative data offers rich narratives and contextual insights that can complement numerical findings.
As stated before, you don’t have to be a qualitative data expert to talk about how analysis might be conducted. Here are some examples of how you might talk about qualitative data analysis:
Coding - Coding involves systematically labeling and categorizing segments of qualitative data to identify themes, concepts, or patterns. You can use “open” coding, which involves initial exploration of the data without predefined categories, allowing new insights and themes to emerge organically. You might also describe a “selective” coding approach, which does the same only you bring a pre-defined set of categories prior to starting the analysis.
Themes - A theme in qualitative research refers to a pattern or meaning that emerges from the data analysis. For example, if you are exploring themes related to experiences of mental illness, you might identify "strategies for coping with symptoms," "emotional impact of illness," and "support systems and resources." as potential themes that emerge across different sources of qualitative data.
Qualitative data can come from so many different sources. However, most evaluations involve some form of interviews, focus groups, or case studies.
Mixed Methods: Quantitative and Qualitative Data
A strong grant proposal might also describe how both quantitative metrics and qualitative narratives will be incorporated in data analysis and reporting. This approach, sometimes called “mixed-methods” (i.e. both qualitative and quantitative) may provide a holistic understanding of program effectiveness.
We often here the phrase, “you can’t reduce our program’s effectiveness to a number!” In mixed-methods approaches, you’re able to incorporate what both approaches do best to incorporate quantitative outcomes and qualitative storytelling to drive a narrative about your program’s overall impact.
For instance, combining quantitative metrics on student attendance rates with qualitative feedback from teachers and parents can offer a nuanced perspective on the educational impact of a youth enrichment program.
Addressing Challenges and Limitations
Navigating data analysis in grant reporting isn’t without its challenges. Limited resources, data accessibility issues, and unexpected barriers can impact the quality and scope of your analysis. You might acknowledge these challenges transparently in your grant report while offering strategies for mitigating their effects. This helps communicate to your grantor that you are thinking proactively and that you recognize that data analysis rarely goes exactly as you planned for it. This might help portray your organization as experienced - as an organization who has clearly run into challenges before and worked out ways to overcome them.
Ethical Considerations in Data Reporting
Ethical considerations should underpin every stage of your data analysis and reporting process. Check out the last blog post in this series to learn more about protecting participant privacy, ensuring confidentiality, and developing procedures for informed consent.
Up Next
This article is the third of a four-part series on writing the evaluation section of your federal grant proposals. Prior and upcoming topics include:
Part #2: Protecting Participants: Confidentiality, Privacy, and Informed Consent
Coming soon: Part #4: Reporting, Communication, Continuous Improvement
—
Note: this blog post is for informational purposes only does not, and is not intended to, constitute legal or medical advice. Readers of this blog post should contact their attorney to obtain advice with respect to any particular legal matter.
