1 Introduction
Interview-based reports indicate that only 3% of donors claim to do any research on charities before giving.Footnote 1 In conjunction with the magnitude of existing charities, this suggests a large amount of inefficient allocations.Footnote 2 These reports speculate “warm glow” (Andreoni, Reference Andreoni1989) to be the main reason behind the lack of search among donors.Footnote 3 This study explores a complimentary factor: regret. Due to the credence nature (Darby & Karni, Reference Darby and Edi1973) of charities, donors rarely learn the outcome of their charitable contributions causing them to rarely regret poor decisions.Footnote 4 For instance, if the consumer anticipates feedback, such as learning the quality of food at the chosen restaurant and comparing it with nearby restaurants, she will search more to avoid feeling regret. However, if the consumer anticipates no feedback, such as never learning a charity’s quality in terms of its impact per dollar, then she will not search as exhaustively because there is no regret to avoid. Therefore, this study investigates if absence of post-decisional, regret-inducing feedback on the relative effectiveness of one’s donations is a contributing factor behind this lack of search among donors in charitable giving.
Prior studies have shown that receiving feedback generates regret in decision making, thereby altering behavior ex-ante.Footnote 5 Using a sequential search framework in a context-free experience good environment, Jhunjhunwala (Reference Jhunjhunwala2021) confirms that such feedback results in increased search, motivating the current study to investigate if its replicable in the charitable giving environment, providing insights on the prevalence of uninformed charitable giving. Prior findings are not guaranteed to unfold in this setting as donor decisions do not impact themselves directly. Furthermore, presence of such feedback could dissuade donors from donating altogether to avoid regret.Footnote 6 However, this study shows that the anticipation of post-decisional, regret inducing feedback has a positive effect on search intensity in charitable giving, without hurting the extensive and intensive margins of donations. Thus, as its main contribution, this analysis provides insights into why donors search so little among charitable alternatives prior to giving: the general absence of feedback on one’s contributions, relative to alternatives, eliminates the potential to regret one’s donation decisions and renders charity information non-instrumental for donors ex-ante.
To study the above, I develop an online experiment with real charities as options where subjects can get free, detailed information on these charities sequentially to infer their quality prior to donating. While the control group receives no feedback, the treatment group is ex-ante aware of receiving post-decisional feedback in the form of charity rankings as determined by third-party evaluations. Consequentially, they research more options relative to the control group prior to donating. Upon seeing the rankings, the subjects expressing regret in their decision increase their search intensity and donate to better ranked charities. The continued lack of search among the control subjects provides evidence that the absence of feedback can partially explain the observed lack of search among donors in the real-world. Importantly, the provision of such feedback had no impact on donation levels.
While this study contributes to the role of information in charitable giving literature broadly, it specifically documents how presence of post-decisional feedback affects donor search for optional, pre-decisional information. Prior studies, on the other hand, have investigated the effect of mandatory, pre-decisional information provision and its saliency on donation levels. Most find that providing donors with statistical information mitigates generosity and dampens donations altogether, unlike the findings here. Such information can lead one to develop excuses to not give (Exley, Reference Exley2015, Reference Exley2020) or due to moral licensing (Goette & Tripodi, Reference Goette and Tripodi2020).Footnote 7 It can also increase giving if a charity turns out to be better than previously thought (Butera & Horn, Reference Butera and Horn2020). Or, it may have no impact on the overall giving but produce significant heterogeneity (Karlan & Wood, Reference Karlan and Wood2017). A conjecture for finding no difference in donation levels in the current study could be attributed to the inherent nature of the question asked. Most studies investigate donations to a charity that they provide impact information on. Conversely, choosing among charities in the presence of relative information may enhance an option’s appeal, diverting donations to it instead of altering donation levels.
Among studies investigating behavior on obtaining relevant information prior to giving, Fong and Oberholzer-Gee (Reference Fong and Oberholzer-Gee2011) find that only 1/3rd of dictators in the standard dictator game pay to learn more about their recipient. Similarly, Null (Reference Null2011) manipulates the social impact of donations per charity making this information available for purchase before decision-making but finds that individuals are unwilling to pay for it. Besides being costly, subjects in Null (Reference Null2011) do not find out how their decision compares to an alternative—two key differentiating aspects of the current study, which demonstrates that only when mandatory regret-inducing, post-decisional information is provided, the optional (and free) pre-decisional information becomes instrumental in decision-making.
Overall, this study investigates empirically if absence of regret-inducing feedback on relative effectiveness of one’s donations is a contributing factor behind uninformed donations, and indeed finds support for it. The nature of the question—essentially testing a factor absent in the real-world to be a cause behind an observed phenomenon—makes real-world investigation with adequate controls practically unfeasible. Therefore, a controlled experiment with real charities emerges as a suitable alternative.
2 Experimental design
The experiment was conducted online using Qualtrics. Ohio State University undergraduates on the lab database were randomly invited to participate in a survey, estimated to last for ∼ 7 min. As in Coffman (Reference Coffman2016), a lottery was used to incentivize subjects wherein for every 40 subjects who completed the survey, one subject was chosen randomly to win $80. Each participant had to decide in advance how they would distribute the $80 between a charity and themselves. Conditional on winning the lottery, their decision would be automatically implemented. The survey comprised of two identical rounds where one round per winner was selected randomly for implementation.
In each round, the subjects were given four charities to choose one from, each benefiting poor communities in Africa. These options differed across rounds but were the same across subjects. Subjects were informed that the charity names were altered to keep them anonymous. This feature rules out mere-exposure effect (Zajonc, Reference Zajonc2001) as a reason to support a particular charity. While the charities differed in their techniques, the beneficiary group at a broader level remained unchanged. This prevented subjects from supporting a charity based solely on its cause. The four charities in round 1 were Against Malaria Foundation, The Lunchbox Fund, Hands for Africa, and Madaktari Africa, and those in round 2 were Give Directly, Aqua Africa, Develop Africa, and Africa Development Promise.
Using a between-subjects design, subjects were divided into two groups: control and treatment. Subjects in both groups were exposed to the same charities, in the same order, with the same pseudonyms. Both groups were given the option to gather information per charity prior to making a donation decision. The treatment group subjects were informed ex-ante that conditional on donating, they’d be shown the real names of all four charities and their rankings based on their performance as evaluated by third-party ratings.Footnote 8 The conditional nature of feedback provision was motivated by the fact that in the real-world, relative to non-donors, donors are more likely to come across information about the charities they support, thereby causing them to reevaluate their future donation decisions.Footnote 9
The ranking was utilized to examine whether its provision, ex-post of decision-making, renders the available charity information instrumental ex-ante, since prior studies (Null, Reference Null2011) found such information to be non-instrumental in the decision-making process. Therefore, the experiment utilizes 2 key measures that donors seem to find valuable as performance metrics to rank charities: third party ratings (Brown et al., Reference Brown, Jonathan and Williams2017; Yoruk, Reference Yoruk2013) and financial information including overhead costs (Hope Consulting, 2012).Footnote 10 Out of the 8 charities used in this experiment, there were 2 top charities (one per round), designated so by third-party charity evaluators. These charities were ranked #1 in the ranking feedback: Against Malaria Foundation in round 1 and Give Directly in round 2. The other 6 charities were ranked based on multiple factors such as external validation, amount spent on cause (the 2 top-charities spent over > 90% on cause), donation trend, and self-reported impact information.Footnote 11 Ultimately, the subjects were not required to follow these rankings.
Each round can be divided into 3 stages: (1) information gathering stage, (2) donation decision stage, and (3) feedback stage. After consenting to participate and reading the basic instructions, the subjects entered the information gathering stage. They were presented with the mission statements of all four charities in round 1. They then had three options to choose from: know more about these charities sequentially, go to the donation page to donate to any one of them, or not donate at all and end the round. Choosing to ‘know more about a charity’ took them to a page where financial information and reviews of the chosen charity were available (essentially the information that was used in the rankings). The subjects could terminate the information gathering stage at any point as they had the latter 2 options always available. Choosing to ‘go to the donation page’ brought them to the donation decision stage of the round where they decided how much of the $80 to donate to any one charity of their choice.
After making their donation decision, subjects who made a positive donation in the treatment group entered the feedback stage where they received the ranking mentioned above. Conditional on donating to the top charity, they were asked how they felt about their donation, with their options being ‘indifferent’, ‘good’, or ‘accomplished’. Conditional on not donating to the top charity, they were asked if they wished they had done better and their options were ‘I don't care’, ‘I did my best’, ‘I could have done better’, and ‘Yes, I really wish I had done more’. These questions served as a measure of their rejoice and regret intensity, respectively. The main survey ended after the subjects in the treatment group completed the regret elicitation question for round 2. In contrast, the control group received no feedback, with the donation decision stage being the last stage of each round. While round 1 is enough to see the effects of anticipated regret, round 2 serves an important purpose. Since donating to charities does not impact an individual directly, it is possible that one does not internalize the full impact of receiving feedback in such a setting. Nevertheless, this feedback can influence their future search behavior and donation levels. It is unclear if it would encourage individuals to actively seek out better-ranked charities or deter them from donating altogether to avoid potential regret. Round 2 enables the examination of these effects.
3 Results
A total of 484 subjects participated, half in treatment and half in control. Of these, 21 in control and 26 in treatment chose “I do not want to make a donation” option at the start of both rounds without reading any of the mission statements. These subjects, termed “non-donors”, are dropped from all analyses as there is no data on their search behavior or their donation levels resulting from engaging in the search process for either of the two rounds. This section is divided into 3 parts, with each part reporting results associated with the three main variables of interest: search, charity donated to, and donation levels.Footnote 12
3.1 Increased ex-ante search in the presence of feedback
Figure 1 displays the frequency distribution of number of charities searched in rounds 1 and 2 across groups. Those who searched zero charities likely donated based on mission statements alone. In round 1, 16% of subjects searched all four charities in the treatment group while only 9% in the control. This difference is significant (p value < 0.05, using chi-square test) and renders the two distributions marginally significantly different (p value < 0.1). In round 2, this percentage increases to 43% in the treatment group, while hovers around 10% in the control. Moreover, while only 41% of the subjects searched all four charities in the treatment, 73% searched all four in the control, making round 2 distributions significantly different across groups (p value < 0.01).Footnote 13
To better understand the impact of feedback on search, Table 1 presents two regression models, with and without controls. The models display a significant treatment effect and a significant gender effect, with males searching less than females. The significant interaction coefficient between treatment and round 2 shows that subjects in the treatment group search significantly more in round 2 Lastly, as expected, there is a strong positive correlation between donation levels and search levels, i.e., those who donate more tend to search more.Footnote 14
Dependent variable: Number of charities searched |
OLS |
|
---|---|---|
(1) Without controls |
(2) With controls |
|
Treatment |
0.26** (0.13) |
0.24* (0.13) |
Round 2 |
0.06 (0.05) |
0.07 (0.05) |
Treatment*Round 2 |
1.02*** (0.13) |
1.01*** (0.13) |
Male |
-0.34*** (0.12) |
|
Donation amount |
0.01*** (0.002) |
|
Constant |
0.59*** (0.08) |
0.37*** (0.12) |
Number of observations |
874 |
874 |
Number of subjects |
437 |
437 |
*p < 0.10, **p < 0.05, ***p < 0.01. Standard errors (SE, in parentheses) clustered at individual level
One can only speculate why the difference in search behavior across the two groups was marginal in round 1 but substantial in round 2—possibly because one did not internalize the full impact of receiving feedback initially, altering future behavior in favor of search. Thus, I investigate elicited regret responses considering the behavior observed in round 1, and how it impacts behavior in round 2. It is natural for one’s regret intensity to increase with worse outcomes. The distribution of regret over charities (Fig. 11, Appendix 2) shows that the worst charity donors expressed most regret: 42%, 33% and 11% for the 4th, 3rd and 2nd ranked charity, respectively. Furthermore, investigating the credibility of regret claims, Table 2 sheds light on how round 1 regret impacts search in round 2 for the treatment group. The variable ‘regret’ is a dummy equaling 1 if the subject displayed regret in round 1 for not donating to the top charity and 0 otherwise. The resulting coefficient shows that donors search more after receiving feedback if they also express regret in their donation decision from round 1.
Dependent variable: Number of charities searched in round 2 |
OLS |
---|---|
Round 1 regret dummy |
1.02*** (0.32) |
Constant |
1.50*** (0.27) |
Observations |
144 |
Of the 216 subjects in treatment, 37 donated to the top charity, 33 did not donate, and 146 donated to a non-top charity triggering the regret elicitation question at the end of round 1. Of the 146, 2 subjects were round 2 “non-donors” and hence were dropped. Including them does not change results significantly. *p < 0.10, **p < 0.05, ***p < 0.01. SE (in parentheses) clustered at individual level
3.2 Increased donor flow to the top charity
Figure 2 reflects the frequency distribution of supported charities, comparing control and treatment across rounds. While the number of subjects who get information on all four charities in round 1 differed significantly across groups, this did not translate into a significant difference in those donating to the top charity. Of those making a positive donation in round 1, 15% got information on the top charity in the control group and 22% in the treatment group. Of these, 67% donated to the top charity in the control group versus 55% in the treatment group, an insignificant difference. 77% (per group) of those who did not donate to the top charity despite getting information on it donated to the second-ranked charity suggesting that donors may care about other factors more than the provided measure.Footnote 15
Although there is no difference in round 1 distributions across groups, round 2 distributions are significantly different (at p < 0.01, chi-square test): a lot more donations were made to the top charity in round 2 of the treatment group, unlike the control. While increased search in round 2 of the treatment group is the main driving force behind this result, about 13% of top-charity round 2 donors changed their decision in favor of the top charity in going from round 1 to 2.Footnote 16 A detailed analysis shows that 20 out of 42 subjects did not donate to the top charity despite getting information on it in round 1. Of those, 18 received information on the top charity in round 2, of which 13 donated to the top charity. This suggests that in the presence of feedback, donors not only search more but also make decisions that are indeed more aligned with third-party evaluations.
3.3 Donation levels remain unchanged
While most donors searched more among charities and donated to better ranked ones in the presence of feedback, an alternative way to avoid regret would be to not make any donations at all. However, the feedback neither improved nor hurt the donation levels: $42 on average for both rounds in the treatment. The control group’s donations averaged $40 and $38 in rounds 1 and 2 respectively; the difference being small and insignificant. The extensive margin of giving in the control was 82% and 84% in round 1 and 2, respectively, and that in the treatment was 85% in both rounds. Figure 3 further shows no difference across the two distributions for both rounds.
Looking for heterogeneity in giving, I investigate if donors substitute quantity with quality, that is donate less if donating to the top charity. For instance, those who donate to the top charity in round 1 of the treatment group may donate less in round 2: 37 subjects donated $51.76 on average to the top charity in round 1, with their donations dropping to $47.03 in round 2. However, this difference is not significant (p value equals 0.22 with paired t test, and 0.15 with Wilcoxon signed-rank test). Additionally, the mean donation amount of those donating to the top charity in round 2 (97 subjects) increased from $48 in round 1 to $49 round 2. Thus, providing feedback leaves the extensive margin and intensive margin of giving unchanged, directing money to better ranked charities, potentially improving the effectiveness of one’s donations.Footnote 17
4 Conclusion
This study employs an online experiment with real charities to investigate if absence of regret-inducing feedback on relative effectiveness of one’s donations is a contributing factor behind the lack of search among donors. Such feedback, which is absent in the real world, is made available exclusively to the treatment group over the course of 2 rounds. In response to anticipation of such feedback, individuals search relatively more and consequentially donate to better ranked charities. This increase in search is more pronounced in the second round for the treatment group, while there is no difference across rounds for the control group. When put in context with other related studies, these findings provide important insights into donor behavior: individuals are generally reluctant to seek information proactively, regardless of whether it comes at a cost (as observed in Null, Reference Null2011) or is provided freely (as in the control group of this study), unless they anticipate regret, as demonstrated in the treatment group. This suggests that the absence of regret-inducing feedback renders charity information less instrumental in donation decisions, thereby contributing to the prevalent lack of search among donors.
In conclusion, while there are ways to promote effective giving (Butera & Houser, Reference Butera and Dan2017), the current study identifies an inherent feature in charities that prevent informed giving. Although the feedback provision feature of the experiment was useful in understanding what could be driving the lack of search among donors, it is not a recommended policy suggestion to promote informed giving: this sort of information provision is neither natural nor feasible in the real-world. However, knowing that donors are positively impacted by relative information on charity quality can be useful in designing policies and campaigns that can promote informed giving without hurting donations—a fruitful avenue for future research.
Acknowledgements
This study was funded by the Decision Sciences Collaborative and the Journal of Money, Credit and Banking, Ohio State University (OSU). It was approved by the OSU IRB on 11/20/2015 (2015B0482). For helpful advice, I thank Lucas Coffman, John Kagel, Paul Healy, Mark Dean, Korie Amberger, Pedro Rey Biel, two anonymous reviewers, and various conference and seminar participants. Errors are my own.
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature.
Data availability
Data available upon request.
Appendix 1
Online Instructions
Control
In this survey, you will be making decisions on how you would want to distribute the $80 between yourself and a charity that serves poor African communities. The charity names are altered to keep them anonymous.
For every 40 students who participate in this survey, one student's name will be drawn who will get the $80. If you get the $80, then the decisions you make in the survey regarding the distribution of the $80 will be implemented for you.
There are two rounds to the survey. Your decisions for only one of the two rounds will be implemented. Each round is equally likely to be selected for implementation.
The drawing for the $80 will happen on 4/30/2017, at noon. You will be provided with a donation receipt (if you make a donation) and the remaining balance from the $80 will be given to you. You will be notified via email if you win the drawing.
Note: Always click continue to move on to the next page.
Treatment
In this survey, you will be making decisions on how you would want to distribute the $80 between yourself and a charity that serves poor African communities. The charity names are altered to keep them anonymous.
For every 40 students who participate in this survey, one student's name will be drawn who will get the $80. If you get the $80, then the decisions you make in the survey regarding the distribution of the $80 will be implemented for you.
There are two rounds to the survey. Your decisions for only one of the two rounds will be implemented. Each round is equally likely to be selected for implementation.
If you donate to one of the four listed charities, their real names and their rankings based on their performance as evaluated by third-party organizations will be revealed to you at the end of EACH round.
The drawing for the $80 will happen on 4/30/2017, at noon. You will be provided with a donation receipt (if you make a donation) and the remaining balance from the $80 will be given to you. You will be notified via email if you win the drawing.
Note: Always click continue to move on to the next page.
Survey screenshots
Treatment
All screens look the same as in the control group except the treatment group views an additional screen related to charity rankings (Fig. 8):
Procedure for ranking charities
In each round, there was only one top charity as determined by third-party charity evaluators such as GiveWell, Giving What We Can, and google.org: Against Malaria Foundation in round 1 and Give Directly in round 2. These 2 charities were the first-ranked charities. None of the other 6 charities were evaluated by a third-party evaluator as they evaluate only promising charities. Lunchbox Fund and Aqua Africa were ranked the second best because either they collaborated with other organizations/celebrities and/or because they provided their impact information in a quantitative nature. They also had high charity navigator ratings with an increasing donation trend over the years. The other four charities, that is the bottom 2 charities per round, were included in the study either due to missing impact information as its absence is likely to breed distrust or because of the qualitative nature of their self-reported impact information making it harder to judge its true value. Out of the bottom 2 charities per round, one of them was ranked fourth because it had spent more than 50% of the donation money on overhead (83% round 1 charity and 62% round 2 charity), along with a declining trend in donations. Coincidentally, a charity’s overhead expenditure was perfectly negatively correlated with its rank. Thus, while the top (first-ranked) charities were determined solely by third-party evaluations, a combination of factors such as external validation, amount spent on the cause (and not overheads), donation trend, charity navigator stars, and self-reported impact information were used to rank the non-top charities. Although the overhead costs were NOT (and should never be) the only criteria for ranking the charities in this study, it was one of the metrics provided for three main reasons: 1. Financials of the top charities revealed that they spent very little on overhead, 2. It made for a simple metric for subjects to understand, and 3. Donors value information on overhead costs according to donor reports (Hope Consulting, 2012). Ultimately, the ranking screen summarized three pieces of information per charity: percentage of donation spent on cause versus overheads, whether the charity was backed by third-party evaluator, and, if not, then whether the charity provided any impact information on its own. Most importantly, the subjects were not required to abide by these rankings in any way.
Appendix 2
Additional results
Figure 9 below provides summary statistics of all important variable across rounds and groups:
Donation levels conditional on search
To look further into the relationship between donation levels and search, the top panel in Fig. 10, graphs the mean donation level (with error bars) conditional on number of charities searched across control and treatment for both rounds. As can be seen, there is no significant difference between the two groups conditional on the number of charities searched. Besides a general trend of increasing donations with increasing search, in round 2 of the treatment one can see that the donation levels of individuals who searched 0 charities is significantly less than those who searched 2 charities.
The bottom panel of Fig. 10 divides these observations into 2 groups based on if an individual compared at least 2 charities before making a relatively more informed decision: ‘searched less than 2’ charities and ‘searched 2 or more’. Providing further evidence of the positive correlation between search and donation levels, we can see that the mean donation level increases with more search. Specifically for round 2 of treatment, those who compared charities, donated significantly more on average than those who did not.
Regret distribution across charities
Figure 11 below shows the distribution of reported regret in the treatment group over the 3 non-top charities. 146 subjects in total donated to a non-top charity in round 1 of the treatment group. Of them 79 donated to the 2nd ranked charity, 48 to the 3rd ranked and 19 to the 4th ranked. As shown in Fig. 11, 42% of those donating to the worst charity report experiencing maximum regret, followed by those donating to the third-ranked (33%) and then the second-ranked (13%) charities. This shows that donating to worse charities creates relatively more regret.
Impact of informed giving
Along with using the donation money to support a charity’s cause, charities use donation money to pay for overhead costs as well. While subtracting the money spent on overheads from total donations is a highly imprecise way to determine the true impact of donations, its numerical nature makes for an easy (to obtain and calculate) measure to get an estimate on the minimum impact created by one’s donation conditional on the charity donated to. Given the negative correlation between a charity’s rank and its overhead cost in the experiment, donating to a higher-ranked charity ensured a higher minimum impact of one’s donations in this setting. Thus, I use the proportion of donations spent on the cause (and not overhead) to get a handle on the minimum impact created by one’s donations depending on the charity donated to. I first average the percentage of donation amount spent on cause for similarly ranked charities across rounds for a fair comparison across rounds as the charities differed across rounds. Each donation made to a charity is then multiplied by this averaged percentage corresponding to that charity’s rank. The resulting variable, which is essentially the mean donation amount spent on cause represents the mean minimum impact created by donations depending on the charity donated to. As shown in Table 3 below, the average minimum impact derived is higher (but not significant) in the treatment group in round 1, with this difference becoming substantial and significant in round 2, as a result of donating to higher-ranked charities. This is true for the treatment group even when comparing across rounds. Thus, while mean donation levels across charities do not differ significantly, the charity to which the money is donated to can significantly affect the minimum impact generated by one’s donations.
Mean donation spent on cause ($) |
Round 1 |
Round 2 |
Difference |
---|---|---|---|
Control |
30.40 (1.42) |
29.05 (1.46) |
1.35 |
Treatment |
33.31 (1.38) |
39.08 (1.66) |
− 5.77** |
Difference |
− 2.91 |
− 11.08*** |
Includes observations with positive donations only. The “Difference” row calculates the “impact donation” difference in control and treatment per round: for round 1, 30.4 − 33.31 = − 2.91 and similarly for round 2. The “Difference” column calculates the same but between the 2 rounds per group: 30.4 − 29.05 = 1.35 for the control group (the top row shows round 1 minus round 2 for control) and similarly the bottom row for the treatment group. The stars denote whether a calculated difference is significant or not with ***, ** and * denoting significance at 1, 5, and 10%, respectively. Standard errors are reported in parentheses. The test used to calculate the level of significance across groups is Wilcoxon rank-sum test and that within group is the signed rank test. Number of observations: control—182 and 186 in round 1 and 2, respectively; treatment—183 and 184 in round 1 and 2, respectively