landscape proposal graphics (8)_edited.jpg

Decision makers need credible evidence to demonstrate the efficiency and effectiveness of publicly funded programs and projects. Program managers in government agencies and other organizations need information on the usage and potential societal benefits of programs to inform decisions on future program investments. The Balmoral Group helps clients evaluate program performance, assess program impacts, identify barriers to and opportunities for success, and translate findings into practical recommendations. Ultimately this information helps to demonstrate if, and how well, programs are achieving intended outcomes.

Program Evaluation and Impact Assessment

The Balmoral Group (TBG) designs comprehensive program evaluations to assess program effectiveness and efficiency, given stated goals, and governing policy and regulatory environments. To evaluate programs, TBG uses a comprehensive evaluation framework rooted in established, credible program evaluation methodology, including

Stakeholder engagement and analysis through interviews, focus groups, and surveys coupled with qualitative analysis to understand and objectively report stakeholder perspectives
Research of applicable local, state, federal laws, rules, regulations, and policies to build understanding of the legal and policy framework within which programs operate
Data collection and analysis including budgetary and financial trends; staffing and operational resource use; cost-benefit analysis to assess program cost effectiveness; geospatial analyses, and other analyses as deemed necessary by each unique project
Development of evaluative findings that are translated into practical, actionable recommendations for decision makers.

Program Evaluation

Program Evaluation Project Highlight

OPPAGA Mosquito Control Districts Review

Reviews evaluated board governance, service delivery, district purpose and performance measures, and program resources and costs...

OPPAGA Mosquito Control Districts Review

Reviews evaluated board governance, service delivery, district purpose and performance measures, and program resources and costs. Work included field reviews, staff interviews, and process and outcomes evaluation, with statutory, budgetary, and program recommendations provided in a final report. TBG staff reported findings in formal presentations to the Florida House of Representatives Local Administration, Federal Affairs & Special Districts Committee.

Figure: OPPAGA's 15 Mosquito Control District Locations

Source: TBG work product

Waste Less Recycle More

The Balmoral Group reviewed this $400 million initiative aimed at reducing waste and litter, increasing recycling, and supporting commercialization of emerging innovations for the New South Wales (NSW) Environmental Protection Agency (EPA) in Australia...

Waste Less Recycle More

The Balmoral Group reviewed this $400 million initiative aimed at reducing waste and litter, increasing recycling, and supporting commercialization of emerging innovations for the New South Wales (NSW) Environmental Protection Agency (EPA) in Australia. To thoroughly assess the wide range of activities included in the Waste Less, Recycle More (WLRM) initiative, TBG utilized several approaches including cost-benefit analysis, program evaluation, and distributional analysis. A scoring rubric was developed to assess and compare programmatic outcomes changes in behavior, financial performance, and governance across several initiatives. Results provided information on the cost-effectiveness of the program and performance of individual initiatives. As such, the findings informed the development of recommendations to help decision makers prioritize and enhance program implementation strategies to allow them to fully capture program benefits.

Figure: Scoring Rubric: Progress across initiatives

Source: TBG work product, from data provided by NSW EPA

Figure: Scoring Rubric: Progress across initiatives

Source: TBG work product, from data provided by NSW EPA

To improve understanding of the societal benefits of programs and projects, TBG conducts impact assessments. Impact assessments evaluate the ways in which programs are utilized by stakeholders, assess benefits resulting from the program, and identify factors necessary for sustained adoption of successful programs. Our team combines both qualitative analysis, often through stakeholder interviews, surveys, and literature reviews, and quantitative data, depending on the assignment. We apply this analysis to assess changes in knowledge, behavior, professional practice, decision-making, and other measurable outcomes, and to assess the benefits from the impact.

Impact Assessment

Impact Assessment Project Highlight

Measuring the Impacts of Workshops on the Use of Earth Observations in Coastal Ecosystems Valuation, NASA (10/2024 – 1/2026)

This work quantified the impact of the NASA-funded project "Using Earth Observations to Inform the Valuation of Coastal Ecosystem Services" (Grant No. 80NSSC18K0083, 2019)...

Measuring the Impacts of Workshops on the Use of Earth Observations in Coastal Ecosystems Valuation, NASA (10/2024 – 1/2026)

This work quantified the impact of the NASA-funded project "Using Earth Observations to Inform the Valuation of Coastal Ecosystem Services" (Grant No. 80NSSC18K0083, 2019). The original product comprised a series of workshops across the U.S. Gulf states. The team conducted structured interviews with practitioners who participated in prior workshops, and an online survey, in which more than 100 respondents who participated in prior workshops, or benefited from colleagues who participated, The results found significant changes in behavior, quantifiable impacts, and measurable benefits for a broadly dispersed group of researchers and coastal resource managers. Testimonials were solicited, and at least one video attesting to the benefits of NASA data was completed by NASA communications team as a result. A Return on Investment of 19:1 was estimated using documentation from participants.