Impact Evaluation

Impact Evaluation

Impact Evaluation Jonathan Poland

An impact evaluation is a study that measures the actual outcomes and consequences of a change. It takes into account both intended and unintended effects of the change, and aims to determine its overall impact. This means that a program or project may achieve its goals, but have negative unintended consequences. On the other hand, a program that is perceived as a failure due to budget and schedule issues may actually have a more positive impact than originally anticipated by its planners. Impact evaluations help organizations understand the full range of impacts of a change and can inform decision-making about future changes or interventions. The following are illustrative examples of an impact evaluation.

Cities

A city expands its highway system to more lanes only to discover that within a few short years traffic jams have once again become a common occurrence. An impact study indicates that the new lanes encouraged development of land further from the downtown core making the city less dense and increasing average commuting distance.

Transportation

A program to develop a system of high speed trains is initially viewed as a failure as it exceeds planned budget. However, within a decade ridership is far greater than business plans had anticipated. The overall impact on the economy, quality of life and the environment can be demonstrated to be exceedingly positive.

Education

An education system abandons standardized testing in high schools in favor of tests crafted by individual teachers. A later impact study looked at data before and after to determine that grade inflation occurred with the abandonment of the standard tests. This led universities and colleges to begin to rank schools and apply more complex admission processes than were far less transparent to students.

Marketing

A newspaper begins aggressively optimizing the titles of its articles with A/B testing. This immediately increases overall revenue. A later impact study indicates that the quality of titles dropped dramatically such that titles often didn’t reflect the content of articles. The optimization effort was associated with a steady decline in reputation, customer satisfaction and subscription rates.

Learn More
What is Marketability? Jonathan Poland

What is Marketability?

The marketability of a brand, product, or service refers to its competitiveness within a market. It is the likelihood that…

Sustainable Design Jonathan Poland

Sustainable Design

Designing for sustainability involves creating products, services, and processes that minimize environmental impact and enhance quality of life for the…

Customer Advocacy Jonathan Poland

Customer Advocacy

Customer advocacy is a customer service strategy that involves employees representing and fighting for the interests of customers, rather than…

Strategic Goals Jonathan Poland

Strategic Goals

Strategic goals are the specific outcomes that an organization or individual hopes to achieve through their strategy. The strategic planning…

Product Identity Jonathan Poland

Product Identity

Product identity refers to the overall personality or character of a product. This can include the product’s features, benefits, and…

Dynamic Pricing Jonathan Poland

Dynamic Pricing

Dynamic pricing refers to the practice of changing prices in real time in response to changes in market conditions or…

Business Capability Jonathan Poland

Business Capability

A business capability is a broad term that refers to the things that a business is able to do or…

Early Adopters Jonathan Poland

Early Adopters

Early adopters are individuals who quickly adopt an innovation. Marketing and selling innovative products can be challenging as it may…

Do-It-Yourself Lobbying 150 150 Jonathan Poland

Do-It-Yourself Lobbying

Yes, it is possible to lobby the government without hiring a professional lobbyist. Lobbying, in its essence, involves advocating for…

Content Database

Search over 1,000 posts on topics across
business, finance, and capital markets.

Product 101 Jonathan Poland

Product 101

A product is an item that is offered for sale. It can be a tangible good, such as a car…

Business Capability Jonathan Poland

Business Capability

A business capability is a broad term that refers to the things that a business is able to do or…

Visual Branding Jonathan Poland

Visual Branding

Visual branding is the use of visual elements, such as color, typography, imagery, and design, to create a cohesive and…

Data Quality Jonathan Poland

Data Quality

Data quality refers to the accuracy, completeness, and reliability of information used for various purposes within an organization. Ensuring high…

How does a boat float? Jonathan Poland

How does a boat float?

A boat floats due to the principle of buoyancy, which is based on Archimedes’ principle. Archimedes’ principle states that an…

Key Employees Jonathan Poland

Key Employees

Key employees, or key personnel, are individuals who possess unique skills, knowledge, or connections that make their prolonged absence or…

Sales Operations Jonathan Poland

Sales Operations

Sales operations is the management of the processes and practices that support the sales function of an organization. It involves…

What is Achievement? Jonathan Poland

What is Achievement?

Achievements are the results of efforts that have produced positive outcomes. These outcomes can range from resounding successes to partial…

Active Silence Jonathan Poland

Active Silence

Active silence is the intentional and strategic use of silence in communication. It involves the ability to listen attentively and…