![]() |
The Gantry Group |
![]() |
Confidence to make Critical Business Decisions | Gantry Group Newsletter Issue No. 15, September 2002 |
|
So, which is more important -- quantitative ROI or qualitative ROI? Based on its interview of 225 C-level executives earlier this year, InformationWeek noted disagreement across executive role groups (CEOs, CIOs and CFOs) as to the appropriate measurement standards for determining Return-on-Investment (ROI) and the accompanying priorities of those standards. As a result of this study, Information Week stated that: "the good news is that C-level executives are giving more attention to the importance of soft metrics, known as intangibles, in determining the business value of IT projects." This finding favoring the use of soft benefits may be even further fueled by the proliferation of "ROI calculators" on websites of all kinds. These high-level sales tools do not disclose underlying assumptions, are not highly customizable, and require only a few inputs to generate return estimates. Typically these tools are so generic that they do not accurately profile any company's business situation, producing high estimates that are simply not credible. Few C-level executives would make a technology purchase decision based on this type of ROI assessment. Finally there has been a plethora of articles written over the past six months asserting the elusiveness of "true" ROI, and the insurmountable difficulties associated with measuring it. More specifically these articles call the reader's attention to the lack of consensus within businesses on how to measure ROI accurately, and concluding that it can never be meaningfully captured. To those who would point to the difficulties of quantifying ROI as a reason for opting for "soft" intangible benefits only, we respectfully suggest that ROI promises without the ROI proof, is what fueled the failed Dot-Com era of the late nineties. In this fourth edition of the Gantry Newsletter series on ROI, we speak directly on the subject of tangible versus intangible ROI. As you will see, there is a case to be made for having both to maximize your sales effectiveness. Following the precedent set in the previous three newsletter issues,
the content in this document is written for vendors of technology-based
products and services. |
| Is ROI in the Eye of the Beholder? |
It seems that everyone agrees on that fact that Return-on-Investment is theoretically a powerful decision support tool. But not everyone agrees on the degree to which this assessment tool can be put into practice. In fact two schools of thought have emerged, drawing a line in the sand between whether quantified ROI is important or not.
Those who subscribe to the belief that ROI is too difficult to measure quantitatively (and therefore shouldn't be attempted) typically do believe that intangible benefits are the "real key to value". These benefits include customer satisfaction, employee retention, brand value, business relationships, and faster-time-to-market. In fact, all these factors can be measured. But the question remains as to how much of the benefit can be directly attributed to a particular purchase or implementation. Many would have you believe that ROI is therefore a subjective attribute -- more art than science. In the eye of the beholder, if you will.
The second school of thought takes the opposite view, claiming that "if it can't be measured it doesn't matter". Such ROI calculators either overlook very important and very real benefits, or they attempt to parameterize intangible factors such as brand value or improved business relationships, by applying a "proprietary" approach that magically metrifies the truly unmeasureable. These proprietary algorithms earn the status of commanding their own acronyms like "Return on (fill in the blank)" or Total Cost of (fill in the blank)".
As usual, the best place to be is somewhere in the middle of these two extremes. In other words, intangible benefits are important to notice and call to the attention of your prospective customers. The appropriate place for this is in your strategic messaging where you promote the unique value proposition of your offering. The tangible benefits (these are the ones that actually can be measured without handwaving) have their place in your value proposition too. The point is, you need both quantitative and qualitative ROI. How you present and distinguish them is key to credibility.
Finally, there is a third school of thought that dismisses ROI (both quantitative and qualitative) as a valid decision support tool. Quantitative ROI is thrown out because of disagreement on what should be measured, and because it doesn't reflect intangible value. Qualitative ROI is thrown out because of its very subjectivity and "softness". Subscribers to this line of thinking generally point out that ROI isn't what is important -- profits and revenues are. [But perhaps they don't understand that ROI is generated from profit and revenue measures!]. According to the executive interview conducted by InformationWeek, cited at the beginning of the newsletter, business leaders in this camp judge investments by the degree of synergy with other initiatives - not by soft or hard benefits.
The thing to keep in mind when considering how all these views play against each other, is that ROI -- tangible or intangible -- is only one decision support tool, not the only one. There is no reason not to consider all of the above including economic and financial benefits, soft benefits, and how well the investment will fit into your current business strategy.
|
Promises, promises |
The pressure to demonstrate tangible ROI has not let up -- in fact, the continuing grip of the economy (oops! we mean the "recovering economy") has, if anything, increased the need for technology vendors to answer for the economic impact -- the very justification -- of their offering. IDC reports that some 68% of companies now require an ROI analysis for all IT investments and of those who do not do so currently, 23% expect to implement such a policy in the next 12 months. In light of these and other similar statistics, the importance of having both qualitative strategic value propositions and solid numeric estimates for Return on Investment cannot be over-emphasized.
The unique value proposition that forms the basis for your brand positioning and strategic messaging, is your promise. Today, promises just aren't enough to close a technology sale. While it is certainly easier for technology vendors to skip over the exercise of quantifying their ROI benefits, prospective customers will assign less credence to your unsubstantiated claims of increased customer satisfaction and other intangible benefits. The point to realize is that having believable numeric ROI benefits, actually boosts the impact of your qualitative value proposition.
In the current economic climate most executives are skeptical of claims that, from their perspective, are based on a wave of the hands. Assertions about how your offering will reduce costs, create efficiencies, and retain customers must be backed up with (believable) numerics. Some claims are easier to quantify than others. But don't give up on quantification just because at first glance you can't directly measure an intangible benefit.
Let's say, for example, that your offering automates a previously manual process such as data entry. One of the seemingly intangible benefits might be "greater accuracy". Upon closer examination, you can focus research on determining the average cost per error, or perhaps the frequency of re-work outsourcing due to errors. Knowing the reduction in the number of incidents where work is sent out to a third party for re-entry, and knowing the cost of the third party leads you directly to the savings from avoided cost due to increased data accuracy.
A more ambiguous example is dealing with something like decreased liability or risk. Since risk assessment is based on probabilities, it is difficult to accurately estimate the impact of a product or service on probability. If however, insurance payments can be reduced or eliminated due to implementation of the offering, then those reductions should be reflected quantitatively to support the qualitative claims of reduced risk.
| How to Strike the Balance |
As we've suggested in previous newsletters in this special ROI series, the optimal approach to developing a set of credible, realistic ROI tools is based on two factors:
1) recognition that ROI should be customized to the industry you are targeting and to the application of your offering, and;
2) identification and validation of how your target market measures ROI or payback.
Now we'll add a third guideline:
3) ensure that your study captures:
Whether your ROI study is based on a quantitative survey or qualitative interviews, it is important to take this opportunity to establish the value proposition your offering represents -- from the perspective of your target customers. This will require you to identify and distill the particular vocabulary used by your market to describe the benefits they value and expect if they were to purchase your offering. Your strategic messaging should include both the intangible value that your customers will enjoy and the quantified ROI they can expect.
But what happens if the
different executive role groups within your targeted prospect companies have
different ways of judging the soundness of an investment? The CFO, for example
may want to see a fast payback, while the CIO wants a good return on investment
and the CEO is looking to the increased overall business value. If all of these
parties are on the purchase decision team for your offering, then you need to
segment your ROI studies by each constituency. In this way you can
cross-tabulate your findings with role group or title, to discover exactly what
is important to whom. If you develop your strategic messaging and value
proposition statements in this way, you will be able to include critical
components that appeal to each of these groups. Or, if your budget permits, you
can develop individual strategic messages targeted to the individual
constituencies on the purchase decision committee.
| Establishing Industry-Specific ROI Benchmarks |
The notion of quantifying your value proposition -- to include tangible as well as intangible benefits -- sounds great, but how do you accomplish this by developing an ROI calculator that is designed for use with individual customer? A comprehensive, application-specific ROI study, should yield (at a minimum) the following deliverables:
The ROI benchmark is an analysis of all the ROI data that was collected during the study. Taken in the aggregate, you can estimate a reasonable range of ROI's over a few different time horizons. An analysis will take the averages (means), standard deviations, and medians of the data across participants. These results will enable you to identify realistic ranges of return on investment that can be expected from use of your offering over a specified period of time. These averaged figures with their accompanying standard deviations are appropriate for use in developing strategic messaging that quantifies ROI.
If you continue to monitor your customers' ROI
associated with implementation of your offering, you can improve the accuracy of
the quantified value proposition. New data can continually be added into the ROI
benchmark model, refining your estimates. Additionally, the increased number of
data points also increases the statistical validity of your claims. In other
words, the more data points your averaged ROI calculations are based upon, the
more likely that they can be projected to the wider population of your target
market.
|
NOW AVAILABLE! Palm Enterprise Mobile Solutions ROI Study prepared by Gantry Group. Palm Solutions Group engaged the Gantry Group to conduct an objective ROI study that would quantify the net results of deployed mobile solutions. Gantry Group has developed definitive ROI tools, each customized to specific application categories within major solution sectors. This white paper explores experiences with Remote Audit applications within the Field Force Automation sector (Field Force: Remote Audit). Individual case studies profiling specific deployments of such Palm Solutions Group solutions were developed to further illustrate the ROI experience. Using an interview-based approach with Palm Solutions Group’s enterprise customers, the Gantry Group developed a realistic, payback-modeling tool that measures the ROI impact that a Palm Solutions Group mobile solution deployment has on key business metrics and cost drivers for the Field Force: Remote Audit applications. Three companies, representing different industries, contributed to the development of a quantitative tool that measures the costs and benefits associated with the deployment. Care was taken to identify and parameterize only those tangible costs and benefits that could directly be measured to ensure that the ROI model is conservative and credible. No estimate-based assumptions concerning intangible benefits were included in the model, which was thoroughly cross-checked to ensure against “double-counting” and inclusion of cost savings that were theoretical but not realized. The companies profiled in this case study, on average, realized actual ROI of 1,000% or more over a three-year time period, with payback occurring in less than two months. |
| About the Gantry
Group
The Gantry Group is a strategic advisory firm
that uses primary market research to help companies cost-effectively
accelerate the successful market adoption of their products and services
-- online and offline. Gantry Group has helped over 165 client companies
drive sales, acquire new customers, increase brand equity, and increase
customer lifetime value through our market analysis, marketing testing,
and ROI/TCO benchmarking service suites. |
| The Gantry Group,
LLC 30 Monument Square, Suite 135 Concord MA 01742 |
Phone:
978-371-7557 Fax: 978-287-0043 Email: info@gantrygroup.com Web: http://www.gantrygroup.com/ |
If you are receiving this email, you either know one
of the Gantry Group team personally or we met you or your firm through a business interaction. If for some
reason this newsletter is reaching you in error, please let us apologize
immediately for our mistake. However we hope you discover value in our monthly
newsletters. Feel free to forward to friends and
colleagues.
| To
Unsubscribe: Simply reply with PLEASE REMOVE in the email subject
field and we will not impose upon you again.
To Subscribe: Simply send us an email at: info@gantrygroup.com and you will receive our monthly newsletter. |
Please [CLICK HERE] to view printable version of this newsletter.
Please [CLICK HERE] to view previous issues.