Tablet’ Market Segment update

The last month was full of action if you follow the tablets market segment. HP first started the price discounting to “gain market share” and then dropped the “bomb” of discontinuing the TouchPad they introduced only 42 days before. The judgment is still out whether we witnessed results of really agile decision making or an example of exceptionally bad corporate self-distraction. The initial stock market reaction seems to support the latter hypothesis, and current history of HP boardroom soap opera episodes provides enough clues. The new CEO apparently wants the company out of consumer products businesses.

There is an update – It appears the decision produced a shark bait effect and caused a number of class action suites on behalf of shareholders.

In this installment of online market research update, I would like to explain the process we follow to generate these reports.

We start at the Product Reputation screen and enter name/model of a tablet and click the “Submit” button. When the metrics for the entered tablet show up on the right side of the screen, we click on the “Compare with other products” button to expose all tablets in our database.

At this date, we monitor customer generated content for 32 tablets and the Market Intelligence report will show their reputation which is calculated by processing the text of customer reviews with our opinion mining software. Keep in mind that no questions were asked about their experiences and no customer was ever contacted by us to solicit their opinions. Surveys are not our business!

We use the “Customize your report” button to select only the tablets that were updated (new customer reviews were published online) within the last 30 days and have greater than 25 customer reviews published. The total number of reviews analyzed is 9,003. The result of the customization is displayed below. Please note that the metrics are calculated on all aggregated reviews published by the customers from the time a tablet became available for purchase.

We export the CSV file and generate WoM (Word of Mouth) Share chart and Trend based on the exported data. Not surprisingly, Apple iPad earns the largest share of customer feedback at 17%, although the number is much smaller than its market share and substantially dropped from 35% only two months ago.

To discover what attributes of their customers’ experience are important, to measure how important these attributes are to the customers, and what the difference between their expectations and their experiences with each attribute is, we focus on five of the most reviewed tablets for a more detailed Customer Intelligence Analysis.

We use a two-point scale to visualize that difference.

0=unacceptable / 1=experience meets expectations / 2=delighted

Customers “say” that Usability (11.64%), Reliability (11.32%), Quality of Construction (9.5%) and Display (5.4%) are the most important attributes of their experience with the tablets. While all participants are providing Usability experience well above their customer’s expectations, HP TouchPad and Apple iPad 2 are the leaders in this category. Motorola and Toshiba are considered the most “reliable” tablets by their customers, while Samsung Tab continues to struggle.

Here is the access to the tablets’ online marketing research dashboard that allows to see actual customer’s feedback if you click on a specific bar.

The last chart I would like to offer depicts customer affinity for tablet’s operating system and despite all brouhaha about the TouchPad, WebOS still earns the highest score from its customers.

   For those of us who are deeply involved with online marketing research, it may appear that the proliferation of Voice of the Customer (VoC) programs is exploding these days. However, recent Forrester’s research found that 56% of the executives they surveyed were not aware of any formal VoC program in their companies. One of potential explanations to this discrepancy may be the fact that many companies conduct localized, departmental initiatives that are not visible to the rest of the organization.

Indeed, an amount of online surveys I am bombarded every day is staggering. It seems that people who designed every website I stop by want to know my opinion… even before I had any time to form one. Availability of inexpensive and easy-to-use technology for conducting online surveys is not a good excuse for harassing your site’s visitors to collect “short” and “easy” response to the closed-ended questions structured on a scale of 1 to 5.

There are 3 reasons why an inadequately administered survey is harmful to your business:

• Popup surveys reduce visitor engagement with a site, and therefore promote high bounce rate.

Many people commenting about their site user experience are complaining about the timing of these interruptions and their inability to respond to posed questions at a time they are being posed. Timing the request to allow a customer to experience your product or service would provide more meaningful reaction and responses.

•  Questions that do not align with customer’s experience and perspective do alienate the customers.

The closed-ended questions you pose to your customers may be very important to you and your company. However, if answering them does not provide any value to the responder, why would they want to waste their time? It is much better to provide generous space for comments and reflections of their experience from their perspective, and let them tell you what elements of this experience are important to them. Make it easy for them to say what they want to, not what you want to hear. They are not in the business of validating your assumptions.

• Customer Feedback that does not result in action is a waste of time – yours and your customer’s.

A disconnect between cause and effect explains low participation of voters in a political process. Customers want to help you improve your product or service and will provide you with clues to how to do it, if you “listen”. There are tools available for automated processing of unstructured customer comments and reviews that are called Opinion Mining platforms. Use them to help you discover the insights into their experience. You can get results within 24 hours. Let the customers know that their efforts are not wasted. Communicate back what you have learned from them and what actions you plan to take in an effort to improve their experience.

This online market research, administered by Amplified Analytics, is valid as of August 5, 2011 and is the result of the review of different tablet brands’ segment of the market. It is based on the analysis of customer feedback from 8,241 tablet users who expressed their sentiments on the product.

The chart above depicts the Word of Mouth (WOM) Share for ten of the top tablet brands in terms of customer satisfaction (CSI).

The chart above illustrates shows customer satisfaction with Operating System of their respective Tablet.

The scores were algorithmically produced by the use of Opinion Mining software that conducts an analysis of customer feedback that is published online by the customers themselves; no customer was personally contacted to provide their opinions.  The relative percentages were not based on customer’s answers to biased survey questions. It is not Amplified Analytics’ business to conduct surveys.

It is also important to note that the Apple iPad2 was excluded from the list of tablet brands analyzed because it significantly dominates the market, thus making the comparison of customer satisfaction meaningless. The Apple brand seems to have its own market that is incomparable to others.

The chart below shows a comparison of specific attributes (reliability, portability, display, etc) of leading tablets. These attributes came from the customers when they shared their experience using the brands. The green line athwart denotes the relative importance of each attribute to customers. Check the methodology used in this link: Opinion Mining. Attributes with less than 1% importance were not included in the graph.

From the graph, we can see that Reliability is the most important attribute, with 11.7% of total opinions.

Yet, customers of Samsung Galaxy continue to get disappointed for the second month of measuring it since it was first introduced. Its Customer Support, with an importance rating of 1.76%, exceeds customer expectations by 8% while the Display attribute, with a 7.42% score, is on top of the competition.

You can access this dynamic Customer Intelligence dashboard by clicking on this link and CustomerSay! Verbatim by clicking on a specific bar of this chart. “Attributes” and “Products” selection windows allow for focus on your area of interest.

Social media monitoring quickly becomes a “commodity” with hundreds of companies’ rummaging through fire hose streams of communications published, re-published and re-tweeted every second of a day. Brands want to know what people think about them and are prepared to pay for this knowledge. But why is this so? What is the value of knowing that people communicate a positive sentiment about your brand today?

I would speculate that most companies make this investment without specific strategy or process on hand, and some companies do it to manage the reputation of their brands or in other words, to do PR damage control and risk mitigation. A very few do so to systematically improve their customers’ experience.

Most of Social Media chatter has relatively low value for opinion mining efforts, which need to be given attention if you want to extract actionable knowledge for systematic change.

Furthermore, it is important to understand the differences between the types of communications that use Social Media channels:

• People often refer to Word of Mouth (WOM) in Social Media as a buzz and focus too much on technology at the expense of the appropriate targets, actions and measurements.
• The Voice of the Customer (VOC) is a subset of WOM that can be directly attributed to the customers of your product. It is very similar and as valuable as, if not more valuable than, customer feedback collected by many companies through their “walled garden” channels at a great expense.

The opinion mining operation that is focused on the Voice of the Customer “ore” delivers significantly higher yield compared to the overall Social Media buzz in terms of actionable knowledge. It is possible because it provides a very close correlation to specific products and often describes holistic customer experience with these products. I refer to “holistic customer experience” in the context of the customer’s effort required to achieve a desired outcome. An example of a desirable outcome is a new roof for the house or a quality audio experience while exercising in a gym.

We consider all steps – from the initial purchase research to the selection, purchase, delivery and setup, and to a completed realization of the desired outcome – measure it as a difference between the customer’s expectations and their perception of reality (their actual experience). Examples of VOC “ore” include—in ascending order—customer forums, blogs and customer reviews published online.

Recent Forrester’s research found that 14% of executives surveyed said that their companies don’t solicit customer feedback at all, while 56% of the respondents said—or were not sure if—their companies do not have a formal VOC program. However, the most shocking finding is that nearly one out of every four executives said that they seldom or never use customer feedback to change a business process (source: http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=142811).

The Temkin Group research identified it as the one of Top 10 Customer Experience Incompetencies, as shown in the table on the left.

There is a good reason why so many companies find it difficult to mine Social Media for improving customer experience:  most content generated by customers is unusable by corporate information systems that are built to process structured data.

The following steps have to be taken to address the big challenge of translating seemingly anecdotal evidence into a scalable, corporate process:

1. Aggregation, capture, cleansing and authentication of Voice of Customer data
2. Conversion of this data into structured information
3. Alignment of this information with corporate targets, i.e. conversion of this information into corporate knowledge
4. Integration of that knowledge into existing, repeatable business process.

PHT95C82Y63H

Category Management Report Tablet’ Brands Word of Mouth Assessment (July 1, 2011)

This information is based on analysis of 6,413 customer reviews published online on or before July 1, 2011 on popular websites like Amazon, Best Buy and Cnet.com.

Only customer’s generated content (Customer Word of Mouth) is analyzed. Consumers’ opinions, without ownership reference, are not part of this online marketing research. The customer generated content was located, authenticated, de-duped and aggregated for the analysis.

There is significant difference in volume of customer feedback available for online marketing research of various brands as illustrated on the chart below.

Changes in Customer perceptions over time

HP TouchPad Tablet was introduced just a few days ago with an enthusiastic number of reviews and remarkably high Customer Satisfaction score. However it is not appearing on the Trending charts above because there is no sufficient history yet to plot.

Trend – It appears that the tablets with proprietary operating systems outperform Android counterparts, in terms of Customer Satisfaction, as they come to the market. See the chart below.

Please follow the links to HP Touchdown, RIM PlayBook, and Motorola Xoom,  verbatim if you want to read what the customers say about their experiences.

For more detailed analysis, please request Customer Intelligence Analysis for specific segment of this category.

The discussions on importance of innovation are all over Social Media. The calls for innovating ourselves out from the current economic malaise are coming from the President of Consumer Electronics Association to the President of the United States. In the words of Louis XIV (or was it Mel Brooks?) – “It’s good to be the King!” – for the rest of us it would be helpful to put some definitions around these terms. I do not pretend to be an expert on the subject of innovation, but I like to be specific and want to offer some ideas for discussion.

So what differentiate commercially successful product or service from the innovation?

I would like to propose that successful products gain market traction, meet their sales forecasts and generate anticipated profit margins.  Innovative products re-shape the market place, create new categories, and generate blockbusting profits. Innovative products successfully defeat the competitors’ assaults for long periods of time.

Development and introduction of successful products or services is a very challenging and risky endeavor, as we are well aware.

The Recent Portfolio Management Benchmark Survey sponsored by Planview, reported that only 52.3% of products meet with commercial success, while 21.2% were “killed prior to launch”.  They did not specify the type of products or industries covered by this survey, but my personal experience pegs the success ratio well under 40% mark.

The risk level for innovation is even higher. It is estimated that only 1 out 3,000 new innovative ideas becomes a commercial success. We also know that most innovative products rarely have anything to do with technological inventions, but have everything to do with the scale of market adoption. Peter Dreker, the father of modern Management Science, wrote in his book “Innovation and Entrepreneurship”, that a 15 year “gestation” period is the average time observed between the time of an original invention and the time of its commercial realization.

We all know examples of such innovations as Ford T, Microsoft Word, iPod and iPad to name a few that dominated and still dominate their product categories. These are very different products, however the thought process, methods and techniques of the people who are behind the creation of these products, are a mystery we want to discover.

I would like to propose that the key difference between really good Product Managers and the Innovators is in a way they perceive and understand the markets they target.

While a Product Manager segments the markets in terms of demographics or personae for which they develop a product, an Innovator is focused on the Customer Experience of people, who struggle to use existing products to do their chores, and interprets these struggles into the definition of innovative vision for new generation products.

In other words they concentrate on improvement of EXPERIENCE as oppose to improvement of a PRODUCT.

Last week we focused at customers’ perception of Operating System for tablets they purchased. These metrics are extracted from 1,352 customer generated content pieces published on-line  on or before June 15th, 2011 using Opinion Miner software.

The difference between customer expectations and their experience is measured from 0 to 2, where 1 represent a point of experience matches expectations and can be interpreted as 1=100% satisfaction.

The importance indicates a percentage of opinions about this Attribute weighted against the sum of all opinions expressed about the analized set of products. Considering the ratio of customer reviews published on-line against the number of units sold, any Attribute that carries importance over 1% may be experienced by tens of thousands of customers.

— CustomerSpeak! —

Android customers are also quite happy with their purchasing decisions depending on the version supplied with their tablet, while iOS do not have anything specific to say on the subject.

I am honored to present this webinar sponsored by Grandview Product Management community on June 22nd, 2011.

There is a heated debate in a Product Management community about the Role of Market Research in creation of innovative products and I have mused on this subject earlier on this blog.

Product managers, who subscribe to a “thought leadership” (as oppose to “customer participation”) model, love to quote Henry Ford who supposedly said – “If I asked my customers what they want, they simply would have said a faster horse.”  The “customer driven innovation” camp proponents are swearing by Customer Feedback and Voice of Customer based methodologies. However there is no clear evidence that either site consistently out-innovate their opponents.

During this webinar we will explore and analyze traditional methods of product definition process, their limitations and their applications that often lead to incremental improvements as oppose to true innovation. We will talk about

• What separate a successful product from INNOVATIVE product
• What are differences between a Product Manager and a Star Product Manager , and
• How the knowledge of the market helps to close the gaps between the two.

Please click on this link to register

In the last few weeks I have encountered this meme on Tweeter, LinkedIn group discussions and numerous product management camp presentations. In my opinion at the core of this debate are a fuzzy definition of the term “innovation” (that is often confused with “invention”) and poor understanding of market research methodologies that are often limited to survey and forum applications.

Since I don’t know a source of really authoritative, undisputable and complete definition of the term “innovation” I would like to propose that most innovations usually are new applications of previously invented technologies and/or processes. Truly innovative products usually find new ways to use existing inventions to improve experience of people. The confusion arises when practitioners focus on improving products rather than experience with the product, because that is where a difference between “innovation” and incremental “improvement” lives.

Product managers, who subscribe to a “thought leadership” (as oppose to “customer participation”) model, love to quote Henry Ford who supposedly said – “If I asked my customers what they want, they simply would have said a faster horse.” There is no debate that a motorized carriage was an amazing invention, which by the way was not created by Ford – he innovated scalable assembly line manufacturing, among other processes. However his quote only implies that survey and/or forum market research methodologies are not suitable for validation of truly innovative products in conceptual stage of development. He couldn’t help but notice all the horse manure on the streets and inefficiencies of small cargo shipping associated with horse carriages. The art of “noticing” how customers experience products, currently available to them, is called ethnographic research and there is no innovation possible without some degree of it.

During the last SVPCamp 2011, I was really tickled to see a presentation by Tony Ulwyck of Strategyn, called “Silence the Voice of the Customer (VOC) and Create Breakthrough Products”. My first reaction to the subject line of the presentation was extremely negative as I, like possibly many others, did not pay close enough attention to terminology he used. In fact VoC is defined by most practitioners as company stimulated customer feedback about your existing products, which is one of the best sources of inspiration for incremental product improvements. Considering this, Tony’s subject line is very valid and surely catches people’s attention. Since VoC collection mechanisms are designed around company’s desire to collect and process the content in the most efficient way, they often do not encourage free and easy sharing of customer experiences, and the ways and reasons customers use the products. That is the primary reason why VoC does not offer much opportunity for discovery of “Aha” insights that lead to innovation. However the quest of an enterprise for efficiency often leads to missed opportunities to innovate as freely flowing stories about how the customers use the products and what jobs they “hired” these products to do, contain insights that can be discovered only by much more expensive ethnographic research. Online Word of Mouth (WoM) opinion mining technologies hold a promise of help this discovery to become timely, scalable and economical process.

With introductions of new tablets from major players taking place almost every week now, we decided to check the “pulse” of customer perceptions with products of this market segment. We limited the list to four most popular products in the interest of keeping the chart neat, but you can check the reputation of other tablets we track by going to http://tinyurl.com/aaidemo, entering the product name or number like “Apple iPad 2″ and clicking on “Submit” button. The system will aggregate and analyze customer reviews to calculate the reputation metrics for you and will let you read the reviews if you want to. You can also compare it to the other tablets reviewed.

Below is a screen shot of Customer Intelligence Analysis dashboard (in private beta) that compares scores of the attributes that are most important to their customers. The importance value is indicated on the right side  and measured as an average percentage of all opinions expressed for these products.

Click on this image to enlarge it.

6,314 customer reviews were processed by the Opinion Miner® software to produce these results. It appears that Reliability (i.e. availability of the device’s to provide intended functionality to a customer) is the most important attribute of the tablet devices as 8.21% of all opinions expressed are focused on that part of the experience. Please contact us for the access to the detailed analysis of ALL attributes for these, or any other products of interest to you. Our customers use this information in their product planning process and for tuning their marketing communications.

Our research shows that customers who purchased Apple iPad 2 report their overall (CSI) expectations were exceeded by over 36%. It is 8% higher than the results achieved by original iPad and newly released Motorola Xoom.

These results, particularly about the newly introduced tablets, will most likely change within a few weeks as the customers will have more time and opportunity to experience them in wider range of circumstances, and more reviews will be posted online. We will continue to monitor the market segment perceptions as new products are introduced and keep you posted.