Last week, the announcement of Amazon Fire line of products created a sizable splash in social media, Consumer Electronics, business and IT publications. While this new device does not have specs of a tablet, most observers immediately started to pin it against iPad. Is it a fair comparison? The answer to this question depends on your definition of what a product is. If you define a product by its functions and features, the answer may be – No. However, if your understanding of a product agrees with Clay Christensen’s definition as the “jobs-to-be-done,” the iPad and Fire will most definitely compete for the same share of consumer wallet, as most customers of these devices use them for web browsing/entertainment most of the time.

Since the Amazon Fire is not yet shipping to the customers, I would like to offer a comparison between Amazon Kindle and Apple iPad 2 from the perspective of their customers. Online marketing research produced this analysis of 7,706 customers feedback published in social media.

The image above highlights the attributes of customer’s experience most important to them as they have articulated in their feedback. No keywords were used during the analysis to identify these attributes, and no questions were asked to influence the answers, as surveys are not our business or part of our opinion mining methodology.

You can click on this link to access the dynamic dashboard and verbatim (by clicking on a specific bar).

Given such a high perception of value users of relatively primitive but extremely functional Kindle give to their experience, the Fire is poised to make a sizable bite out of current iPad tablet growth prospects.

Tablet’ Market Segment update

The last month was full of action if you follow the tablets market segment. HP first started the price discounting to “gain market share” and then dropped the “bomb” of discontinuing the TouchPad they introduced only 42 days before. The judgment is still out whether we witnessed results of really agile decision making or an example of exceptionally bad corporate self-distraction. The initial stock market reaction seems to support the latter hypothesis, and current history of HP boardroom soap opera episodes provides enough clues. The new CEO apparently wants the company out of consumer products businesses.

There is an update – It appears the decision produced a shark bait effect and caused a number of class action suites on behalf of shareholders.

In this installment of online market research update, I would like to explain the process we follow to generate these reports.

We start at the Product Reputation screen and enter name/model of a tablet and click the “Submit” button. When the metrics for the entered tablet show up on the right side of the screen, we click on the “Compare with other products” button to expose all tablets in our database.

At this date, we monitor customer generated content for 32 tablets and the Market Intelligence report will show their reputation which is calculated by processing the text of customer reviews with our opinion mining software. Keep in mind that no questions were asked about their experiences and no customer was ever contacted by us to solicit their opinions. Surveys are not our business!

We use the “Customize your report” button to select only the tablets that were updated (new customer reviews were published online) within the last 30 days and have greater than 25 customer reviews published. The total number of reviews analyzed is 9,003. The result of the customization is displayed below. Please note that the metrics are calculated on all aggregated reviews published by the customers from the time a tablet became available for purchase.

We export the CSV file and generate WoM (Word of Mouth) Share chart and Trend based on the exported data. Not surprisingly, Apple iPad earns the largest share of customer feedback at 17%, although the number is much smaller than its market share and substantially dropped from 35% only two months ago.

To discover what attributes of their customers’ experience are important, to measure how important these attributes are to the customers, and what the difference between their expectations and their experiences with each attribute is, we focus on five of the most reviewed tablets for a more detailed Customer Intelligence Analysis.

We use a two-point scale to visualize that difference.

0=unacceptable / 1=experience meets expectations / 2=delighted

Customers “say” that Usability (11.64%), Reliability (11.32%), Quality of Construction (9.5%) and Display (5.4%) are the most important attributes of their experience with the tablets. While all participants are providing Usability experience well above their customer’s expectations, HP TouchPad and Apple iPad 2 are the leaders in this category. Motorola and Toshiba are considered the most “reliable” tablets by their customers, while Samsung Tab continues to struggle.

Here is the access to the tablets’ online marketing research dashboard that allows to see actual customer’s feedback if you click on a specific bar.

The last chart I would like to offer depicts customer affinity for tablet’s operating system and despite all brouhaha about the TouchPad, WebOS still earns the highest score from its customers.

   For those of us who are deeply involved with online marketing research, it may appear that the proliferation of Voice of the Customer (VoC) programs is exploding these days. However, recent Forrester’s research found that 56% of the executives they surveyed were not aware of any formal VoC program in their companies. One of potential explanations to this discrepancy may be the fact that many companies conduct localized, departmental initiatives that are not visible to the rest of the organization.

Indeed, an amount of online surveys I am bombarded every day is staggering. It seems that people who designed every website I stop by want to know my opinion… even before I had any time to form one. Availability of inexpensive and easy-to-use technology for conducting online surveys is not a good excuse for harassing your site’s visitors to collect “short” and “easy” response to the closed-ended questions structured on a scale of 1 to 5.

There are 3 reasons why an inadequately administered survey is harmful to your business:

• Popup surveys reduce visitor engagement with a site, and therefore promote high bounce rate.

Many people commenting about their site user experience are complaining about the timing of these interruptions and their inability to respond to posed questions at a time they are being posed. Timing the request to allow a customer to experience your product or service would provide more meaningful reaction and responses.

•  Questions that do not align with customer’s experience and perspective do alienate the customers.

The closed-ended questions you pose to your customers may be very important to you and your company. However, if answering them does not provide any value to the responder, why would they want to waste their time? It is much better to provide generous space for comments and reflections of their experience from their perspective, and let them tell you what elements of this experience are important to them. Make it easy for them to say what they want to, not what you want to hear. They are not in the business of validating your assumptions.

• Customer Feedback that does not result in action is a waste of time – yours and your customer’s.

A disconnect between cause and effect explains low participation of voters in a political process. Customers want to help you improve your product or service and will provide you with clues to how to do it, if you “listen”. There are tools available for automated processing of unstructured customer comments and reviews that are called Opinion Mining platforms. Use them to help you discover the insights into their experience. You can get results within 24 hours. Let the customers know that their efforts are not wasted. Communicate back what you have learned from them and what actions you plan to take in an effort to improve their experience.

This online market research, administered by Amplified Analytics, is valid as of August 5, 2011 and is the result of the review of different tablet brands’ segment of the market. It is based on the analysis of customer feedback from 8,241 tablet users who expressed their sentiments on the product.

The chart above depicts the Word of Mouth (WOM) Share for ten of the top tablet brands in terms of customer satisfaction (CSI).

The chart above illustrates shows customer satisfaction with Operating System of their respective Tablet.

The scores were algorithmically produced by the use of Opinion Mining software that conducts an analysis of customer feedback that is published online by the customers themselves; no customer was personally contacted to provide their opinions.  The relative percentages were not based on customer’s answers to biased survey questions. It is not Amplified Analytics’ business to conduct surveys.

It is also important to note that the Apple iPad2 was excluded from the list of tablet brands analyzed because it significantly dominates the market, thus making the comparison of customer satisfaction meaningless. The Apple brand seems to have its own market that is incomparable to others.

The chart below shows a comparison of specific attributes (reliability, portability, display, etc) of leading tablets. These attributes came from the customers when they shared their experience using the brands. The green line athwart denotes the relative importance of each attribute to customers. Check the methodology used in this link: Opinion Mining. Attributes with less than 1% importance were not included in the graph.

From the graph, we can see that Reliability is the most important attribute, with 11.7% of total opinions.

Yet, customers of Samsung Galaxy continue to get disappointed for the second month of measuring it since it was first introduced. Its Customer Support, with an importance rating of 1.76%, exceeds customer expectations by 8% while the Display attribute, with a 7.42% score, is on top of the competition.

You can access this dynamic Customer Intelligence dashboard by clicking on this link and CustomerSay! Verbatim by clicking on a specific bar of this chart. “Attributes” and “Products” selection windows allow for focus on your area of interest.

Social media monitoring quickly becomes a “commodity” with hundreds of companies’ rummaging through fire hose streams of communications published, re-published and re-tweeted every second of a day. Brands want to know what people think about them and are prepared to pay for this knowledge. But why is this so? What is the value of knowing that people communicate a positive sentiment about your brand today?

I would speculate that most companies make this investment without specific strategy or process on hand, and some companies do it to manage the reputation of their brands or in other words, to do PR damage control and risk mitigation. A very few do so to systematically improve their customers’ experience.

Most of Social Media chatter has relatively low value for opinion mining efforts, which need to be given attention if you want to extract actionable knowledge for systematic change.

Furthermore, it is important to understand the differences between the types of communications that use Social Media channels:

• People often refer to Word of Mouth (WOM) in Social Media as a buzz and focus too much on technology at the expense of the appropriate targets, actions and measurements.
• The Voice of the Customer (VOC) is a subset of WOM that can be directly attributed to the customers of your product. It is very similar and as valuable as, if not more valuable than, customer feedback collected by many companies through their “walled garden” channels at a great expense.

The opinion mining operation that is focused on the Voice of the Customer “ore” delivers significantly higher yield compared to the overall Social Media buzz in terms of actionable knowledge. It is possible because it provides a very close correlation to specific products and often describes holistic customer experience with these products. I refer to “holistic customer experience” in the context of the customer’s effort required to achieve a desired outcome. An example of a desirable outcome is a new roof for the house or a quality audio experience while exercising in a gym.

We consider all steps – from the initial purchase research to the selection, purchase, delivery and setup, and to a completed realization of the desired outcome – measure it as a difference between the customer’s expectations and their perception of reality (their actual experience). Examples of VOC “ore” include—in ascending order—customer forums, blogs and customer reviews published online.

Recent Forrester’s research found that 14% of executives surveyed said that their companies don’t solicit customer feedback at all, while 56% of the respondents said—or were not sure if—their companies do not have a formal VOC program. However, the most shocking finding is that nearly one out of every four executives said that they seldom or never use customer feedback to change a business process (source: http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=142811).

The Temkin Group research identified it as the one of Top 10 Customer Experience Incompetencies, as shown in the table on the left.

There is a good reason why so many companies find it difficult to mine Social Media for improving customer experience:  most content generated by customers is unusable by corporate information systems that are built to process structured data.

The following steps have to be taken to address the big challenge of translating seemingly anecdotal evidence into a scalable, corporate process:

1. Aggregation, capture, cleansing and authentication of Voice of Customer data
2. Conversion of this data into structured information
3. Alignment of this information with corporate targets, i.e. conversion of this information into corporate knowledge
4. Integration of that knowledge into existing, repeatable business process.

PHT95C82Y63H

Category Management Report Tablet’ Brands Word of Mouth Assessment (July 1, 2011)

This information is based on analysis of 6,413 customer reviews published online on or before July 1, 2011 on popular websites like Amazon, Best Buy and Cnet.com.

Only customer’s generated content (Customer Word of Mouth) is analyzed. Consumers’ opinions, without ownership reference, are not part of this online marketing research. The customer generated content was located, authenticated, de-duped and aggregated for the analysis.

There is significant difference in volume of customer feedback available for online marketing research of various brands as illustrated on the chart below.

Changes in Customer perceptions over time

HP TouchPad Tablet was introduced just a few days ago with an enthusiastic number of reviews and remarkably high Customer Satisfaction score. However it is not appearing on the Trending charts above because there is no sufficient history yet to plot.

Trend – It appears that the tablets with proprietary operating systems outperform Android counterparts, in terms of Customer Satisfaction, as they come to the market. See the chart below.

Please follow the links to HP Touchdown, RIM PlayBook, and Motorola Xoom,  verbatim if you want to read what the customers say about their experiences.

For more detailed analysis, please request Customer Intelligence Analysis for specific segment of this category.

It appears Digital Media receivers keep on selling well and more consumers are considering to cut off the cable for their entertainment needs. We have published results of Voice of Customer analysis six months ago and it is still one of the most visited posts on this blog. The comments are also keep coming, and the one sent yesterday caused me to write this update.

This time we used Opinion Miner® software to discover:

• WHAT attributes of their customer experience are important – based on the stories and reviews these customers published on-line;
• HOW important are these attributes to them – based on the percentage of opinions expressed about an attribute compared to total opinions expressed;
• MEASUREMENTS of a difference between customers expectations and their experience for each attribute. It is expressed in a two points scale from “0″ (unacceptable) to “2″ (delighted) with “1″ that can be interpreted as 100% satisfied (expectation=experience).

We selected the following DMR’s, listed alphabetically, for this customer feedback analysis:

1. Apple TV 2010 (593 customer reviews)
2. D-Link Boxee Box (425 customer reviews)
3. Logitech Revue (367 customer reviews)
4. Roku XDS Streaming Streaming Player (1,186 customer reviews)

The number of opinions expressed by these products’ customer reviews does not match, and usually exceeds by a wide margin, the total number of customer reviews, as our software often extracts multiple opinions from a single customer story.

Keep in mind that no questions were asked about their experiences and no customer was ever contacted by us to solicit their opinions.  Surveys is not our business!

Our customer feedback analysis shows that Reliability is the most important attribute of customer experience for Digital Media Receivers, as 16.79% of all opinions expressed were focused on it. Unfortunately Boxee Box disappointed substantial number of their customers by shipping defective units, connectivity problems and firmware related stability issues. The details are available on request free of charge*. Reliability problems often put pressure on Support organizations and the D-Link customer support experience have also earned negative ratings from their customers. Apple TV and Roku reviews have generated below expectations score as well for the Support with comments like these

The CustomerSpeak! sample is from Roku reviews

Usability is the second most important attribute of customer experience with 10.96% of all opinions expressed. All analyzed products delighted their customers with their usability experience.

Read the rest of this entry »

Last week we focused at customers’ perception of Operating System for tablets they purchased. These metrics are extracted from 1,352 customer generated content pieces published on-line  on or before June 15th, 2011 using Opinion Miner software.

The difference between customer expectations and their experience is measured from 0 to 2, where 1 represent a point of experience matches expectations and can be interpreted as 1=100% satisfaction.

The importance indicates a percentage of opinions about this Attribute weighted against the sum of all opinions expressed about the analized set of products. Considering the ratio of customer reviews published on-line against the number of units sold, any Attribute that carries importance over 1% may be experienced by tens of thousands of customers.

— CustomerSpeak! —

Android customers are also quite happy with their purchasing decisions depending on the version supplied with their tablet, while iOS do not have anything specific to say on the subject.

I am honored to present this webinar sponsored by Grandview Product Management community on June 22nd, 2011.

There is a heated debate in a Product Management community about the Role of Market Research in creation of innovative products and I have mused on this subject earlier on this blog.

Product managers, who subscribe to a “thought leadership” (as oppose to “customer participation”) model, love to quote Henry Ford who supposedly said – “If I asked my customers what they want, they simply would have said a faster horse.”  The “customer driven innovation” camp proponents are swearing by Customer Feedback and Voice of Customer based methodologies. However there is no clear evidence that either site consistently out-innovate their opponents.

During this webinar we will explore and analyze traditional methods of product definition process, their limitations and their applications that often lead to incremental improvements as oppose to true innovation. We will talk about

• What separate a successful product from INNOVATIVE product
• What are differences between a Product Manager and a Star Product Manager , and
• How the knowledge of the market helps to close the gaps between the two.

Please click on this link to register

The tablets market segment is fun to watch. While there is no doubt that Apple “owns” the segment it is interesting to note that it has the lowest satisfaction score compared to the competition.

Given the enthusiasm of Apple fans and popularity of the original iPad, I wonder if the bar was set too high for many iPad 2 purchasers. Digging deeper into the details of Customer Experiences we can see that a lot of negative comments are focused on quality of the camera embedded into the tablet.

Indeed the “focused” listening provides specific metrics that show difference between customer expectations and their actual experience with this attribute of Customer Experience.

The analysis shows that Blackberry Playbook is a clear leader when it comes to Customer Experience with picture quality. Considering widely held belief (which I do not share) that Apple does not do market research it would be interesting to see if they address the camera/picture quality issue in the next edition of this popular product.

We used Opinion Miner® software to analyze 1,103 customer generated reviews, published online before May, 29 2011, of the tablets listed above to generate these findings. The scores are calculated to the two point scale from 0 (unacceptable) to 2 (delighted) with 1=100% satisfied (i.e. experience matches expectations).