We have recently created  our new Google+ page to publish regular updates of Customer Intelligence Analysis and Market Intelligence Analysis reports for specific products and market segments contained in our data base. These reports are the samples we produce for our own research and training of our Opinion Mining software and based on the analysis of the data subsets, which may or may not be statistically representative of all Customer Generated Content (CGC) available online. The reports will be published a few times per week as long as there is sufficient interest, i.e. visitors who have Amplified Analytics in their circles.

Please visit Amplified Analytics Google+ page, join Google+ if you are not yet on it, and include it into your circle to get updates every time new content is published.

This analysis of customer reviews for Kindle Fire vs Asus Transformer Prime shows the attributes of customer experience that are the most important to the customers and how their experience meets their expectations. Click on the image of dashboard to make it larger.

This article was originally published at CustomerThink.com and being re-posted with some updates and modifications.

Marketers used market segmentation methods for a very long time. However, as our abilities to collect and manage information continues to improve, the new methods of segmentation become available to enable more targeted marketing efforts for marketers and better products and services for consumers. One of the most commonly accepted strategies utilized is demographic segmentation based on an assumption that a specific group (based on age, gender, etc) is a primary consumer of your product or service. Sometimes this assumption is based on the product purchase history. Regardless of the validity of an assumption, it does not often provide an insight on “WHY” this demographic segment would select the product in question or “HOW” they would use it. In other words, there is a lot of guessing that has to take place or additional segmentation strategies to be deployed. In my opinion, the popularity of demographic strategy lay mostly in its low cost and ease of access as behavioral and psychographic segmentation requires a lot of research that translates into high cost and time-to-market constraints.

The advances in technology start to offer new opportunities for market segmentation based on automated analysis of customer-generated content which is becoming available with the proliferation of social media and the rise of Social Consumer. Essentially instead of assuming what demographic group would be the ideal target for our marketing efforts, we could look at a group that already expressed their interest by purchasing specific types of products or services and learn “WHAT” elements of their experience were important to them.

Joel Rubinson, one of my favorite authorities in the field,  posted this on Google+ ”as I review materials for the NYU social media class I am about to teach, I believe that Facebook will lead to the end of demographic targeting for media. Of course, content consumption and sharing behavior also enable this but Facebook will be the catalyst. Why not target on interests and actions? Thoughts?”

Most companies of any size use online survey techniques in an attempt to engage their customers, but the method does not support discovery of customer perspective; it validates assumptions of the company based on questions posed and deemed important. Again, the primary driver of survey method popularity is not the quality of the output and ability to provide better market intelligence, but the cost of implementation. I would suggest there are better alternatives today to learn unbiased market segment knowledge in applications of Opinion Mining technology to unsolicited customer-generated content.

The Opinion Mining approach offers much better quality of market segment intelligence and often rivals Survey approach in terms of implementation complexity and cost. I would like to offer an example to illustrate my point. Let’s look at tablets market segment defined by a few popular products in this category; however, non-like products that compete for the same wallet share can be used to get valuable insights:

• Apple iPad2 (666 customer “stories”)
• Blackberry Playbook (255)
• HP TouchPad (650)
• Motorola Xoom (576)
• Samsung Galaxy Tab 10.1 inch and (502)
• Toshiba Thrive (433)

These products were selected based on their popularity that manifested itself in a number of their customer-generated content references available online in a form of customer reviews, forum comments or social networks product page messages.

The first level of Customer Intelligence gained by Opinion Mining of this customer content is a list of customer experience attributes, sorted by their importance. The importance is measured as a percentage of total number of unsolicited opinions expressed by the customers. This answers the questions – WHAT is important to the customers and HOW important that is.

The next level allows the measuring of the difference between customer expectations and their experience and measures HOW well the customers’ needs are met. We use a two-point scale to visualize that difference (0=unacceptable, 1=experience meets expectations, 2=delighted); however, the measurements can easily be converted to any scale of choice without losing their meaning or accuracy. The chart below focuses on the top four attributes of customer experience by their importance to illustrate the approach.

There are practical implications of these measurements as they reflect on marcom messaging that have created customer expectations the product needs to meet. In the example above, most of the products exceeded the expectations of their customers in attributes most important to them by a significant margin. As an illustration, I would suggest that perhaps messaging about usability of these products could leverage customer sentiment to assure consumers who are hesitant to make a purchase and increase their products market adoption. That calls for a next level of intelligence that provides an answer to WHY customers feel this way and provide a context in which they express their opinions.

Above is a very small sample to illustrate the use of words and expressions (in square brackets) people to describe their opinions, and how they are attributed to a specific element of customer experience. These words, expressions ad even quotes can be used to fortify marketing messaging. Think of the very successful marketing campaign by Tempur-Pedic.

The flip side of the coin – early understanding of root causes of customer disappointment – can help to alleviate larger problems, turn the problem situation around or even present an opportunity for differentiation as illustrated below.

Looking deeper reveals a lot of unhappiness about compatibility:

And even deeper analysis will provide a context that is invaluable for taking an advantage of the opportunity (click on the image below to make it larger):

To sum it up – this type of market intelligence can be produced within a few hours at cost of a few hundred dollars without any installation, implementation or training investment which makes it difficult to ignore as an alternative or addition to survey and panels approach. As GPS technology thought us – multiplicity of signal sources results in better decision quality.

The Kindle seem to make a lot of its customers quite happy and they keep publishing their reviews in the record numbers – over 115 per day, every day since Amazon started its shipping. If this flood continues, it will outsell the current Tablet segment champion – iPad 2, our research shows that a number of customer reviews correlates to a number of units sold.

Below is the chart from a Market Intelligence Analysis dashboard that compares the two contenders by satisfaction with attributes of customer experience that are important to the customers. Click on the image to make it larger.

You can find explanation of Attributes concept in this short video

We are proud to announce the a new release of Opinion Mining software is now available to our customers and registered users. The release includes the following functions, features and enhancements:

• New format of Customer Intelligence analysis report along with short videos to help quick adoption

• New pages on our website describing how our customers using Customer Feedback Analysis to outsell their competition.

• New Trending report

I would like to thank our customers who provided valuable feedback that helped us develop these new capabilities.

I keep struggling with the definition of what is an innovative blockbuster product (or service), and this is yet another attempt: A truly innovative product is the one that delights its customers by anticipating their needs before they knew they have them. In other words, if you want to develop a blockbuster product, you should stop trying to better serve the existing needs of your customers and instead try to discover needs that customers may not realize they have and address them.

Traditionally, companies use customer feedback to assess satisfaction with existing products and to validate product developer’s ideas for the improvements. One of the most popular methods used for collecting customer feedback are survey and panels, where the questions asked or topics moderated tend to reflect interests of product development team and focus on how customers experience their product.

I would like to pose that truly innovative product developers use a different perspective to discover the needs customers cannot articulate in controlled or moderated environment – the perspective of holistic experience of a job the customer “hired” the product in question to do.

The journey starts with the understanding of what the “job” they want to do is and what a desirable outcome is. The next step is to imagine how this whole experience can be simplified in its entirety, which may or may not involve your product. I use the word “simplified” because it is an ultimate description of improvement in a context of “desirable outcome.” Terms we usually use to describe improvements – Better, Faster, Cheaper – are traps anchoring us to the incremental changes of status quo.

The complete customer experience starts with a notion that the desired outcome can be achieved, and goes through discovery of components required, acquisition of the components and/or materials and skills all the way through a process of applying them. Your product may be just one of many in that process, but if you can make it easier to find at the conception stage, simpler to understand that it is the best alternative to get the job done at the acquisition stage, and require less skill and/or effort to operate, that will make your product a lot more successful. However, truly innovative products do often have an element of disruption that does not easily fit into organizational structures. If you are a drill product manager, and survey satisfaction of a drill purchasers, the ideas of alternative wall anchoring to hung pictures will not likely come up. However, even if it does, how does it help you or your department?  I wonder if a celebrated genius of Steve Jobs could only manifest itself because he operated from above of organizational hierarchy.

The question is, “Can Customer Feedback help to create innovative products?” If you define Customer Feedback as the results of survey or other structured information-gathering method, the answer is NO. The best outcome of these exercises is reduced uncertainty about your assumptions (i.e., confirmation of what you already know). The probability of discovering an idea that could lead to the conceptualization of an innovative product is extremely low, but could be improved somewhat by allowing open-ended questions and a lot of unstructured comments.

I define Customer Feedback as any and all customer-generated content available about a product/service in any form customers chose to communicate it. That includes company and public forums, customer support notes and call transcripts, company sales notes, customer’s Facebook comments, and customer videos and reviews published online. The wider Customer Feedback “fishing” net is cast, the higher probability of innovative ideas discovery. Combine it with the right analysis methodology that does not tie you up with pre-conceived keywords and ontology, and your chances are looking even better.

This is a new analysis of customer feedback, which is available online, about their smart phones. At this time we are tracking and analyzing comments from 37,110 customers on 136 mobile smart phones. I decided to filter out the phones which were not updated with new customer comments during the last 30 days to insure that these phones are still available on the market. The resulting Product Reputation report is available at Market Intelligence.

I selected the most reviewed phones for each operating system to take a close look at what attributes are important to the smart phone customers. As customers keep posting their reviews and forum comments about their experience with the phones they chose,  Reliability remains the most important specific attribute that dominate the conversation as 15.22% of all opinions mined is focused on it.

Let’s face it, anybody who buys a smart phone and pays for the service expects to be able to use their phone every time they want to. Apple clearly outshines competition by exceeding customers’ expectations of Reliability by 10%. HTC-HD7 (Win7 OS “representative”) meets their customers’ expectations: however Android (HTC Thunderbolt), Symbian (NokiaN8) and RIM’s Blackberry Curve 9330 are a disappointment to customers who selected to purchase these phones.

Overall customers are satisfied with their decisions to various degrees, but Apple iPhone users are reporting that the phone exceeded their expectations by 42%. Not surprisingly they also are the most satisfied with the choice and quality of the Applications available to them, their Usability and Web Browsing Experience. Since I personally have never purchased an Apple product, nobody can accuse me in the Apple bias: however this phone has earned a remarkable reputation by managing not to disappoint its user in a single attribute of customer experience.

Nokia N8 leads customer satisfaction in Battery Life, exceeding expectations by 14%, Call Quality, Music Player experience, Sound and Video Quality. However, it also disappoints their customers where it really counts – poor Customer Support, inadequate Keyboard, Operating System experience and Web Browsing.

Below is the list of top 19 Customer Experience Attributes by their importance to the customers as they opined in their comments and reviews. Our methodology does not utilize surveys, focus groups, panels or other forms of leading questions/bias forming market research tools. I have filtered out any Attribute with importance below 0.35% that may be very valuable for Product Marketing analysis, but not very meaningful for general consumption. The complete list is available on request:

1. General Satisfaction (~CSI) – 16.96%
2. Reliability – 15.22%
3. Usability – 8.97%
4. Battery Life – 5.42%
5. Screen/Display experience – 4.44%
6. Call Quality – 3.78%
7. Customer Support – 3.39%
8. Style/Design – 3.19%
9. Picture Quality – 1.94%
10. Feature Set – 1.92

The selection of phones for the comparative analysis would vary based on criteria important to a person who conducts the research – I wanted to compare a single representative phone per operating system and you may want to find the best Android phone for example. The Attributes and their importance may vary based on such choice as customers “conversations” could yield substantially different results.

Last week, the announcement of Amazon Fire line of products created a sizable splash in social media, Consumer Electronics, business and IT publications. While this new device does not have specs of a tablet, most observers immediately started to pin it against iPad. Is it a fair comparison? The answer to this question depends on your definition of what a product is. If you define a product by its functions and features, the answer may be – No. However, if your understanding of a product agrees with Clay Christensen’s definition as the “jobs-to-be-done,” the iPad and Fire will most definitely compete for the same share of consumer wallet, as most customers of these devices use them for web browsing/entertainment most of the time.

Since the Amazon Fire is not yet shipping to the customers, I would like to offer a comparison between Amazon Kindle and Apple iPad 2 from the perspective of their customers. Online marketing research produced this analysis of 7,706 customers feedback published in social media.

The image above highlights the attributes of customer’s experience most important to them as they have articulated in their feedback. No keywords were used during the analysis to identify these attributes, and no questions were asked to influence the answers, as surveys are not our business or part of our opinion mining methodology.

You can click on this link to access the dynamic dashboard and verbatim (by clicking on a specific bar).

Given such a high perception of value users of relatively primitive but extremely functional Kindle give to their experience, the Fire is poised to make a sizable bite out of current iPad tablet growth prospects.

Tablet’ Market Segment update

The last month was full of action if you follow the tablets market segment. HP first started the price discounting to “gain market share” and then dropped the “bomb” of discontinuing the TouchPad they introduced only 42 days before. The judgment is still out whether we witnessed results of really agile decision making or an example of exceptionally bad corporate self-distraction. The initial stock market reaction seems to support the latter hypothesis, and current history of HP boardroom soap opera episodes provides enough clues. The new CEO apparently wants the company out of consumer products businesses.

There is an update – It appears the decision produced a shark bait effect and caused a number of class action suites on behalf of shareholders.

In this installment of online market research update, I would like to explain the process we follow to generate these reports.

We start at the Product Reputation screen and enter name/model of a tablet and click the “Submit” button. When the metrics for the entered tablet show up on the right side of the screen, we click on the “Compare with other products” button to expose all tablets in our database.

At this date, we monitor customer generated content for 32 tablets and the Market Intelligence report will show their reputation which is calculated by processing the text of customer reviews with our opinion mining software. Keep in mind that no questions were asked about their experiences and no customer was ever contacted by us to solicit their opinions. Surveys are not our business!

We use the “Customize your report” button to select only the tablets that were updated (new customer reviews were published online) within the last 30 days and have greater than 25 customer reviews published. The total number of reviews analyzed is 9,003. The result of the customization is displayed below. Please note that the metrics are calculated on all aggregated reviews published by the customers from the time a tablet became available for purchase.

We export the CSV file and generate WoM (Word of Mouth) Share chart and Trend based on the exported data. Not surprisingly, Apple iPad earns the largest share of customer feedback at 17%, although the number is much smaller than its market share and substantially dropped from 35% only two months ago.

To discover what attributes of their customers’ experience are important, to measure how important these attributes are to the customers, and what the difference between their expectations and their experiences with each attribute is, we focus on five of the most reviewed tablets for a more detailed Customer Intelligence Analysis.

We use a two-point scale to visualize that difference.

0=unacceptable / 1=experience meets expectations / 2=delighted

Customers “say” that Usability (11.64%), Reliability (11.32%), Quality of Construction (9.5%) and Display (5.4%) are the most important attributes of their experience with the tablets. While all participants are providing Usability experience well above their customer’s expectations, HP TouchPad and Apple iPad 2 are the leaders in this category. Motorola and Toshiba are considered the most “reliable” tablets by their customers, while Samsung Tab continues to struggle.

Here is the access to the tablets’ online marketing research dashboard that allows to see actual customer’s feedback if you click on a specific bar.

The last chart I would like to offer depicts customer affinity for tablet’s operating system and despite all brouhaha about the TouchPad, WebOS still earns the highest score from its customers.

   For those of us who are deeply involved with online marketing research, it may appear that the proliferation of Voice of the Customer (VoC) programs is exploding these days. However, recent Forrester’s research found that 56% of the executives they surveyed were not aware of any formal VoC program in their companies. One of potential explanations to this discrepancy may be the fact that many companies conduct localized, departmental initiatives that are not visible to the rest of the organization.

Indeed, an amount of online surveys I am bombarded every day is staggering. It seems that people who designed every website I stop by want to know my opinion… even before I had any time to form one. Availability of inexpensive and easy-to-use technology for conducting online surveys is not a good excuse for harassing your site’s visitors to collect “short” and “easy” response to the closed-ended questions structured on a scale of 1 to 5.

There are 3 reasons why an inadequately administered survey is harmful to your business:

• Popup surveys reduce visitor engagement with a site, and therefore promote high bounce rate.

Many people commenting about their site user experience are complaining about the timing of these interruptions and their inability to respond to posed questions at a time they are being posed. Timing the request to allow a customer to experience your product or service would provide more meaningful reaction and responses.

•  Questions that do not align with customer’s experience and perspective do alienate the customers.

The closed-ended questions you pose to your customers may be very important to you and your company. However, if answering them does not provide any value to the responder, why would they want to waste their time? It is much better to provide generous space for comments and reflections of their experience from their perspective, and let them tell you what elements of this experience are important to them. Make it easy for them to say what they want to, not what you want to hear. They are not in the business of validating your assumptions.

• Customer Feedback that does not result in action is a waste of time – yours and your customer’s.

A disconnect between cause and effect explains low participation of voters in a political process. Customers want to help you improve your product or service and will provide you with clues to how to do it, if you “listen”. There are tools available for automated processing of unstructured customer comments and reviews that are called Opinion Mining platforms. Use them to help you discover the insights into their experience. You can get results within 24 hours. Let the customers know that their efforts are not wasted. Communicate back what you have learned from them and what actions you plan to take in an effort to improve their experience.