headertext headertext promolink

Posts tagged with ‘Feedback’

Market Segmentation from Customer Perspective

Opinion Mining

This article was originally published at CustomerThink.com and being re-posted with some updates and modifications.

Marketers used market segmentation methods for a very long time. However, as our abilities to collect and manage information continues to improve, the new methods of segmentation become available to enable more targeted marketing efforts for marketers and better products and services for consumers. One of the most commonly accepted strategies utilized is demographic segmentation based on an assumption that a specific group (based on age, gender, etc) is a primary consumer of your product or service. Sometimes this assumption is based on the product purchase history. Regardless of the validity of an assumption, it does not often provide an insight on “WHY” this demographic segment would select the product in question or “HOW” they would use it. In other words, there is a lot of guessing that has to take place or additional segmentation strategies to be deployed. In my opinion, the popularity of demographic strategy lay mostly in its low cost and ease of access as behavioral and psychographic segmentation requires a lot of research that translates into high cost and time-to-market constraints.

The advances in technology start to offer new opportunities for market segmentation based on automated analysis of customer-generated content which is becoming available with the proliferation of social media and the rise of Social Consumer. Essentially instead of assuming what demographic group would be the ideal target for our marketing efforts, we could look at a group that already expressed their interest by purchasing specific types of products or services and learn “WHAT” elements of their experience were important to them.

Joel Rubinson, one of my favorite authorities in the field,  posted this on Google+as I review materials for the NYU social media class I am about to teach, I believe that Facebook will lead to the end of demographic targeting for media. Of course, content consumption and sharing behavior also enable this but Facebook will be the catalyst. Why not target on interests and actions? Thoughts?”

Most companies of any size use online survey techniques in an attempt to engage their customers, but the method does not support discovery of customer perspective; it validates assumptions of the company based on questions posed and deemed important. Again, the primary driver of survey method popularity is not the quality of the output and ability to provide better market intelligence, but the cost of implementation. I would suggest there are better alternatives today to learn unbiased market segment knowledge in applications of Opinion Mining technology to unsolicited customer-generated content.

The Opinion Mining approach offers much better quality of market segment intelligence and often rivals Survey approach in terms of implementation complexity and cost. I would like to offer an example to illustrate my point. Let’s look at tablets market segment defined by a few popular products in this category; however, non-like products that compete for the same wallet share can be used to get valuable insights:

  • Apple iPad2 (666 customer “stories”)
  • Blackberry Playbook (255)
  • HP TouchPad (650)
  • Motorola Xoom (576)
  • Samsung Galaxy Tab 10.1 inch and (502)
  • Toshiba Thrive (433)

These products were selected based on their popularity that manifested itself in a number of their customer-generated content references available online in a form of customer reviews, forum comments or social networks product page messages.

The first level of Customer Intelligence gained by Opinion Mining of this customer content is a list of customer experience attributes, sorted by their importance. The importance is measured as a percentage of total number of unsolicited opinions expressed by the customers. This answers the questions – WHAT is important to the customers and HOW important that is.

Attribute

Importance

usability

12.02%

reliability

10.28%

quality of construction

8.92%

display

6.21%

specifications

3.58%

portability

3.49%

audio quality

3.08%

price/value

2.64%

applications

2.18%

battery

2.17%

video and camera

1.73%

customer support

1.53%

performance

1.51%

operating system

1.29%

web experience

0.87%

flash

0.86%

connectivity

0.27%

build quality

0.24%

screen resolution

0.2%

replaceable battery

0.19%

color quality

0.15%

 

The next level allows the measuring of the difference between customer expectations and their experience and measures HOW well the customers’ needs are met. We use a two-point scale to visualize that difference (0=unacceptable, 1=experience meets expectations, 2=delighted); however, the measurements can easily be converted to any scale of choice without losing their meaning or accuracy. The chart below focuses on the top four attributes of customer experience by their importance to illustrate the approach.

There are practical implications of these measurements as they reflect on marcom messaging that have created customer expectations the product needs to meet. In the example above, most of the products exceeded the expectations of their customers in attributes most important to them by a significant margin. As an illustration, I would suggest that perhaps messaging about usability of these products could leverage customer sentiment to assure consumers who are hesitant to make a purchase and increase their products market adoption. That calls for a next level of intelligence that provides an answer to WHY customers feel this way and provide a context in which they express their opinions.

 

Above is a very small sample to illustrate the use of words and expressions (in square brackets) people to describe their opinions, and how they are attributed to a specific element of customer experience. These words, expressions ad even quotes can be used to fortify marketing messaging. Think of the very successful marketing campaign by Tempur-Pedic.

The flip side of the coin – early understanding of root causes of customer disappointment – can help to alleviate larger problems, turn the problem situation around or even present an opportunity for differentiation as illustrated below.

Looking deeper reveals a lot of unhappiness about compatibility:

And even deeper analysis will provide a context that is invaluable for taking an advantage of the opportunity (click on the image below to make it larger):

 

To sum it up – this type of market intelligence can be produced within a few hours at cost of a few hundred dollars without any installation, implementation or training investment which makes it difficult to ignore as an alternative or addition to survey and panels approach. As GPS technology thought us – multiplicity of signal sources results in better decision quality.

Customers view of Tablets-2011

This analysis is based on 30,670 customer reviews of 108 tablets published online by December 24th 2011.

To insure statistical representation and accuracy of results, we have focused on 18 tablets that were reviewed at least 100 times this year. That may mean that some tablets that were introduced toward the end of the year did not qualify for this report.

We have studied before the correlation between number of reviews published online and a number of units shipped, and therefore found it important to use it for comparison.

The most customer-reviewed tablet of 2011 are Amazon Kindle Fire (3,572), Apple iPad 1 and 2 (2,302 combined) and HP TouchPad (970).

Amazon Kindle Fire announcement dominated media and not surprisingly received a disproportional number of customer feedback after it was released.  It’s value proposition and content availability are highly anticipated to make long expected dent in iPad market supremacy. The number of reviews seem to predict that this is the case.

 

Even though Kindle Fire OS is build on the Android platform, it has sufficient proprietary layer to view it separately from a more common versions.

 

 

From the date of TouchPad introduction the WebOS customers were the most satisfied lot (1.39) and the uncertainty about its future does not seem to extinguish their enthusiasm. Apple iPad customers are very close behind at (1.35). It is interesting to note that iPad 2 version of iOS have substantially improved its overall average satisfaction score.

The Kindle Fire OS experience score falls 0.03 points behind the Android, which is well within the margin of error, while both somewhat exceeded their customers’ expectations.

Our Market Intelligence Analysis of the tablet segment indicates that the following attributes of customer experience are most important to them:

 

  1. Usability – 11.45% of all opinions expressed
  2. Reliability – 9.45% of all opinions expressed
  3. Price – 3.21% of all opinions expressed
  4. Screen – 2.89% of all opinions expressed
  5. Sound Quality – 2.52% of all opinions expressed
  6. Compact Size – 2.10% of all opinions expressed
  7. Screen Size – 1.70% of all opinions expressed
  8. Battery Life – 1.63% of all opinions expressed
  9. Customer Support – 1.40% of all opinions expressed
  10. Operating System – 0.95% of all opinions expressed

 

You can get more detailed explanation of Attributes and Importance by watching this short video.

 


In terms of overall satisfaction, Samsung Galaxy tablet (7″) has earned the top customer satisfaction rating (1.53) and Huawei Ideo 7 tablet (1.50) came within a statistical tie, while Archos 7 Home tablet (0.82) and Velocity Micro Cruz tablet (0.95) are on the very bottom of the list.

To get more specific insights into the dynamics of the tablet customer perceptions, we sampled a market segment by analyzing the most experienced (i.e., most reviewed) models representing different operating systems.

  1. Amazon Kindle Fire – 3,572 customers
  2. Apple iPad 2 – 999 customers
  3. RIM Blackberry Playbook – 281 customers
  4. HP TouchPad – 970 customers
  5. Motorola Xoom – 588 customers
  6. Samsung Galaxy Tab 10.1 inch – 615 customers

 

More details and customer feedback verbatim are available via access to the dynamic dashboard for this segment on request. Watch this video for navigation tips.

 

iPhone 4S knock customer satisfaction ratings out of the park

We finally got enough customer feedback to see the evidence that iPhone 4S substantially improved customer experience compared to iPhone 4 models. Apple resolved antenna issues completely and as the result significantly improved reception/signal clarity. Customers love new keyboard experience and their usability satisfaction ratings are exceedingly high. The results are based on Opinion Mining of 4,489 Apple iPhone customers published online.

Market Intelligence Analysis

The image above highlights the attributes of customer’s experience most important to them as they have articulated in their feedback. No keywords were used during the analysis to identify these attributes, and no questions were asked to influence the answers, as surveys are not our business or part of our opinion mining methodology. Click on the image to enlarge it.

Can Customer Feedback help to create innovative products??

I keep struggling with the definition of what is an innovative blockbuster product (or service), and this is yet another attempt: A truly innovative product is the one that delights its customers by anticipating their needs before they knew they have them. In other words, if you want to develop a blockbuster product, you should stop trying to better serve the existing needs of your customers and instead try to discover needs that customers may not realize they have and address them.

 

Traditionally, companies use customer feedback to assess satisfaction with existing products and to validate product developer’s ideas for the improvements. One of the most popular methods used for collecting customer feedback are survey and panels, where the questions asked or topics moderated tend to reflect interests of product development team and focus on how customers experience their product.

 

I would like to pose that truly innovative product developers use a different perspective to discover the needs customers cannot articulate in controlled or moderated environment – the perspective of holistic experience of a job the customer “hired” the product in question to do.

The journey starts with the understanding of what the “job” they want to do is and what a desirable outcome is. The next step is to imagine how this whole experience can be simplified in its entirety, which may or may not involve your product. I use the word “simplified” because it is an ultimate description of improvement in a context of “desirable outcome.” Terms we usually use to describe improvements – Better, Faster, Cheaper – are traps anchoring us to the incremental changes of status quo.

 

The complete customer experience starts with a notion that the desired outcome can be achieved, and goes through discovery of components required, acquisition of the components and/or materials and skills all the way through a process of applying them. Your product may be just one of many in that process, but if you can make it easier to find at the conception stage, simpler to understand that it is the best alternative to get the job done at the acquisition stage, and require less skill and/or effort to operate, that will make your product a lot more successful. However, truly innovative products do often have an element of disruption that does not easily fit into organizational structures. If you are a drill product manager, and survey satisfaction of a drill purchasers, the ideas of alternative wall anchoring to hung pictures will not likely come up. However, even if it does, how does it help you or your department?  I wonder if a celebrated genius of Steve Jobs could only manifest itself because he operated from above of organizational hierarchy.

 

The question is, “Can Customer Feedback help to create innovative products?” If you define Customer Feedback as the results of survey or other structured information-gathering method, the answer is NO. The best outcome of these exercises is reduced uncertainty about your assumptions (i.e., confirmation of what you already know). The probability of discovering an idea that could lead to the conceptualization of an innovative product is extremely low, but could be improved somewhat by allowing open-ended questions and a lot of unstructured comments.

 

I define Customer Feedback as any and all customer-generated content available about a product/service in any form customers chose to communicate it. That includes company and public forums, customer support notes and call transcripts, company sales notes, customer’s Facebook comments, and customer videos and reviews published online. The wider Customer Feedback “fishing” net is cast, the higher probability of innovative ideas discovery. Combine it with the right analysis methodology that does not tie you up with pre-conceived keywords and ontology, and your chances are looking even better.

Customers want us to listen more

online marketing researchThis morning, I had an interesting experience. Among many emails, tweets and webinar offerings, I managed to expose myself blindly to two that focused on one challenge I have to overcome the most – talking too much and listening too little. Interestingly enough, neither of the messages was specifically targeting individual or style shortcomings, and the subject line of these presentations was not about listening skills. If this is not a moment of serendipity, then I don’t know what is. BTW it also synch with my favorite definition of serendipity: “…is when you come to look for a needle in a stack of hay, and you end up finding a farmer’s daughter.”

 

The first piece of content is a video from http://www.entselling.com/ that talks about challenges of entrepreneurial selling and is not focused on the selling or listening style at all. It is very good and I strongly recommend it to any startup team, but the listening piece resonated with me the most. I’ve been trained on the importance of this skill for selling many years ago, and judging by my performance at the time, I have even learned to apply it. However, as it may be obvious to people who know me, it is not one of my natural qualities :) . The more I get excited about the subject of conversation, the less patient I get with listening to my conversation partners, particularly if I think I already figured out what they are trying to communicate.

 

I may be right about that, but it doesn’t create a great conversation experience, nor does it make them feel that they have been heard and that I actually do understand their concerns or problems I am proposing to address with my product or service. Apparently, it is a very common problem undermining many startup founders who are understandably excited about their creations to a detriment of their potential customers’ comfort, and subsequently a sales success. Maybe I should start looking for a startup founders “shut up and listen” support group. Please let me know if such a group exists.

 

The second piece is even more interesting and was presented by Rebel Brown at the Defy Gravity webinar sponsored by TreeHouseInteractive. Rebel is a very dynamic and passionate speaker, and she was talking about many marketers trying to use social media as traditional content broadcasting channel. The main lesson I took out of this presentation is about a challenge of institutionalized listening that needs to become a part of personalized conversation if a brand wants to be successful in social media. I suppose that no brand will be able to survive without social engagement with their customers, as the customers are creators of a brand.

 

“Advertising can help you sell good products, but only your customers can help you build a great Brand!”

 

The challenge is in learning what is important to your customers and communicating with them about this, as opposed to focusing on your product or your brand. I think the most difficult part is to not assume that we already know what it is, and not be afraid to learn from these communications.

 

Rebel also made a great point about the practice of counting followers and “likes” as a result of social media efforts. I will paraphrase it here as, “Do not confuse tactical metrics with actual meaningful results.” Let’s face it – these only exist because they are easy to count. Their relevance to business outcomes is very questionable, and the only thing they help to learn is how to manipulate or game the counting mechanisms.

 

I don’t think a “real” marketer can be helped by a mere support group or volunteer 12-step program. Perhaps there is an opportunity for a true “rehab.” All you need is a recovering marketing celebrity lending their name to this venture.

3 Reasons why Surveys may harm your business

   For those of us who are deeply involved with online marketing research, it may appear that the proliferation of Voice of the Customer (VoC) programs is exploding these days. However, recent Forrester’s research found that 56% of the executives they surveyed were not aware of any formal VoC program in their companies. One of potential explanations to this discrepancy may be the fact that many companies conduct localized, departmental initiatives that are not visible to the rest of the organization.

Indeed, an amount of online surveys I am bombarded every day is staggering. It seems that people who designed every website I stop by want to know my opinion… even before I had any time to form one. Availability of inexpensive and easy-to-use technology for conducting online surveys is not a good excuse for harassing your site’s visitors to collect “short” and “easy” response to the closed-ended questions structured on a scale of 1 to 5.

There are 3 reasons why an inadequately administered survey is harmful to your business:

  • Popup surveys reduce visitor engagement with a site, and therefore promote high bounce rate.

Many people commenting about their site user experience are complaining about the timing of these interruptions and their inability to respond to posed questions at a time they are being posed. Timing the request to allow a customer to experience your product or service would provide more meaningful reaction and responses.

  •  Questions that do not align with customer’s experience and perspective do alienate the customers.

The closed-ended questions you pose to your customers may be very important to you and your company. However, if answering them does not provide any value to the responder, why would they want to waste their time? It is much better to provide generous space for comments and reflections of their experience from their perspective, and let them tell you what elements of this experience are important to them. Make it easy for them to say what they want to, not what you want to hear. They are not in the business of validating your assumptions.

  • Customer Feedback that does not result in action is a waste of time – yours and your customer’s.

A disconnect between cause and effect explains low participation of voters in a political process. Customers want to help you improve your product or service and will provide you with clues to how to do it, if you “listen”. There are tools available for automated processing of unstructured customer comments and reviews that are called Opinion Mining platforms. Use them to help you discover the insights into their experience. You can get results within 24 hours. Let the customers know that their efforts are not wasted. Communicate back what you have learned from them and what actions you plan to take in an effort to improve their experience.

 

 

 

 

Word of Mouth (WOM) analysis of popular Tablet brands

This online market research, administered by Amplified Analytics, is valid as of August 5, 2011 and is the result of the review of different tablet brands’ segment of the market. It is based on the analysis of customer feedback from 8,241 tablet users who expressed their sentiments on the product.


The chart above depicts the Word of Mouth (WOM) Share for ten of the top tablet brands in terms of customer satisfaction (CSI).

The chart above illustrates shows customer satisfaction with Operating System of their respective Tablet.

The scores were algorithmically produced by the use of Opinion Mining software that conducts an analysis of customer feedback that is published online by the customers themselves; no customer was personally contacted to provide their opinions.  The relative percentages were not based on customer’s answers to biased survey questions. It is not Amplified Analytics’ business to conduct surveys.

It is also important to note that the Apple iPad2 was excluded from the list of tablet brands analyzed because it significantly dominates the market, thus making the comparison of customer satisfaction meaningless. The Apple brand seems to have its own market that is incomparable to others.

The chart below shows a comparison of specific attributes (reliability, portability, display, etc) of leading tablets. These attributes came from the customers when they shared their experience using the brands. The green line athwart denotes the relative importance of each attribute to customers. Check the methodology used in this link: Opinion Mining. Attributes with less than 1% importance were not included in the graph.

 


From the graph, we can see that Reliability is the most important attribute, with 11.7% of total opinions.

Yet, customers of Samsung Galaxy continue to get disappointed for the second month of measuring it since it was first introduced. Its Customer Support, with an importance rating of 1.76%, exceeds customer expectations by 8% while the Display attribute, with a 7.42% score, is on top of the competition.

You can access this dynamic Customer Intelligence dashboard by clicking on this link and CustomerSay! Verbatim by clicking on a specific bar of this chart. “Attributes” and “Products” selection windows allow for focus on your area of interest.

 

Customer Experience Management and Opinion Mining of Social Media

Social media monitoring quickly becomes a “commodity” with hundreds of companies’ rummaging through fire hose streams of communications published, re-published and re-tweeted every second of a day. Brands want to know what people think about them and are prepared to pay for this knowledge. But why is this so? What is the value of knowing that people communicate a positive sentiment about your brand today?

I would speculate that most companies make this investment without specific strategy or process on hand, and some companies do it to manage the reputation of their brands or in other words, to do PR damage control and risk mitigation. A very few do so to systematically improve their customers’ experience.

Most of Social Media chatter has relatively low value for opinion mining efforts, which need to be given attention if you want to extract actionable knowledge for systematic change.

Furthermore, it is important to understand the differences between the types of communications that use Social Media channels:

  • People often refer to Word of Mouth (WOM) in Social Media as a buzz and focus too much on technology at the expense of the appropriate targets, actions and measurements.
  • The Voice of the Customer (VOC) is a subset of WOM that can be directly attributed to the customers of your product. It is very similar and as valuable as, if not more valuable than, customer feedback collected by many companies through their “walled garden” channels at a great expense.

The opinion mining operation that is focused on the Voice of the Customer “ore” delivers significantly higher yield compared to the overall Social Media buzz in terms of actionable knowledge. It is possible because it provides a very close correlation to specific products and often describes holistic customer experience with these products. I refer to “holistic customer experience” in the context of the customer’s effort required to achieve a desired outcome. An example of a desirable outcome is a new roof for the house or a quality audio experience while exercising in a gym.

We consider all steps – from the initial purchase research to the selection, purchase, delivery and setup, and to a completed realization of the desired outcome – measure it as a difference between the customer’s expectations and their perception of reality (their actual experience). Examples of VOC “ore” include—in ascending order—customer forums, blogs and customer reviews published online.

Recent Forrester’s research found that 14% of executives surveyed said that their companies don’t solicit customer feedback at all, while 56% of the respondents said—or were not sure if—their companies do not have a formal VOC program. However, the most shocking finding is that nearly one out of every four executives said that they seldom or never use customer feedback to change a business process (source: http://www.mediapost.com/publications/?fa=Articles.showArticle&art_aid=142811).

The Temkin Group research identified it as the one of Top 10 Customer Experience Incompetencies, as shown in the table on the left.

There is a good reason why so many companies find it difficult to mine Social Media for improving customer experience:  most content generated by customers is unusable by corporate information systems that are built to process structured data.

 

The following steps have to be taken to address the big challenge of translating seemingly anecdotal evidence into a scalable, corporate process:

  1. Aggregation, capture, cleansing and authentication of Voice of Customer data
  2. Conversion of this data into structured information
  3. Alignment of this information with corporate targets, i.e. conversion of this information into corporate knowledge
  4. Integration of that knowledge into existing, repeatable business process.

voice of customer feedback analysisPHT95C82Y63H

 

How to murder innovation by Focus Group

I am sure it is not just my experience, but it seem that nothing kills innovation quicker than the search for consensus.

The human mind treats a new idea the same way the body treats a strange protein; it rejects it. – P. B. Medawar

I absolutely love this video.

We do not see things as they are, we see things as we are – The Talmud

Musing on Voice of Customer and Word of Mouth Marketing

I was reading a post by Bruce Temkin about power of the VOC (Voice of Customer)

It turns out that more than half of the large companies had a formal VoC program in place. And when we asked about the results, the data was amazing — 83% of companies reported that they had positive results from those efforts.

I am surprised and encouraged that large companies are so interested and invested in this large and not very clearly defined area of a Customer Experience Management. Mostly I am surprised to learn that these companies claim they are actually act on their findings. I am not challenging Bruce’s findings, I just would like to see it as a consumer more often.

Meanwhile I would like to muse on one of my favorite subject – how to make your customers to market your products – i.e. Word of Mouth Marketing.  The WOM became an important part of VOC enterprise strategy as social media enabled consumers to become much more influential than we used to be. However WOM is the original form of advertising and it played an important role in every day life on issues of much more importance than selection of a product purchase or store preference for millennium. People have, and still do, share information about our experiences with each other across dinner tables, camp fires or customer reviews websites because WOM is much more relevant to an individual needs, concerns or desires than a broad advertising messaging addressed to the market place. Marketers try to improve relevancy of the advertising through segmentation, but their assumptions and biases limit effectiveness of their messages, while WOM is ultimately more effective as its recipients control the message they decide to accept or trust, and then reinforce it by sharing their own experience.

I would like to quote a LinkedIn discussion tread here:

People decide intellectually but buy emotionally. Selling based on features and benefits won’t close the sale for the customer, but emotional messages from WOM (“This product is great because it met this need for me”) will do it. All people make decisions intellectually but will buy emotionally – particularly if the purchase resolves a ” pain “for them as recommended WOM

37 years of being in the brand building business has made me realise that the CONSUMER IS THE MEDIUM. Sumit Roy

Here are few more quotes from the same conversation

1- CONSUMER is MEDIUM – implies there are great opportunities to tap into for better and faster business results. The medium, which is in the process of being discovered and integrated into strategies and business models.

2- WOM is AMPLIFIER, i.e. ADs x WOM – implies that WOM can be that multiplier improving the result beyond your “traditional” mediums diminishing returns curve. In fact, WOM is the enabler to make that curve steeper (you get more with every additional dollar invested) and higher (you can enjoy that for longer than usual).

However this is my favorite – “Trust is what helps social intercourse breed healthy brands”. My deepest thanks to everyone who contributed to that discussion.