logo

Who Dissed Who? Xiaomi vs Huawei Honor - A Comparative Study Based on 100,000 E-Commerce Product Reviews

The editor recently heard that Xiaomi and Honor, two competing internet smartphone brands, dissed each other in a round and have created a lot of buzz on online media. The editor is curious, whose phones are actually better? This is a difficult question to answer. Look at reviews? They are often biased paid articles. Sample the opinions of people around you? The sample size is too small to be scientific. The editor found an earth-shattering method, directly using massive amounts of e-commerce reviews for statistics. Although there are fabricated reviews on every platform, generally speaking, these fake reviews occur in the early stages of product release. Once the volume of reviews increases, the faked ones basically drown out as noise.

The editor exported 1.6 million product review texts from JD.com for December 2018, which belong to both Honor and Xiaomi brands (try brushing up a million reviews yourself), and combined with the AI technology of our tech guys, conducted Aspect extraction and sentiment analysis on a random sample of 100,000 review texts. This study does not differentiate between models, only analyzing the overall brand evaluation.

After being tagged by AI, the aspects and sentiments generally look like the following (only 10 entries are excerpted as examples). Subsequently, the editor conducts a comparative analysis of this 100,000-entry dataset.

Out[100]: .dataframe tbody tr th:only-of-type { vertical-align: middle; } .dataframe tbody tr th { vertical-align: top; } .dataframe thead th { text-align: right; }
Input.bid Input.sku_id Input.text Prop2 Tag
135438 8557 100001009366 Huawei is a big brand, its Honor sub-brand seems to have a better cost-performance ratio, hoping it continues to be good as always Cost-performance Cost-performance(positive)
135442 18374 7437788 Quick response, clear photos, good signal, cheap price Speed Speed(positive)
135443 18374 7437788 Quick response, clear photos, good signal, cheap price Photography Photography(positive)
135445 18374 7437788 Quick response, clear photos, good signal, cheap price Price Price(positive)
135448 18374 8443344 The feel in the hand is okay, quite satisfied! Hand-feel Hand-feel(positive)
135453 8557 7081550 Bought it for mom, it's enough for her, the appearance is also okay Appearance Appearance(positive)
135456 8557 5821455 The phone is okay, the screen is very average and a bit harsh on the eyes, the eye-protection mode under a warm background has obvious yellow trailing, photography is just so-so, the rest is fine! Screen Screen(negative)
135457 8557 5821455 The phone is okay, the screen is very average and a bit harsh on the eyes, the eye-protection mode under a warm background has obvious yellow trailing, photography is just so-so, the rest is fine! Photography Photography(negative)
135458 18374 6600258 Complete packaging! The speed of logistics is undeniable, naturally the fastest! The delivery guy is also great! The phone is for the kid to use, the performance is sufficient! A thousand... Packaging Packaging(positive)
135461 18374 7437762 Battery life is not strong, selfie and such are okay, and the photography is so-so, feels like it's about the same as the R15 Dream Edition, anyway the feeling of holding it in the hand doesn't... Photography Photography(positive)

After discarding the majority of overly generalized review texts, the editors analyzed the proportion of comment counts in the following aspects against the brand's total number of comments, yielding data that can be used for brand comparison. As can be seen, Xiaomi is quite strong in the aspect of "cost-performance" with 10.96% of Xiaomi reviews affirming its value for money, while 9.36% of Honor reviews affirm its cost-performance. Additionally, Honor has a relatively significant advantage in terms like "screen" and "appearance." Meanwhile, Xiaomi shows more distinct advantages in aspects like "photography," "cost-performance," and "price."

Then we use negative reviews as validation. Xiaomi received a lot of complaints regarding "Battery", with a fair amount of grievances about the "Screen" and "Design" as well. On the other hand, Honor does not have particularly noticeable issues.

To Facilitate Comparison For Each Project, The Editor Has Recreated Several Charts According to the Projects:

From the perspective of "Speed", the two brands are neck and neck, ending in a tie.

From the perspective of cost-effectiveness, Xiaomi has received more positive feedback but also more negative feedback. However, considering the much larger number of positive feedback samples, the confidence level is higher. Therefore, the editor tentatively and subjectively believes that Xiaomi wins in terms of cost-effectiveness.

Regarding the screen, the positive and negative reviews corroborate each other, with Honor coming out ahead.

Regarding price, the editor believes it should be closely related to the cost-performance ratio and can corroborate each other; hence Xiaomi takes the victory

In terms of photography, Xiaomi received more positive evaluations and fewer negative evaluations, Xiaomi wins out. This is a bit different from the editor's intuition; the editor has always thought that Huawei's technology should be a bit better, but Honor needs to distinguish itself from the Huawei main series, so making some compromises in certain areas is inevitable.

Tactile feel is a rather abstract concept, yet a significant number of consumers have mentioned it. Both companies are neck and neck in this aspect.

In terms of appearance, Honor has more positive reviews and fewer negative ones, coming out on top.

In terms of colors, Honor takes the win. Colors should have strong relevance to the appearance and can validate each other.

Regarding the battery, both brands have similar positive reviews, but Xiaomi has significantly more negative sentiment. Based on the editor’s own painful experience, it is not fair to comment on Honor as I have never used it, but Xiaomi's battery is really...

In terms of packaging, Honor receives more positive feedback. Coupled with Xiaomi's setback in design and color, one might wonder if there has been a misstep in their design strategy?

To Summarize:

  • Tie: Speed, Hand-feel

  • Xiaomi Wins: Cost-effectiveness, Price, Photography

  • Honor Wins: Screen, Appearance, Color, Battery, Packaging

After the new products from both companies are launched, I will conduct a comparative analysis of the new models separately.

This article is translated from an original Chinese version and may contain incorrect details due to mistranslation. Please use at discretion.