or Connect
AppleInsider › Forums › Mobile › iPhone › Rampant cheating by Android knockoffs prompts AnTuTu to launch new benchmark
New Posts  All Forums:Forum Nav:

Rampant cheating by Android knockoffs prompts AnTuTu to launch new benchmark

post #1 of 24
Thread Starter 
While some U.S. tech media reports have portrayed Samsung's benchmark fraud as a minor embarrassment related to numbers "nobody cares about," faking benchmarks is a big business in Asia, particularly among White Box Tablets, a market segment the U.S. tech media does consider relevant when talking about Apple's iPad market share of "shipments."

AnTuTu X
Source: AnTuTu.com


A recent report by TechCrunch described Samsung's fraudulent efforts to get its "Galaxy" product model names to the top of benchmark charts as a dubious benefit only likely catch the attention of some tech enthusiasts.

However, in Asia and particularly China, faking benchmarks is a huge business because the market for cheap, domestic "White Box" iPhone and iPad knockoffs is legitimized by reassuring benchmark scores.

Samsung has faked benchmark scores for its products regardless of their internals, having cheated for not only its own Exynos 5 chip in the Galaxy S4, but also for its Galaxy Note 3 using a Qualcomm Snapdragon chip and its Galaxy Tab 3 10.1 powered by an Intel CloverTrail+ processor. Such benchmark fudging is a practice that's opposed by Qualcomm and Intel, as noted by AnandTech.

In China, however, component makers and device assemblers are commonly united in creating fake benchmarks that portray their devices to be worth more than they are, or of similar quality to the products they are knocking off. The problem is so out of hand that earlier this week, popular Android benchmark AnTuTu, which bills itself as an "impartial and unbiased smart phones benchmark," announced a new version of its tool specifically designed to work around the rampant cheating.

How many ways a cheater can cheat



Not all "optimizations" are full blown cheating, but many are. As AnTuTu explained, "there are some smartphone makers who do system optimization especially aiming at AnTuTu Benchmark to improve the test scores. A legal system optimization operation on devices is what we encourage, but the action of tricking customers by cheating is what we are firmly against."

The group describes a variety of ways the Android hardware makers are cheating end users. The most egregious way is to modify AnTuTu's benchmark tool to report "fake hardware specs list and test scores," claiming, for example, more RAM and faster components than are even present. "This kind of cheating method always turns out on high imitation and fake devices," the group states.

A second cheat is similar to what Samsung has been doing: temporarily boosting the results when the device senses that a benchmark is running. "As a consequence, the result customers saw is differ with the real fluency feel in daily use," the AnTuTu states.

Another cheat type involves faking graphics performance. "After recognition of AnTuTu Benchmark and other Benchmark, some chips will self omit test frames, while the system shows correctly. For example, when operating 3DRating test, the frames number which the system has received is 10, while the real frames showed is only 5 per minutes, in this case, test scores will have huge improvement."

The group noted, "We [at] AnTuTu feel sorry about these behaviors and we need to alert all users to these behaviors of Fake-phone makers adopted on devices."

"New Android White Box Tablets" just like old PC netbooks



As blogger Mike Cane notes, the scope of cheating among China's "White Box" iPad clones goes far beyond faking benchmarks. Sloppy efforts to create knockoff products infect the entire manufacturing chain, "from the chipmakers to the component suppliers to the tablet makers."

"Chipmakers," Cane writes, "find a way to make their chips detect AnTuTu and then run a certain way to produce a better score. They also claim their chips will run at a certain speed but tablet makers must downclock them because of chip yield problems ? which the chipmakers paper over by simply discounting their chips. Component makers get customers not on the basis of quality but by cutting deals on price."

On top, "tablet makers hype their products without full and honest specs and with abysmal warranties, return policies, and repair policies. One investigation into tablets revealed a defect rate of one in three!" he noted.

Cane referenced the White Box Tablet market that analysts like Strategy Analytics are directly comparing to the iPad, noting, "on the whole, domestic Chinese tablet makers ? en toto ? are held in low regard by the Chinese themselves. Yet we outside of China think we?re getting some sort of bargain!"

fake iPads
Source: Mike Cane


One example of this is in screen quality. Products like the "Teclast P89 Mini," "Cimi/Simi X8," "Onda V819 Mini" and "Vido Mini One" essentially claim to be lower cost, generic versions of Apple's iPad mini. However, they ship with screens that can't reproduce the same color depth, resulting in washed out images (a broad range of fakes, depicted above). Forum boards are also full of users complaining about failed chargers, dysfunctional buttons and unstable software.

The state of China's Android-based White Box Tablets is virtually identical to the low quality PC netbooks that briefly generated big shipments before collapsing at the feet of unimpressed consumers as Apple's iPad began to gain traction immediately after its launch in 2010. That hasn't stopped analysts' regular comparisons of Apple's consistent iPad sales against the global "shipments" of such White Box devices, arriving at the conclusion that Apple's "market share" is plummeting in Asia.

The extremely poor quality of such low end builds helps to explain why purported shipments of Android tablets aren't showing up in web logs and other metrics of customer use; rather than cheap iPads, these White Box Tablets are actually more like very expensive ewaste, destined to be thrown in a drawer rather than put to use.
post #2 of 24

I have zero sympathy for blowhards that think they are getting an iPad experience at cheap-garbage Android prices.  You get what you pay for, cry back home when that landfill product suddenly breaks down after a few months.

And people complain that iDevices are too expensive when the other spectrum shows exactly what happens when they race to the bottom??  Stupidity on an epic level.

post #3 of 24
Quote:
Originally Posted by sflocal View Post

I have zero sympathy for blowhards that think they are getting an iPad experience at cheap-garbage Android prices.  You get what you pay for, cry back home when that landfill product suddenly breaks down after a few months.


And people complain that iDevices are too expensive when the other spectrum shows exactly what happens when they race to the bottom??  Stupidity on an epic level.

True. What's the point of doing some benchmarks which device is faster when all of them are showing wrong results?

So now apple is proven right even on the benchmarks test also. and for normal everyday use they are already far ahead from other companies.
Before these tech companies use to mess with battery tests only and now this too.

my way or the highway...

Macbook Pro i7 13" with intel SSD 320 series and 8GB RAM, iPhone 5, iPad 3 (Retina)

Reply

my way or the highway...

Macbook Pro i7 13" with intel SSD 320 series and 8GB RAM, iPhone 5, iPad 3 (Retina)

Reply
post #4 of 24

I have several tablets and one of them is a Chinese white box one called MID. It has two camera's, 3g  and the ability to make normal phone calls. It still amazes me that the Chinese can make such a awesome product for so little money. But since the IOS 7 upgrade on my iPad, I started using my iPad a lot more.

post #5 of 24

Wow, anand has a great article about this.

post #6 of 24

What a healthy competition Apple has.

"We're surrounded by anonymous, poorly made objects. It's tempting to think it's because the people who use them don't care -- just like the people who make them." - Jony Ive, 2014
Reply
"We're surrounded by anonymous, poorly made objects. It's tempting to think it's because the people who use them don't care -- just like the people who make them." - Jony Ive, 2014
Reply
post #7 of 24
I really don't understand or care about Android phone makers benchmarks, but it sure has DED obsessed.
post #8 of 24
Quote:
Originally Posted by pedromartins View Post

Wow, anand has a great article about this.

Anand has yet to mention AnTuTu's new benchmark test.
post #9 of 24
My mac runs a LOT slower than most PC's that you can buy for HALF the price.
Do I care? Nope. Why?
Apple make a product that is pleasant to use. I am more productive on Mac OS, because I find the user interface does not leave me 'wondering' or questioning. It just DOES what I expect it to do. Same happens with my iOS devices.

Speed is not always the answer to everything. It's USABILITY!
post #10 of 24

I echo what Peter Windle said. The overall usability and ease of use keep me hooked. "It just works."

 

If Apple "doped" the benchmarks, would the average Apple user care? Probably not.

 

Amazing that these White Boxes even fake the amount of RAM, GPU speed, etc.

post #11 of 24
Apple is DOOOOOOMED. Oh,wait, this is GOOD news for Apple, right? or has someone accused Apple of doing the same thing but haven't been caught yet?

I thought the whole benchmark comparison thing was a casualty of the MHz wars - but I guess not.
post #12 of 24
Quote:
Originally Posted by Peter Windle View Post

My mac runs a LOT slower than most PC's that you can buy for HALF the price.
Do I care? Nope. Why?
Apple make a product that is pleasant to use. I am more productive on Mac OS, because I find the user interface does not leave me 'wondering' or questioning. It just DOES what I expect it to do. Same happens with my iOS devices.

Speed is not always the answer to everything. It's USABILITY!

My 2009 MacBook Pro runs faster than a lot of newer computers. It's amazing what a SSD and 6-8 GB or RAM can do. I've extended the life of my MBP almost 2 fold. Unfortunately I'm limited by the processor and graphics.

I just wish we had a bit more flexibility in upgrading our devices to really get the most out of them.
post #13 of 24

Android will become synonymous with being a Yugo.

 

I find this whole benchmarking things a joke anymore, it no longer about this, well most buyers except in China do not care about this. It is like auto industry back in the 60's they had a marketing slogan of win on Sunday sell on Monday. People we see that a car win a track figure it was the best so why not buy it. But what they did not know the car that won in a way cheated it was not the car you can buy, it was specifically built to win a race. It should you how China and these other counties think, they are still unable to think on their own they need someone to tell them what is best.

post #14 of 24
Quote:
Originally Posted by Peter Windle View Post

My mac runs a LOT slower than most PC's that you can buy for HALF the price.

 

This is FUD

 

 

post #15 of 24
Quote:
Originally Posted by Satalite View Post

My 2009 MacBook Pro runs faster than a lot of newer computers. It's amazing what a SSD and 6-8 GB or RAM can do. I've extended the life of my MBP almost 2 fold. Unfortunately I'm limited by the processor and graphics.

I just wish we had a bit more flexibility in upgrading our devices to really get the most out of them.

Yep. My 2006 MBP is just fine for every day use since I replaced the hard disk with an SSD. Too bad it's limited to 3GB of RAM.
"I'm way over my head when it comes to technical issues like this"
Gatorguy 5/31/13
Reply
"I'm way over my head when it comes to technical issues like this"
Gatorguy 5/31/13
Reply
post #16 of 24
Originally Posted by AppleInsider View Post
“…Antutu has got…”

 

I can tell they’re not native speakers. I can tell they’re just trying to follow native speakers’ trends. But GAH, that hurt to read.

Originally Posted by asdasd

This is Appleinsider. It's all there for you but we can't do it for you.
Reply

Originally Posted by asdasd

This is Appleinsider. It's all there for you but we can't do it for you.
Reply
post #17 of 24
Quote:
Originally Posted by Satalite View Post


My 2009 MacBook Pro runs faster than a lot of newer computers. It's amazing what a SSD and 6-8 GB or RAM can do. I've extended the life of my MBP almost 2 fold. Unfortunately I'm limited by the processor and graphics.

I just wish we had a bit more flexibility in upgrading our devices to really get the most out of them.

 

Ditto.

post #18 of 24

The article is titled Rampant cheating by Android knockoffs prompts AnTuTu to launch new benchmark yet there is no mention of a new benchmark. I could understand them not revealing the tech they will use to keep the cheaters from cheating but the article only speaks to AnTuTu's disgust at and several types of cheating.

 

No mention of new benchmark as far as I can tell. :(

post #19 of 24
Quote:
Originally Posted by Damn_Its_Hot View Post
 

The article is titled Rampant cheating by Android knockoffs prompts AnTuTu to launch new benchmark yet there is no mention of a new benchmark. I could understand them not revealing the tech they will use to keep the cheaters from cheating but the article only speaks to AnTuTu's disgust at and several types of cheating.

 

No mention of new benchmark as far as I can tell. :(

 

there’s a link to the report of their new benchmark, but there’s also a PHOTO OF THEIR STORY ABOUT CHANGING IT AND WHY.

post #20 of 24

Cheating - in China? i'm shocked!

post #21 of 24
Beyond issues of dodgy performance is the issue of safety. We've seen people electrocuted by knock-off device chargers. I can't imagine wanting to risk having the device itself overheat because of a shoddy battery and cause a house fire. The people making these bottom rung devices care nothing about those who are buying them. It all makes you appreciate Apple all the more. Buy from people who care.
post #22 of 24
Originally Posted by sflocal View Post
 

I have zero sympathy for blowhards that think they are getting an iPad experience at cheap-garbage Android prices.  You get what you pay for, cry back home when that landfill product suddenly breaks down after a few months.

And people complain that iDevices are too expensive when the other spectrum shows exactly what happens when they race to the bottom??  Stupidity on an epic level.

 

Yup.  But oh well, imitation is the sincerest form of flattery.

Whole lotta Apple flattery going on in China.

Sent from my iPhone Simulator

Reply

Sent from my iPhone Simulator

Reply
post #23 of 24
Quote:
Originally Posted by sflocal View Post
 

I have zero sympathy for blowhards that think they are getting an iPad experience at cheap-garbage Android prices.  You get what you pay for, cry back home when that landfill product suddenly breaks down after a few months.

And people complain that iDevices are too expensive when the other spectrum shows exactly what happens when they race to the bottom??  Stupidity on an epic level.

 

Agreed. There is no "Apple tax" but there is an "idiot subsidy".

post #24 of 24
Originally Posted by Dunks View Post

There is no "Apple tax" but there is an "idiot subsidy".

CREATOR: gd-jpeg v1.0 (using IJG JPEG v62), quality = 85

Originally Posted by asdasd

This is Appleinsider. It's all there for you but we can't do it for you.
Reply

Originally Posted by asdasd

This is Appleinsider. It's all there for you but we can't do it for you.
Reply
New Posts  All Forums:Forum Nav:
  Return Home
  Back to Forum: iPhone
  • Rampant cheating by Android knockoffs prompts AnTuTu to launch new benchmark
AppleInsider › Forums › Mobile › iPhone › Rampant cheating by Android knockoffs prompts AnTuTu to launch new benchmark