Few Days Ago Huawei caught trying to pass off DSLR images as smartphone photos. But It does not end here, now this time Huawei caught cheating benchmark test for P20
Huawei has been caught optimizing some of its top smartphones to over-perform on benchmark tests. Last Tuesday AnandTech finds out that Huawei’s P20 had been programmed to maximize performance specifically when running 3DMark, it’s a popular benchmarking app. Today, the company behind 3DMark followed up with a statement saying that it had confirmed the findings and would delist the P20, as well as three other Huawei phones with similar behavior, from its benchmark leaderboards.
The delisted phones include the P20, P20 Pro, Nova 3, and Honor Play. Huawei admitted to this behavior in a statement given to Android Authority, saying that its phones are designed to adjust their performance based on the app that’s running.
The delisted telephones incorporate the P20, P20 Pro, Nova 3, and Honor Play. Huawei admitted to this conduct in a statement given to Android Authority, saying that its telephones are intended to modify their performance based on the app that’s running.
But the way that Huawei implemented that behavior isn’t allowed. While phones can adjust their performance as part of their typical behavior under high workloads, they can’t be hardcoded to maximize their behavior just because a specific benchmark app is running. That’s what Huawei seems to have done, according to UL, which is behind the 3DMark software.
The delisted phones embrace the P20, P20 Pro, Nova 3, and Honor Play. Huawei admitted to the current behavior in an exceeding statement given to Android Authority, speech that its phones area unit designed to regulate their performance supported the app that’s running.
But the manner that Huawei enforced that behavior isn’t allowed. whereas phones will change their performance as a part of their typical behavior underneath high workloads, they can’t be hardcoded to maximize their behavior simply because a particular benchmark app is running. That’s what Huawei appears to own done, in keeping with UL, that is behind the 3DMark software system.
When UL ran an internal version of 3DMark, that Huawei’s phones couldn’t acknowledge the name of, the phones performed worse on the take a look at. That indicated that the phones weren’t really sensitive enough to spot superior demands on their own, that meant the benchmark score wasn’t a correct reflection of however the phone would handle a typical app while not special attention from Huawei.
As a social control, 3DMark has removed these phones’ rankings from its leaderboard and adorned their listings on its website with a note that the phone’s “manufacturer has not complied with UL benchmark rules.” several of their results are removed still.
Huawei is far from the first company to urge caught flirting with benchmark results. Samsung got busted for identical behavior on its flagship phones in 2013, and simply last year, OnePlus was found to own done identically. Huawei since just weeks ago it got caught trying to pass off a DSLR photo as a photo from one of its phones.
What’s funny concerning all of this can be that benchmarks don’t extremely matter that much. Tweaking a phone to optimize benchmark apps may produce some numbers that build a small set of nerds drool, however, those numbers don’t correlate to the particular experience of using the phone. they could speak to however well the phone performs underneath significant stress, like while diversion, however, a stronger take a look at is to only play a game with it and resolve what happens.
Huawei even admits this. In its statement, the company said it “always prioritizes the user expertise instead of following high benchmark scores — particularly since there isn’t a direct association between smartphone benchmarks and user experiences.” And yet, it still coded its phone to deliver higher performance once running a benchmark test.
But Huawei also claims that its phones’ include AI that’s smart enough to optimize performance based on whatever app is running, and clearly, that’s not the case. If it were, then boosting performance for benchmarks would be fair game — but as it is, it’s not a real reflection of how the phone performs in demanding situations.
You May Like This