Samsung Galaxy Note, HTC One caught cheating in benchmarks again

1234579

Comments

  • Reply 121 of 169
    solipsismxsolipsismx Posts: 19,566member
    So if I drink coffee and beat you, that’s cheating. See, you don’t get to define what a “drug” is.

    It depends on who is making the rules. I don't think any SAT or ACT testing facility would turn away anyone who uses any performance enhancing drug (aka has a cup of coffee in hand or pops a pill before a test) as I don't think those are (yet) a consideration. I'd think they only care about looking at other people's tests, getting someone else to take the test for you, and other ways one can answer questions that aren't coming from one's own brain.
  • Reply 122 of 169
    dasanman69dasanman69 Posts: 13,002member
    So if I drink coffee and beat you, that’s cheating. See, you don’t get to define what a “drug” is.

    Sure I do, I'm talking about an either illegal substance or a drug not prescribed to the one taking it, but on the other hand if you and I were in a stay awake contest and coffee isn't supposed to be consumed and you do then you cheated.
  • Reply 123 of 169
    Cheating or whatever you want to call it is legit because Apple needs competition. /s
  • Reply 124 of 169
    hill60hill60 Posts: 6,992member
    Quote:
    Originally Posted by dasanman69 View Post





    If a drink was enough I don't think a cellist would go out of their way to obtain a beta blocker. Most rules for cheating are reactive not proactive. The rules are set after it became known that people were using means to gain an unfair advantage over everyone else.

     

    The rules Samsung and HTC broke are published here.

     

    Futuremark are quite clear on the matter:-

     

    BENCHMARK RULES AND GUIDELINES





    People rely on Futuremark benchmarks to produce accurate and unbiased results. We safeguard that trust by having clear rules for hardware manufacturers and software developers that specify how a platform must interact with our benchmark software. In simple terms:

    A platform must run the benchmark without modification as if it were any other application.









    Optimization policy

    Benchmark specific optimizations are not allowed. Additionally, all generic optimizations that change the work specified by the benchmark are prohibited.


    • The platform may not change the quality level of the work.

    • The platform may not use an alternative technique to that requested by the workload.

    • The platform may not replace or remove any portion of the requested work even if the change would result in the same output.

    • Optimizations based on empirical data of benchmark workloads are not allowed.

    • Optimizations that change the output of the work are not allowed.





    Application detection

    The platform may not detect the launch of the benchmark executable. The platform must not alter, replace or override any parameters or parts of the test, nor modify the usual functioning of the platform based on the detection of the benchmark.

    Exceptions

    • The platform may detect the benchmark application if it is the general approach for enabling specific platform features, such as multi-GPU use.

    • The platform may detect the benchmark application if there is a known conflict between the benchmark application and the platform that would otherwise prevent the benchmark from functioning correctly. This must be pre-approved with Futuremark.



  • Reply 125 of 169
    hill60 wrote: »
    The rules Samsung and HTC broke are published here.

    Futuremark are quite clear on the matter:-

    <div style="border-style:solid;border-width:0px 0px 1px;color:rgb(68,68,68);padding:30px 25px;">
    <h1 style="color:rgb(253,125,22);margin-bottom:10px;margin-top:0px;">BENCHMARK RULES AND GUIDELINES</h1>

    </div>

    <div style="color:rgb(68,68,68);margin-top:20px;">
    <div style="float:left;width:786px;">
    <div style="padding-bottom:20px;padding-left:25px;padding-right:25px;">
    People rely on Futuremark benchmarks to produce accurate and unbiased results. We safeguard that trust by having clear rules for hardware manufacturers and software developers that specify how a platform must interact with our benchmark software. In simple terms:
    <p style="margin-top:1em;">A platform must run the benchmark without modification as if it were any other application.</p>

    </div>
    </div>

    </div>

    <hr style="border-bottom-width:0px;border-left-width:0px;border-right-width:0px;border-top-color:rgb(204,204,204);border-top-style:solid;color:rgb(68,68,68);height:0px;margin:0px;padding:0px;">

    <div style="float:left;width:590px;">
    <div style="padding-bottom:20px;padding-left:25px;padding-right:25px;">
    <h2 style="color:rgb(51,51,51);margin-top:0px;padding-top:20px;">Optimization policy</h2>

    <p style="margin-top:20px;">Benchmark specific optimizations are not allowed. Additionally, all generic optimizations that change the work specified by the benchmark are prohibited.</p>

    <ul style="margin-left:0px;margin-top:10px;padding-left:16px;"><li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">The platform may not change the quality level of the work.</li>

    <li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">The platform may not use an alternative technique to that requested by the workload.</li>

    <li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">The platform may not replace or remove any portion of the requested work even if the change would result in the same output.</li>

    <li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">Optimizations based on empirical data of benchmark workloads are not allowed.</li>

    <li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">Optimizations that change the output of the work are not allowed.</li>

    </ul>
    </div>
    </div>

    <div style="float:left;width:590px;">
    <div style="padding-bottom:20px;padding-left:25px;padding-right:25px;">
    <h2 style="color:rgb(51,51,51);margin-top:0px;padding-top:20px;">Application detection</h2>

    <p style="margin-top:20px;">The platform may not detect the launch of the benchmark executable. The platform must not alter, replace or override any parameters or parts of the test, nor modify the usual functioning of the platform based on the detection of the benchmark.</p>

    <h5 style="color:rgb(51,51,51);margin-bottom:10px;padding-top:20px;">Exceptions</h5>

    <ul style="margin-left:0px;padding-left:16px;"><li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">The platform may detect the benchmark application if it is the general approach for enabling specific platform features, such as multi-GPU use.</li>

    <li style="color:rgb(136,136,136);list-style-image:url(http://www.futuremark.com/static/images/li.png);padding-bottom:4px;">The platform may detect the benchmark application if there is a known conflict between the benchmark application and the platform that would otherwise prevent the benchmark from functioning correctly. This must be pre-approved with Futuremark.</li>

    </ul>
    </div>
    </div>


    Thanks for the info but the discussion had turned toward PEDs.
  • Reply 126 of 169
    Originally Posted by dasanman69 View Post

    Thanks for the info but the discussion had turned toward PEDs.

     

    Oh, shut up. I don’t really see why you’re allowed to keep posting here; you’ve admitted to doing this on purpose in the past.

  • Reply 127 of 169
    dasanman69dasanman69 Posts: 13,002member
    Oh, shut up. I don’t really see why you’re allowed to keep posting here; you’ve admitted to doing this on purpose in the past.

    To doing what? My comment he quoted wasn't about cheating on testing procedures which will always naturally have anti-cheating rules in place from the beginning. I was cordial and respectful in my reply and very unlike how you respond to people.
  • Reply 128 of 169
    hill60hill60 Posts: 6,992member
    Quote:
    Originally Posted by dasanman69 View Post





    To doing what? My comment he quoted wasn't about cheating on testing procedures which will always naturally have anti-cheating rules in place from the beginning. I was cordial and respectful in my reply and very unlike how you respond to people.

     

    Bringing in a strawman when all along this whole article was about a specific set of circumstances.

     

    Anyhow, I'm off for a drive, I have a 1,000hp car which beats the pants off everything on the road, I've seen the benchmarks and linked to them before, I'll be able to have a BBQ on the bonnet or "hood" as I think you call it, it should turn out alright as long as you don't mind the flavour of burnt paint.

     

    Hey maybe I can fire up a benchmark on my S4 and cook an egg on the side.

  • Reply 129 of 169
    dasanman69dasanman69 Posts: 13,002member
    hill60 wrote: »
    Bringing in a strawman when all along this whole article was about a specific set of circumstances.

    Anyhow, I'm off for a drive, I have a 1,000hp car which beats the pants off everything on the road, I've seen the benchmarks and linked to them before, I'll be able to have a BBQ on the bonnet or "hood" as I think you call it, it should turn out alright as long as you don't mind the flavour of burnt paint.

    Hey maybe I can fire up a benchmark on my S4 and cook an egg on the side.

    How is it a strawman? The discussion turned towards what is considered cheating. I merely pointed out that it happens a lot more often than people realize.
  • Reply 130 of 169
    timbittimbit Posts: 331member
    solipsismx wrote: »
    There are two ways and they are both quite simple.

    One way is to check the code to look that tells the CPU and/or GPU to disable thermal limits when certain tests are detected. The other way, in case that smoking gun isn't found, is to simply run a test with a standard benchmark app, then run it again after changing the signature of the app. If the thermal limits are removed on after using a unique signature then the previous benchmark was doped.

    Thank you for an honest and simple answer, and not sarcastically answering and yelling "troll".
  • Reply 131 of 169
    Quote:

    Originally Posted by hill60 View Post

     

     

    It seems so, judging by some of the comments and one star reviews here.

     

    These Android guys can't handle anything detracting from their decision to purchase also ran products.

     

    How to shoot an Android guy down using an iPhone 5s.

     

     Hold your phone next to theirs, open camera apps together, put latest and greatest Samsung Note 3 or S4 in burst mode then hold down camera icon on both phones...

     

    ...BOOM headshot, they will be left in a whimpering mess as this demonstration of 64bit power blows them away.




    Let's see, on one side it shoots 13MP and 4K video and on the other 8MP 1080p.   Note3 burst mode takes 20 13Mp photos in 1.5-2secs.  

  • Reply 132 of 169
    hill60hill60 Posts: 6,992member
    Quote:
    Originally Posted by zerobim08 View Post

     

    Note3 burst mode takes 20 13Mp photos in 1.5-2secs.  


     

    Pure bullshit, the Note 3 only takes 8 photos in burst mode, the S4 takes 20, after taking the photo's instead of being immediately available like on the 5S, the Samsung's just hang there showing "processing".

     

    Typical whiny response based on fantasy from butthurt fanatics who can't accept that Apple is way in front of their shitty Android.

  • Reply 133 of 169
    hill60 wrote: »
    <div class="quote-container" data-huddler-embed="/t/160936/samsung-galaxy-note-htc-one-caught-cheating-in-benchmarks-again/120#post_2444911" data-huddler-embed-placeholder="false">Quote:<div class="quote-block">Originally Posted by <strong>zerobim08</strong> <a href="/t/160936/samsung-galaxy-note-htc-one-caught-cheating-in-benchmarks-again/120#post_2444911"><img alt="View Post" src="/img/forum/go_quote.gif" /></a><br /> <p><span style="line-height:1.4em">Note3 burst mode takes 20 13Mp photos in 1.5-2secs.  </span></p></div></div><p> </p><p>Pure bullshit, the Note 3 only takes 8 photos in burst mode, the S4 takes 20, after taking the photo's instead of being immediately available like on the 5S, the Samsung's just hang there showing "processing".</p><p> </p><p>Typical whiny response based on fantasy from butthurt fanatics who can't accept that Apple is way in front of their shitty Android.</p>

    You don't have a Note 3 so don't talk nonsense. I just took 20 shots and the "processing" took about 2 to 3 seconds.

    Don't arrogantly show you know something when you obviously don't. Just make you look dumb.
  • Reply 134 of 169
    Originally Posted by zerobim08 View Post

    Don't arrogantly show you know something when you obviously don't. Just make you look dumb.

     

    I have to go lie down; that irony hurt so much.

  • Reply 135 of 169
    hill60hill60 Posts: 6,992member
    Quote:

    Originally Posted by zerobim08 View Post





    You don't have a Note 3 so don't talk nonsense. I just took 20 shots and the "processing" took about 2 to 3 seconds.



    Don't arrogantly show you know something when you obviously don't. Just make you look dumb.

     

    I used the new camera menu and put it in best shot mode, 8 photo's, I didn't notice that you could change it back to the more traditional menu.

     

    So why does it save to the phone, not the SD card, is that an indication of the main flaw of SD being too slow?

     

    My 5s will take 1,000 if I could be bothered holding my finger down for a hundred seconds.

  • Reply 136 of 169
    hill60 wrote: »
    <div class="quote-container" data-huddler-embed="/t/160936/samsung-galaxy-note-htc-one-caught-cheating-in-benchmarks-again/120#post_2445270" data-huddler-embed-placeholder="false">Quote:<div class="quote-block">Originally Posted by <strong>zerobim08</strong> <a href="/t/160936/samsung-galaxy-note-htc-one-caught-cheating-in-benchmarks-again/120#post_2445270"><img alt="View Post" src="/img/forum/go_quote.gif" /></a><br /><br /><br />You don't have a Note 3 so don't talk nonsense. I just took 20 shots and the "processing" took about 2 to 3 seconds.<br /><br />Don't arrogantly show you know something when you obviously don't. Just make you look dumb.</div></div><p> </p><p>I used the new camera menu and put it in best shot mode, 8 photo's, I didn't notice that you could change it back to the more traditional menu.</p><p> </p><p>So why does it save to the phone, not the SD card, is that an indication of the main flaw of SD being too slow?</p><p> </p><p>My 5s will take 1,000 if I could be bothered holding my finger down for a hundred seconds.</p>

    Best shot is different from burst mode. Point is note3 can take burst mode as fast as 5s even at higher 13 mp resolution.

    note 3 camera just kills 5s in capabilities. Like 4k video with stereo and various shooting mode.
  • Reply 137 of 169
    solipsismxsolipsismx Posts: 19,566member
    I thought the days of people foolishly claiming the number of megapixels in a camera is a determination of quality.
  • Reply 138 of 169
    solipsismx wrote: »
    I thought the days of people foolishly claiming the number of megapixels in a camera is a determination of quality.

    Where did I mention more pixel is better? :p
  • Reply 139 of 169
    muppetrymuppetry Posts: 3,331member
    zerobim08 wrote: »
    solipsismx wrote: »
    I thought the days of people foolishly claiming the number of megapixels in a camera is a determination of quality.

    Where did I mention more pixel is better? :p

    That would be in your previous post:

    zerobim08 wrote: »

    Best shot is different from burst mode. Point is note3 can take burst mode as fast as 5s <b>even at higher 13 mp resolution</b>.

    note 3 camera just kills 5s in capabilities. <b>Like 4k video</b> with stereo and various shooting mode.
  • Reply 140 of 169
    hill60hill60 Posts: 6,992member
    zerobim08 wrote: »
    note 3 camera just kills 5s in capabilities. Like 4k video with stereo and various shooting mode.

    That'd chew up memory pretty fast, seeing as you can't write direct to memory card, then according to some you'd need a 4k screen to view it.
Sign In or Register to comment.