Radio engineer: Consumer Reports iPhone 4 testing flawed

Posted:
in iPhone edited January 2014
An engineer experienced with electromagnetic issues like those now affecting Apple's iPhone 4 says that the tests performed by Consumer Reports were scientifically flawed.



In response to the iPhone 4 technical findings reported by the consumer buying advice group, engineer Bob Egan observed on his own site that "Consumer Reports' [radio frequency] engineers should know better than to think they can run an engineering grade test for an issue like this in a shielded room. And certainly not one with people in it."



Egan explains, "To even reasonably run a scientific test, the iPhone should have been sitting on a non-metallic pedestal inside an anechoic chamber. The base station simulator should have been also sitting outside the chamber and had a calibrated antenna plumbed to it from inside the chamber.



"I have not seen Consumer Reports' claim directly that the finger effect reduces the iPhones sensitivity by 20db as reported elsewhere, but unless Consumer Reports connected to a functional point inside the iPhone that number is fantasy.



"Even the way they seem to have tested the change ? by varying the base station simulator levels ? seems to assume the iPhone receiver and/or transmitter operate in a linear fashion (the same way) across all signal strengths ? bad assumption.



"Bottom line: from what I can see in the reports, Consumer Reports replicated the same uncontrolled, unscientific experiments that many of the blogging sites have done."



While there is little controversy surrounding the fact that some changes can be observed in iPhone 4 signal bars by holding the device a certain way, and that the signal strength may impact call quality and data transmissions speeds, Egan notes that it is not known "what part of this problem is Apple?s and what part is related to the AT&T network. And we don?t know how the observed effect is, or is not, similar to other devices.



"We also don?t know if placing a finger on the antenna bridge is detuning the antenna or detuning the receiver itself. And neither does Consumer Reports."



Reuters and other new agencies have jumped on the latest blog posting by Consumer Reports to suggest that the groups's refusal to "recommend" iPhone 4 with a special endorsement is actually a recommendation against buying the phone.



The report by Reuters described Consumer Reports' evaluation of iPhone 4 "critical" and a "poor review," despite the fact that iPhone 4 is the highest ranked smartphone in the group's mobile phone rankings. Consumer Reports does not appear to have "recommended" any smartphone model in its tests.



Update: Egan added in an email response, "Curiously the Consumer Reports 'engineers' seemed to have completely overlooked a potential very large new problem observation: you cannot measure the 'receiver' antenna problem by monitoring the output power of the phone as they did.



"Bridging the antenna gap so as to make cell phone receiver deaf (or more deaf) would normally cause the output power of the cell phone to go up to compensate, not down. Eg. the cell phone thinks its further away from the tower.



"If what we see in the video is true ? the received single strength went down- it would suggest two things; 1) touching the gap is actually making the cell phone more sensitive ? not less, or 2) the problem is not a calibration of the signal strength software calibration as admitted by Apple. Instead suggesting there is a malfunction in the cell phone power control system, or some other screwy situation.



"Of course if Consumer Reports did even a reasonable job of controlling the conditions of the test there would be some authoritative data. As I said, their work is not authoritative, and is on par with many 'blogger' tests, including my own 'trash can' tests cited elsewhere."
«13456710

Comments

  • Reply 1 of 193
    vrkiranvrkiran Posts: 110member
    Everyone is a scientist. If it's pro Apple stock, it's bound to get a mention on AI. Last week CR was a great publication known for their honesty, this week, it's ignorant and unscientific!
  • Reply 2 of 193
    foo2foo2 Posts: 1,077member
    Egan: "[Apple] surely have a s/w issue", but on what scientific basis? Without access to the software, this is pure fantasy.



    Egan: "I have not seen CR’s claim directly that the finger effect reduces the iPhones sensitivity by 20db as reported elsewhere, but unless CR connected to a functional point inside the iPhone that number is fantasy"



    Stop the fantacizing. Demand Apple bring back Field Test Mode in the next iOS 4 update.
  • Reply 3 of 193
    anonymouseanonymouse Posts: 6,857member
    Quote:
    Originally Posted by vrkiran View Post


    everyone is a scientist. If it's pro Apple stock, it's bound to get a mention on AI.



    So, articles on methodological criticisms of the CR iPhone tests, which have also been written about here, are somehow inappropriate?
  • Reply 4 of 193
    bregaladbregalad Posts: 816member
    So how does this scientist suggest testing the effect of a person holding a phone if the person is required to stay outside the anechoic chamber?
  • Reply 5 of 193
    daharderdaharder Posts: 1,580member
    Note: Alleged Radio Engineer Bob Egan's statements wholly funded by Apple.
  • Reply 6 of 193
    ivan.rnn01ivan.rnn01 Posts: 1,822member
    Meh.

    FUD. The fella is far too much clueless and brainless even for a college student in engineering.
  • Reply 7 of 193
    wtbardwtbard Posts: 42member
    There's been a lot of bad information put out. Attenuation has been called interference. Transmit power levels called receive levels.



    From the video, it looks like what was tested was the iPhone transmit power as received by their simulator. As far as I can tell, no one has measured receive power levels which are what are displayed on the iPhone bars.



    This was definitely not a rigorous test but more like a demo. It would be good to have a real engineering company with experience with cell phones to take measurements, but that likely would cost more than the media is willing to pay.
  • Reply 8 of 193
    Quote:

    So how does this scientist suggest testing the effect of a person holding a phone if the person is required to stay outside the anechoic chamber?



    A sausage?
  • Reply 9 of 193
    vrkiranvrkiran Posts: 110member
    Quote:
    Originally Posted by anonymouse View Post


    So, articles on methodological criticisms of the CR iPhone tests, which have also been written about here, are somehow inappropriate?



    I did not know that you personally knew Bob Egan and his technical acumen to disagree with an unscientific organization! Sorry!
  • Reply 10 of 193
    mazda 3smazda 3s Posts: 1,613member
    Quote:
    Originally Posted by vrkiran View Post


    Everyone is a scientist. If it's pro Apple stock, it's bound to get a mention on AI. Last week CR was a great publication known for their honesty, this week, it's ignorant and unscientific!



    That about sums it up.
  • Reply 11 of 193
    bcottenbcotten Posts: 11member
    i think the bigger issue is that we're all still having this conversation 3-4 weeks into this... that's the biggest problem for the iPhone 4. Also- the antenna.
  • Reply 12 of 193
    8corewhore8corewhore Posts: 833member
    Why do people even think CR is the end all be all? People just want to be told what to do by some authority. And "journalism". Most if it is desperate sensationalism to grab eye balls. Most are the info equivalent of a car salesman. It's mostly now tabloid. I'm not referring to AI right now. I'm referring to the media in general that loves to regurgitate and misrepresent facts because they have to spew something. I use my phone all the time and ignore the stupid bars but because of the lazy media I have total strangers grinning asking how the phone is with all it's problems. I just say no problems and they look confused.
  • Reply 13 of 193
    neilmneilm Posts: 985member
    "My engineers can beat up your engineers!"

    "Huh-uh!"

    "Uh-huh!"

    etc., and so ad infinitum.



    My observation: I noticed the signal strength degradation/death grip thing on my own almost immediately on starting to play with my new iPhone 4 on release day. Taking even a modest amount of care in holding it the problem can be avoided altogether. Any case that covers the metal strip, which is to say any case at all, fixes it. I'm using the Bumper.



    Should this have happened? No. Is it a big deal? No. Is the whole thing getting blown way out of proportion? You be the judge...
  • Reply 14 of 193
    2oh12oh1 Posts: 503member
    I thought the biggest problem for the iPhone 4 is that they're selling faster than Apple can make them.
  • Reply 15 of 193
    irelandireland Posts: 17,798member
    I'm sure you searched around for an article like this, Daniel.



    As a shareholder you aren't doing Apple any favors but refusing to acknowledge the real issue here along with them. Fixing it would have a better long-term result for their image, and their stock.
  • Reply 16 of 193
    daharderdaharder Posts: 1,580member
    Quote:
    Originally Posted by 2oh1 View Post


    I thought the biggest problem for the iPhone 4 is that they're selling faster than Apple can make them.



    Obviously Your Were Terribly Mistaken...
  • Reply 17 of 193
    solipsismsolipsism Posts: 25,726member
    Quote:
    Originally Posted by vrkiran View Post


    If it's pro Apple stock, it's bound to get a mention on AI.



    You're right... except for all those articles that don't help Apple's image. Two so far today and three yesterday, with moat articles seeming to be mostly Apple-neutral, like the MS, BMW, and AT&T articles from today.





    Quote:
    Originally Posted by Bregalad View Post


    So how does this scientist suggest testing the effect of a person holding a phone if the person is required to stay outside the anechoic chamber?



    It's a control group. I've been saying the same thing since this issue appeared, we still don't know what the cause is. Touching the "3G-Spot" shows a result, but not the actual cause.
  • Reply 18 of 193
    irelandireland Posts: 17,798member
    Quote:
    Originally Posted by vrkiran View Post


    Everyone is a scientist. If it's pro Apple stock, it's bound to get a mention on AI. Last week CR was a great publication known for their honesty, this week, it's ignorant and unscientific!



    It's actually disgraceful reporting on the part of AI. They are throwing their own reputation under the bus to protect Apple's.
  • Reply 19 of 193
    anonymouseanonymouse Posts: 6,857member
    Quote:
    Originally Posted by vrkiran View Post


    I did not know that you personally knew Bob Egan and his technical acumen to disagree with an unscientific organization! Sorry!



    I fail to see any relevance in your comment.
  • Reply 20 of 193
    irelandireland Posts: 17,798member
    Quote:
    Originally Posted by 2oh1 View Post


    I thought the biggest problem for the iPhone 4 is that they're selling faster than Apple can make them.



    No, that's the good part. The bad part is if this does become widely well known it says more about Apple's reputation then the issue itself. Their refusal to deal with the real issue is what the big deal will be about, if that happens. Brand image is Apple's most precious thing, and it's going to take a hit. Apple has the opportunity to swallow its pride and fix the issue. If they do they'll get respect back. If they don't then the Apple rots a little.
Sign In or Register to comment.