	Agent009 "If everything seems under control, you're just not going fast enough."
	View My AgentSpace

Are Consumer Reports Rankings Relevant?

Agent009 submitted on 03/01/2007 Official AutoSpies Timestamp: 10:34 AM
from: www.truedelta.com

[34] user comments | category: Spy Shots

Print this Page |

Digg It |

del.icio.us

Are Consumer Reports Rankings Relevant?

It’s that time of year again: millions of copies of Consumer Reports’ Annual Auto Issue are on their way to mailboxes and newsstands across America. For the next year, this issue will be the bible for many car shoppers as they sort out which vehicles are likely to be the most reliable. But what many of these car shoppers don’t understand is that, by the time the Auto Issue comes out, the data behind the reliability verdicts are already nearly a year old.

How could this be? Why publish a hugely influential Auto Issue using old data? Partly because Consumer Reports still uses the same research methods and timetable they’ve used for decades. The majority of their surveys are still handled through regular mail. This in turn all but requires that the survey be annual and that data analysis drag on for multiple months. The 2006 survey covered the period from April 1, 2005, through March 31, 2006.

But hoary methods and an annual timetable aren’t the only reasons. Even with this schedule, the results from the 2006 survey were released last November, with the annual New Car Preview. So what’s so special about the April auto issue? Well, it does include the results of road tests conducted after the Preview went to press. More than this, though, it’s included in members’ subscriptions. If you’re a print subscriber, and don’t spend another seven bucks to buy the Preview from a newsstand, then the Auto Issue is the first time you have access to all of the “latest” reliability information from Consumer Reports.

Forcing consumers to choose between waiting four months or spending more money seems like something a profit-oriented enterprise might do, doesn’t it? More specifically, it’s the sort of thing a profit-oriented business would do if it faced no real competition. If no one else is providing more recent information, then the year-old stuff is the best there is.

This situation is changing. Recently launched vehicle reliability research at TrueDelta.com takes full advantage of the Internet. TrueDelta’s panel members fill out a one-page survey the month after their vehicle is in the shop, and check-in with an approximate odometer reading quarterly. Once the quarter ends, TrueDelta promptly analyzes the all-digital data.

As a result, this February TrueDelta released vehicle reliability results based on repairs that occurred as recently as December 31, 2006. And it updates this information quarterly, not annually. In May, as the Consumer Reports Auto Issue is pulled from newsstands, TrueDelta will release results based on data through March 31, 2007. At that point, TrueDelta’s information will be a full year “fresher.” During the peak summer and early fall selling months, TrueDelta’s lead will extend to 15 months.

When shopping for a car, do you want to know how reliable it was a year ago, or how reliable it has been recently? Until Consumer Reports fully makes the move from the 1950s into the twenty-first century, and stops peddling year-old information as “the latest,” it isn’t properly serving consumers.

Read Article

Comments:

Images hosted in your AgentSpace can now be posted in the comments section using the following syntax (case matters):
[img]IMAGE URL[/img]
Example: [img]http://agent004.myautospies.com/users/150/Sample-Gallery/sample1.JPG[/img]

JMd71 - 3/1/2007 11:05:47 AM

+1 Boost

CR is relevant is you are "just" a consumer. But we're enthusiasts, and we go beyond the average consumer when researching items we must have :-)

reply to this comment

enthusiastx11 - 3/1/2007 10:17:34 PM

-1 Boost

totally agree. consumer reports is best used for appliances, stereos, or a simple people mover. not really useful for products like performance or luxury cars that are purchased for intangible reasons like design, handling feel and individual comfort.

JMd71 - 3/1/2007 11:05:55 AM

0 Boost

CR is relevant if you are "just" a consumer. But we're enthusiasts, and we go beyond the average consumer when researching items we must have :-)

reply to this comment

mbz350 - 3/1/2007 11:08:10 AM

+7 Boost

Good Post. I find it to be ridiculous when people base their sole purchase decision off consumer reports or what JD powers have said about previous vehicles in a lineup. Granted it can be usefull, but should not be an overall factor.

reply to this comment

snatch - 3/1/2007 12:44:59 PM

+2 Boost

i think some people lose sight of what the PURPOSE of CR is - an assessment of reliability. Should people base their purchasing decision solely on reliability - probably not. When I buy a car, I take styling, performance and other factors into consideration but that's just me. I think for the most part, CR's evaluation is fair - a prior model "should be" a good predictor for the current year [unless there are significant changes]. How else can you really accurately predict future reliability? Also, they're basing their data from thousands and thousands of surveys... which statistically, makes it a lot harder to manipulate. Some people always say that the surveys are useless because they don't take into account driving dynamics etc... but again, they're missing the point - CR does not assess these factors. if you want opinions on those - get C&D or MT. Just my 2 cents.

Threepoint1415926 - 3/1/2007 2:24:39 PM

0 Boost

I disagree snatch.... Because CR trusts surveys of peoples opinions to calculate their automotive ratings, there is no objective data at all. It is purely subjective by way of the surveyed. Polls never make truth, they only make opinion. Hence there is nothing accurate about the prediction of reliability. Perhaps a corollary may be that it is a probably accurate description of what the types of people who buy these cars will think of them.

snatch - 3/1/2007 4:53:20 PM

+1 Boost

i think there was an article posted a while back that listed mechanical problems [or costs] in vehicles.. i believe the information came from insurance companies who ultimately got stuck w/ the bill for paying for the problems. anyway, the top problems came from europeans i believe.. don't get me wrong, i love european cars but to say the europe is as reliable as the japanese would be wishful thinking. and again, these studies are consistent with CR - the japanese consistently beat the rest... that said, i still prefer the germans....

530N52 - 3/1/2007 11:23:54 AM

+3 Boost

Relevant if you by a car with the same enthusiasm you buy a refrigerator.

reply to this comment

1970toyotamarc - 3/1/2007 11:42:18 AM

-2 Boost

Funny how the only people who seem to dislike CR or JD are the ones whose favorite cars don't make the top picks.
Ive never met one car buyer who used information solely from one source to make their car buying decision. But if you really dont believe this source is a valuable one, then what is a good source? Autospies? a Blog?

I know what the following comments will be. I'm not an enthusiast. I just want to buy an appliance. Blah Blah Blah. Ive heard it all before. An enthusiast only being defined as someone who owns a German car with a stickshift. Forgive me if I choose to own a technological tour de force that depite its complexity, and depsite all the haters here, continues to score highly in CR and JD. And that amazing vehicle is my brand new 2007 Magnetic Gray Prius.

reply to this comment

Will_ - 3/1/2007 12:35:08 PM

-2 Boost

That's funny. Car and Driver, Motor Trend, and Top Gear are hailed as Heaven for the godly BMW and Mercedes. Let one Japanese car top any comparison, or let Jeremy Clarkson call any BMW a "turd," and the tide turns...

And it's called hypocrisy, with an "i," and you demonstrate it at its finest.

enthusiastx11 - 3/1/2007 10:23:39 PM

0 Boost

an enthusiast is someone who won't compromise on handling and performance. period. people who buy cars largely based on quality ratings are very different. they'll happily tolerate sloppy, imprecise handling or a soft ride for just a bit more reliability.

furthermore, the absolute difference in quality between the #1 rated and #10 rated brand is far smaller than it was just 10 years ago. the vast majority of cars today are incredibly reliable. check out those absolute scores next time you look at JD powers.

Will_ - 3/1/2007 11:44:11 PM

0 Boost

"A bit more reliability" is a disaster of an understatement. Furthermore, an "enthusiast" is defined as "One who is filled with enthusiasm; one who is ardently absorbed in an interest or pursuit." I'd say everyone on this site is an enthusiast, for we are all ardently absorbed in the interest of automobiles.

Will_ - 3/1/2007 12:13:39 PM

-3 Boost

Has anyone noticed that BMW likes using the Kelley Blue Book to back up their claims of resale superiority? Name the "enthusiasts" who buy cars based solely on higher resale values? We rarely ever see articles with posters trying to discredit the KBB. I don't see anyone calling them irrelevant.

reply to this comment

enthusiastx11 - 3/1/2007 10:27:16 PM

-2 Boost

resale value isn't a purchase reason for most BMW buyers. but those amazing residuals sure do make for some sweet lease deals. you can drive a 335i for less than a IS350 that actually stickers for less. an easy decision made even easier.

Will_ - 3/1/2007 11:41:36 PM

-1 Boost

True. Escape those reliability issues altogether!

r_driver04 - 3/1/2007 12:34:38 PM

+3 Boost

An enthusiast will utilize all sources to make a decision. Positive and negative information as well. But it all comes down to which makes you smile when you turn the ignition or accelerate up a merge ramp. Might as well buy what you WANT, since you'll be paying on it.

reply to this comment

mini22 - 3/1/2007 1:11:35 PM

-1 Boost

I completely agree with you. Toyota is where it is because it's used car rating has been at or near the top for many years.This is why people keep buying them. They are not exiting enthusiast cars but have shown to be very reliable.So CU does perform an important function for the majority of buyers of autos in this country. And most of them are non-car enthusiasts.

reply to this comment

mkaresh - 3/1/2007 2:36:17 PM

0 Boost

I operate the website mentioned in the article.

You appear to have thoroughly misunderstood the article. So I wouldn't be so quick to label it "very stupid."

Maybe a timeline will help:

March 31, 2006 End of year covered by CR's current reliability verdicts

Late June, 2006 Deadline for surveys

Early November 2006 First release of the results, in the New Car Preview, not included in subscriptions

Early March 2007 First release of the results to print subscribers

Whatever the causes--and they still have about twice as many print subscribers (who get their survey via snail mail) as online members--I find it absurd that they're now issuing an auto issue with reliability verdicts based on repair data that is nearly a year old.

I understand your point that long-term durability is most important to many people. But even if you're considering six-year-old cars, do you want data on the fifth year of these cars' lives, or the sixth?

The same applies for every model year. CR has no idea about reliability since March of last year.

reply to this comment

webguy - 3/1/2007 1:15:47 PM

+7 Boost

Is CR relevant? Yes, of course. It’s the largest and virtually the only study of its kind. If reliability is a concern of yours, it would be foolish to dismiss this study; and the consideration of reliability hardly excludes you from the enthusiast crowd. It is after all an element of quality.

Sure, like any statistics, they’re vague, can be manipulated and even irrelevant in your own personal life. Who knows what other factors are driving people to report "problems" in their cars. Certain cars may very well attract the types who take care of their vehicles, and others the type to drive it into the ground. Further, if you want a CLS for instance, another car like it doesn’t yet exist. Early adopters are accustomed to dealing with teething problems, and the CR reports are akin to the warning labels on a bottle of alcohol. On cars the warning label reads "High performance parts are subject to increased wear, and may require a significant level of maintenance."

Bottom line is though, despite blog postings that come out of the woodwork to proclaim their Chevy Cobalt was driven into the sand without a single problem, or their Lexus spent two months in the shop; the CR reports do reflect general experiences. Much like the IIHS crash tests, they are pushing manufacturers to do better by pulling back the red curtain on a very important element of the ownership experience.

reply to this comment

Terminal10 - 3/1/2007 1:24:23 PM

+1 Boost

I agree with you one or two peoples experience with a car does not translate into a major problem. Who are the people reporting these problems are they people like us who post on sites like this and have a good handle on what we drive and the cars we lust after? Probably not they are Mr. and Mrs. average who put fuel in the car and ignore that flashing oil low light on the dash until the engine seizes and then tell Consumer Reports that they have a problem with their car.

reply to this comment

klossfam - 3/1/2007 1:31:39 PM

-1 Boost

I think from a reliability & cost of ownership they are a good source but as noted by many above - definitely geared towards people that view cars as "appliances"...it's a total bean counter point of view without regard to the fun to drive level - I've owned 4 new Acuras/Honda since 2001 - and yes, they are fairly bullet proof - but I drive an Audi A4 S-line because I'll trade some "reliable ratings" for driving pleasure (in reality the Audi has been as reliable as any Acura or Honda I've owned - even more so than my 2002 Acura TL-S)...I throw Consumer Reports in the pile with the rest of the mail BUT I READ Car & Driver...

reply to this comment

answer - 3/1/2007 1:49:58 PMView My AgentSpace

+3 Boost

Consumer Reports is a relevant source of car data, how much so depends on the consumer.

An enthusiast who looks at a car for reasons beyond reliable transportation will use Consumer Reports opinion a lot less than someone who wants good value and a dependable means for getting to work. That however does not mean Consumer Reports is wrong/irrelevant etc.

The way some of you self-described enthusiasts speak makes me think you are all drift racing on your morning commute and time your runs to the grocery store.

While you may not value what Consumer Reports provides, the majority of car purchasers seem to think otherwise.

reply to this comment

supermoto - 3/1/2007 2:15:06 PM

0 Boost

I much prefer the rankings/reviews in Robb Report! Their rankings are done by enthusiasts who have owned the best cars out there, so have an informed opinion. Sonsumer reports has rankings made by poorly paid writers who who should should stick to reviewing vacuum cleaners.

reply to this comment

izfuney - 3/1/2007 6:59:18 PM

+2 Boost

Cool!!
I base my car ranking by the cool factor as personified by my neighbour, a pony tailed dude who drives a MG. Figure all these psoters boast about being "enthusiasts" . You ain't no "enthusiast" untill you have taken apart your distributor and cleaned it to get get your car going just because it rained.
Amen.

huu76 - 3/1/2007 9:40:08 PM

+3 Boost

Well, CR faulted the IS300 for being more sporty than the 3 series.

reply to this comment

weaponX - 3/2/2007 9:31:18 AM

+1 Boost

Yes, they are relevant.

Their reliability studies are very helpful.

Numbers don't lie.

reply to this comment

mkaresh - 3/2/2007 3:41:19 PM

+2 Boost

Numbers would be helpful, but CR doesn't provide numbers. They provide red and black dots. The relationship between numbers and dots is kind of like that between instruments and idiot lights. Which do you prefer in your car?

weaponX - 3/5/2007 2:56:45 PM

+1 Boost

I prefer my car not to be in the shop every week.

And if I have to put up with those red/black dots to tell me which car will/won’t break down then so be it.

Do you think they they just pull out those conclusions out of the big blue sky?

If it helps, red = good, black = bad.

Neverfollow - 3/2/2007 12:11:58 PM

0 Boost

Take a look at the Audi brand lately:

Highest quality Euro brand (Consumer Reports 2006)
4th best overall quality of all luxury brands (Consumer Reports 2006)
Recommend and top pick (Consumer Guide 2005,2006)
Top safety brand according to the (IIHS 2005,2006)
Has won several shootouts in C&R, MT, R&T, Autoweek, along with many German publications such as Auto Bild (Golden Steering wheel 2005,2006) and Auto Motor und Sport
Two engines on Wards Top 10 automotive engines list 2006.
Autoweeks Reader's Choice Best luxury car 2006.

There way too many more to mention here but still, very little respect in the eyes of the US Consumer!

reply to this comment

chewy - 3/5/2007 9:49:25 PMView My AgentSpace

0 Boost

Go true delta.

reply to this comment

To post a comment for this story, you must first Login.

If you do not have an account, you will need to Register (It's Free!).

Most Recent Stories

Honda And Acura Top Redisdual Value Rankings The Most BRILLIANT Idea Yet On The Bailout! Should The Oil Companies Foot The Loans To Help The Auto Industry?Diamond-crusted Lamborghini key fob by Amosu Luxury 2008 LA Auto Show: Honda Insight Concept introduces Ecological Drive Assist System Has BMW Found The Diesel Solution With The 335d?Are We Being Fair? US Automaker Bailout Raises WTO Legality Concerns WEB RAGE FRIDAY RETURNS! Be Loud And Proud And Vent Your Gripes Now!House Speaker Takes The Bankruptcy Option Off The Table For The Detroit 3 GM Returns 2 or 7 Corporate Jets After Whipping Shed Moment In Washington Car Driver Names Its Top 10 But Is Your Favorite On The List?Volkswagen Jetta Diesel Wins 2009 Green Car of the Year Law Makers Approve Short Term Bailout With Conditions Jaguar XF Cabrio to debut at the 2009 Detroit Motor Show in January LA 2008 Live: 2010 Cadillac CTS Sport Wagon is here even though its delayed LA AUTO SHOW: More Goodies For The Eyes From The Show Floor In The City Of Angels Official: 2009 Porsche Cayenne Diesel unveiled and priced at €47,250 Volkswagen Touareg TDI Trophy Truck unveiled in LA Last Ditch Deal With Automakers May Get Approval- But Can They Be Trusted?GMAC Files For Banking Status In Effort To Access $700 Billion Bailout Package Vw Touareg V6 TDI priced at $42,800 Saab 9-6x patent photos LA AUTO SHOW: The All New RX, The Bread And Butter Crossover/SUV Makes Its Grand Entrance Audi Sees Dual Clutch Transmissions Making Into 90% Of Lineup In Near Future Mitt Romney Makes An Open Call To Let Detroit Go Bankrupt LA AUTO SHOW: Infiniti's G37 Convertible Officially Hits The Road Congress Takes The Detroit 3 To The Whipping Shed And They STILL Have No Clue Why!Jaguar XF coupe and convertible receive the greenlight LA AUTO SHOW: 2009 Bentley Azure Tunveiled LA AUTO SHOW: 2009 BMW 750 Li gets iDrive powered owner’s manual LA AUTO SHOW: 2009 Nissan 370Z pricing announced 2010 Nissan GT-R No Longer with Launch Control LA AUTO SHOW: First Day Recap Highlights From The Show Floor-Some Sweet Stuff!LA 2008: Honda surprises with FC Sport fuel cell sports car concept LA AUTO SHOW: Toyota's New CNG Powered Hybrid Camry Is A Gas LA AUTO SHOW: Mazda 3 Compact Sedan Gets A Re-do And Will Be The Future Underpinnings For The Next Ford Focus. THANK GOD!LA AUTO SHOW: Nissan's Iconic 370z Gets Edgy With This Redo Audi's Q7 and A5 Both Take KBB Top Resale Value Honors How About The Full Scoop On BMW's New 7 Series Hybrid!German Company Offers GM $1.3 Billion To Buy Opel And Turn It Green Ford of Europe to remain profitable in 2009, says CEO Detroit Three Beg For Money From Congress After Arriving In Corporate Jets 2009 Porsche Cayman and Boxster facelift unveiled in Los Angeles Jaguar Leads The Pack In Latest Sales Satisfaction Index 2010 Ford Mustang Live Reveal at Santa Monica Airport (Video)LA AUTO SHOW EXCLUSIVE STUD OR DUD? Did Infiniti One Up BMW's 3 Series Cabrio With The G37 Convertible?LA Auto Show Preview: Lamborghini Gallardo LP 560-4 Spyder 2010 Nissan Cube Revealed: Coming to U.S. in spring 2009 2010 Mercury Milan & Mercury Milan Hybrid Launched in L.A.2010 Ford Fusion Facelift Breaks Cover 2010 Toyota Prius US production in danger?

More Recently Added News

Join AutoSpies

Photo Galleries

AutoSpies presents the best Auto Show Photos, Automotive Videos, Car Reviews and Hot Rides.

Latest Galleries

Cars

Auto Shows

More Galleries