Housekeeping - A Word About Product Reviews

Since the early beginnings of this site I've enjoyed writing product reviews. Whenever I go back and look at the monthly stats I always find that product reviews rate the highest of all articles. There's lots more to cycling than product reviews, but they are something I enjoy and the stats indicate that you find them useful and/or interesting. Our job is only to plant the seed, and your comments along with your experiences is what really adds value.

Unfortunately people have come to distrust product review and feel that they’re paid advertisements. Personally, I feel that if I don’t have credibility with product reviews, I don’t have anything left at all. The reader’s voice is much louder than mine, so it keeps me as honest as I can be. That’s not to say that conflicts never arise, but I do my best to put discosure statements whenever I feel necessary.

I’ve taken steps to ensure that any advertiser relationships are kept completely separate from most of the product reviews on this site. As most of you know I’ve hired Matt Wikstrom as the Tech Editor of CyclingTips (Matt does not get paid). I let him choose the products he wants for reivew write whatever he feels. Sometimes an advertiser will ask for a review and I will often oblige if I feel that it will be of interest to you. On the other hand, sometimes I go asking brands for their products to be submitted for review if I think it’ll be of value to you. We always expect to send back the product to the distributor, but sometimes with small items they allow us to keep it. It’s never expected, but a very nice gesture.

The other step I’ve taken which I’m hoping will gain traction is adding “user reviews” to most of the products we review. We allow owners of a product to login and rate the product against the same criteria as the reviewer did (as well as a text review to make it more complete). I feel that this is where the true value in the product review will lay. If you don’t trust the review, simply look at the owner reviews (see this Garmin 800 example). Give it a shot and let me know what you think. If it catches on, we’re onto a winner.

Unfortunately the conversation in most of the product review posts have descended into criticisms about the review procedure or wording, accusations on conflicts of interest, or feelings about the reviews being paid. I’ll never please everyone, but I’ll have to begin deleting these comments from now on because they do not add any value to the review itself. You’re more than welcome to email me directly if you have any concerns and I’ll be sure to respond. As always, you’re more than welcome (and encouraged) to leave comments with constructive feedback and criticism with regards to your thoughts and experiences on the product.

I’ve taken these steps becuase I want CyclingTips to be a place where you can come for trustworthy reviews. If I haven’t achieved that, I’ve failed miserably. Please feel free to make suggestions on how we can do this better. Thanks for reading.

Tags: product reviews

http://profiles.google.com/aglogan Andy Logan

Great post Wade and FWIW I enjoy reading the Product Reviews and take what has been written at face value, as to me anyway you have demonstrated time and again that you’re trying to do what is best for the readers of the blog and to ensure you retain the credibility you have built.

Unfortunately there will always be haters and skeptics, but the User Review definitely help give another level of credibility as well.
Mars

Hey Wade,

You’re right you won’t and can’t please everyone. I think it says more about the poster of such comments and in particular if they haven’t worked it out yet, they never will.

Please keep product reviews coming! I don’t care if it is a pair of pink socks from the pink fairy, something from Rapha, Gaerne, Parlee or other, I enjoy reading the reviews which are an opinion that we can take on face value.

So hurry up with the next product review please (yes I am about to read the madfiber one now).
Bennyfrenny

just a little tragic that it has gone this far. Nice move, more gracious than I would have been
Bennyfrenny

just a little tragic that it has gone this far. Nice move, more gracious than I would have been
Erich (Brazil)

That’s why I love reading this site: You can see how carefully it is made, in every aspect… Congrats, Cyclingtips!!! Another great move from one of the best cycling sources on the entire web!
- http://www.cyclingTipsBlog.com cyclingTips
  
  I should add that many other publications have very credible reviews and do a solid job at separating advertising from their reviews. Its not as bad as many people think.
  - Anonymous
    
    Considering many professional association magazines offer editorial places for those who spend enough on advertising and dont disclose it you are a long way away from every losing credibility.
    
    It seems a bit rich to try and create some fantasy gold standard and hold a blog ran administrated by one guy when most newspapers and news outlets turn our PR releases as news.
    
    Keep up the good work mate. Just remember those who post complaints are the minority.
  - Erich (Brazil)
    
    Yeah, I know and I read a lot of them, but Cyclingtips is definitely one of the best cycling blogs out there man! Congrats! keep up with the great job!
- http://www.cyclingTipsBlog.com cyclingTips
  
  I should add that many other publications have very credible reviews and do a solid job at separating advertising from their reviews. Its not as bad as many people think.
Pete

Well Said.
pedr09

Not an unexpected post Wade. Had to be done. I really don’t know what some people think goes on behind the scenes of sites like this one. FFS, if you’ve spent more than 15 minutes reading posts here, you’d know where you and your contributors are coming from and how you approach things. The product reviews are always welcome reading and I take them exactly as they come. To those cycling gods out there who either can’t process what’s being presented here, are simply too knowledgeable to put up with anything less than a thesis on every product, or both… I’ll let Ari Gold do the talking - http://www.youtube.com/watch?v=sGz3uyCNZCM
pedr09

Not an unexpected post Wade. Had to be done. I really don’t know what some people think goes on behind the scenes of sites like this one. FFS, if you’ve spent more than 15 minutes reading posts here, you’d know where you and your contributors are coming from and how you approach things. The product reviews are always welcome reading and I take them exactly as they come. To those cycling gods out there who either can’t process what’s being presented here, are simply too knowledgeable to put up with anything less than a thesis on every product, or both… I’ll let Ari Gold do the talking - http://www.youtube.com/watch?v=sGz3uyCNZCM
Jii

Enjoy your reveiws, enjoy the site, enjoy the photo collections and love that you are getting paid to do it. Would have made the same comment on the photo journal of the cup weekend ride except the comments were closed.
A vociferous minority can disguise a happy or approving majority. Never more so than on the internet where the effort required to air your discontent is ever so low.
http://twitter.com/man_thom Manning Thomson

Ahh the internet, giving stupid people a voice since circa 1990
Keep up the good work Wade and ignore the idiots
- Ben from SA
  
  my sentiments exactly, jealously is a nasty thing, and the whingers are often green with envy
Steel

Funnily enough, after reading CTech’s review of the bib knicks about a month back and the subsequent torrents of user support for the Assos Milles, I went out bought a pair ($185 at Assos South Melbourne - cheaper than Wiggle/CRC!) Very very comfortable and a big step up from my usual Santinis. This demonstrates perfectly how the user/expert review should work in my opinion.

Anyway - Wade you’re just one email to media watch away from Allan Jones/John Laws territory. REMEMBER THAT ;)
- lefthandside
  
  You should follow it up with a user review on the bib knicks review site ;)
  - http://profiles.google.com/aglogan Andy Logan
    
    I will be doing this for the Rapha Pro Bid Shorts as well, because I have been sent a pair (and pro team jersey) as a Christmas Present and for the tall riders out there, I am 6’4 so will be reviewing the extra long ones as well.
Peoplearelosers

Tall poppy syndrome ….. some people just can not stand your website being popular whilst their’s has failed.

It was technically your “blog” to get people together, if they dont like it then they can go elsewhere.

I personally dont care who you work for, who you ride with, what relationship you have…. i just want to read :)
Notso Swift

I have only been reading for about 2.5 years an posting maybe 2 but I think most people who have read the site would know there is no problem. Besides if you take what one site says as gospel you deserve to get an invitation from a great deal where a respectful Nigerian friend will send you $10 Million if you just loan him a couple of thou’ until funds clear

Do we have to create a new login for the reviews?
My old one didn’t seem to work or is that because of me security settings
Guest

Cyclingtips staff are doing a great job including the reviews, keep up the good work.
Michael in Sydney

Wade

I saw some of the comments that may have inspired(?) this post and I thought a) they had not actually read the reviews and b) get a life. This blog is the only one that I regularly read and like the other who have comment here I know that there are no other agenda in place just desire to share information and knowledge.
Gezzalenko

I actually thought that guys comment was fair enough, given his perspective (he might be new to the site, or, he might not have understood CT review’s genesis). He did make a fair point about wanting more of a “review” rather than a “price, colour, aesthetics”.

Where it got personal was about the “paid reviews” I suppose.
http://www.cyclingTipsBlog.com cyclingTips

Thanks guys. I definitely don’t expect praise all the time and have thick enough skin to take criticism. I usually learn from it. One of the many things I enjoy about this platform is that I can have direct dialogue with everyone and keep everything in the open.
- scano
  
  Perhaps you could do a live press conference next time Wade?
  - http://www.cyclingTipsBlog.com cyclingTips
    
    I’d be the only one there
Mike

All covered above, but I second it all - especially the comments about jealousy/envy.

FWIW I don’t read the reviews with a view to possible purchase ‘cos much of the stuff is all too pricey, fancy or racey for my type of riding - but I do like to see what better/keener riders go for and what the latest developments are as a lot of it trickles down in subsequent years, and it all adds to the enjoyment of following cycling as a sport as well as just a recreation. Much like following the mechanical details of F1 cars might enhance your enjoyment of following motor racing.

So keep it up !! ;)
jules

can i offer a suggestion to readers on one way to tell the difference between paid promotions and an independent review?

paid promotions are typically written in a deferrential tone towards the product, using lots of superlatives. kinda obvious, but moreso - they often avoid objective analysis on the product, focussing instead on the “feelings” the product evokes in the reviewer, e.g. “i’ve never felt so alive as when i rolled out of the driveway on Brand A wheels” etc.

proper, independent reviews focus as much as possible on objective criteria - weight, structural matters (e.g. type of carbon), warranty, etc. you can’t lie about that stuff. or you can, but you will probably be caught.
Chris Dunbar

My only criticism, and it is a big one, is that I can’t buy a CT kit!
J-Lo

Personally, I see a big difference between the monthly “product picks” posts, and ones like the knicks review (or the posts dedicated to a single product). The knicks review post was fantastic, there was direct comparison between similar products - listing pros and cons of each, and lots of user feedback btl. The “product pics” posts seem to be a quick review of whatever you’ve been sent, which could read more like paid promotions (but only if you’re squinting). Why not stick to one type of product per post. If you’re going to review a bottle cage, wait until you’ve got a bunch, then compare them.

Otherwise, ignore the haters. This is a great blog.
- http://www.cyclingTipsBlog.com cyclingTips
  
  Hi Joe, thanks for the feedback. With regards to your question about the Product Picks, I’d love to be able to wait for a bunch of bottle cages (for example), but it could be a year and then the “new thing” won’t be so new anymore. We can’t really take the time and effort to post a feature article about a bottle cage (the reason other sites do this is because it gets more pageviews rather than putting up a few products at a time - but I don’t play that game). I think the product picks provides a nice platform to showcase what people have sent us throughout the month.
  - J-Lo
    
    Yeah that’s fair enough. I just get more out of the comparison reviews, as the product picks make you beholden to whoever is pushing their latest product.
    
    Anyway, its only a very small issue in what is otherwise a fantastic site.
Andrew

Like I said a few days ago I believe that it is best to do your own research and enjoy how that develops. If CT sows the seed of curiosity to go further then job done. We are all big boys/gals here and should be able to make up our own minds independently, A few years ago I was looking to a deeper cross section wheel and started out looking at the clincher options. Over a period of time I talked to shops. WW s etc and became more convinced of a tubular path. Then the next dilemma was the brand as I am a heavier rider. It took about 12 months of discussions and frustrations to finally arrive at Enve. Was a fascinating research and completely worth it and ended up with a wheel in my opinion only is ideally suited to my needs. No one else can make decision for you. Keep banging the reviews in I say, well done
Kim B

Criticism is standard practice everywhere. Put something out there and criticism will arrive unsolicited and sometimes unintended. As for Cycling Tips I have found it like eye candy for cyclist and the content as good and better than anywhere else, including magazines. It provides relevant links up to date information from the international cycling community. As for the product reviews, as a relatively new cyclist I want your opinions (which include bias) to influence my understanding. If I do not like what you have to say I will change to another site or get another opinion. If I go into a shop and ask for a product review what do I get…… Your site is way better than good it is world class. Every time I see one of the reviews, articles or new bit you have added it adds to my positive opinion of this site and the way it engages with us the users, viewers, community, subcribers or what ever it is we are called. Your site is a great body of work for people interested in cycling and a fantastic showpiece for cyclist everywhere. Reviews, comments, ideas, opinions keep em rolling in
Cummquott

Keep that CT Kit exclusive Wade….when do I get mine?
http://twitter.com/Dan_McIlroy Daniel McIlroy

This is a blog, by its very nature is one person’s opinion. You want cold hard facts, go to the manufacturer’s website, no info there? Email them and ASK!

All you need to do - on this site - is read the “about” page before you read a single other thing. Get perspective and context, and read with that in mind. Any time a conflict of interest (perceived or real, mainly perceived) has come up, Wade has been at pains to address it… I know what i’m getting on this site, and honestly, it is probably the first site I come to for cycling info.

But it is the internet, and as the meme goes… “Haters gonna hate”

or perhaps more appropriately for the subject matter… “they see me rollin’, they be hatin’”
Dr Ferrrari

Why does everyone have to be so opinionated? Why cant they just take the damn blood transfusion and be greatful?
- jules
  
  it’s just like orange juice!
Dr Ferrari

But it’s so much better!
Marco he never complained!
Harry Butcher

The issue is that everything is easy when you see somebody else doing it. Its easy to criticise and tell you how to improve what your doing however 99% of the criticisers wouldn’t know the first thing about running a website and all the logistics involved in compiling the articles, photos and other information that you bring to us. Without a doubt, this is one of the best sites and is my most commonly visited cycling site.

If I wanted to be critical I could say that I wish there were more articles (because I am greedy and love the way your team presents its work) however I realise whats involved in bringing us what you do and appreciate all the time and effort involved so I am grateful for what you provide me free of charge.

Keep up the good work!!