For Better or For Worse, Twitter.

Honestly, I don’t know if it’s a good thing that the vast majority of my thoughts come in little snippets no longer than 140 characters at a time, but it seems to be the case.

I can’t promise every one (or even necessarily most) of my tweets will be about the mess that is market research these days, but for better or for worse, it’s where I mostly am. I’ll of course continue to post longer items here when the mood strikes me, but if you’re not following me there, you may want to.

Feeling the Urge…

I’m feeling the urge to get back at this. Going to try to sit through some Toluna research today, see if it’s any better than the last time I looked, and then report back with some dire pronouncements about the future of market research.

Though I basically just said it in the comments on Ray’s excellent post.

Carry on; I’ll be along presently.

Follow me on Twitter!

All the cool kids are doing it, you know.

Tweets by researchrants

I predict I’m going to have trouble deciding what’s blog-worthy and what’s just twitterable, but I’ll get it eventually. (And thanks to everyone who mentioned me on Twitter over the past couple days; it’s what got me to get moving on this.)

A beginning is a very delicate time.

Welcome.

Where and how do we begin?

I’ve been working in the research industry for about fifteen years. My career path did not travel a straight line, and my undergraduate degree is in another field. I have no graduate degree. My professional experience comes under the tutelage of others who similarly were trained outside of the ivory towers of academic polling. I’ve learned and improved by doing. I’m not in any way a math or statistics expert. I haven’t done regression analysis or chi-square tests since college.

To some of you, I’ve just disqualified myself as a researcher and critic. That’s a shame, because you’re probably the most in need of the following advice:

Hire someone who knows how to use words effectively, and let them edit your surveys down to their core. (That person, by the way, probably isn’t currently a researcher. That’s OK. It’s much easier to teach someone how to write good questions than it is to teach them to write in the first place.)  Stop asking the same question six different ways; ask it once — correctly — and move on. Stop abusing your respondents by subjecting them to telephone surveys that go on forever and web panel studies that present page after page of matrices that practically beg respondents to click random choices just to get it over with.

It drives me crazy that so much of the research I see is so very bad. The reasons vary, but the outcome is the same — frustrated respondents and unreliable results.

My purpose here is simple — to display instances of what I consider to be bad research in the hope that we all can learn by example and improve. Some of what we’ll see is flat-out awful; other examples will be less egregious. There also are, of course, researchers who are doing great, innovative work, and I hope to hold some of that up as examples of what we all should be aiming for.

The better we make our questions — the better job we do of survey design — the better our results will be. I hope this blog can become a home for what I see as a movement — the movement to make our research instruments more friendly to respondents, which in turn will make our data better.