Better Product Managers, and Product Management

Archive for the ‘Learning’ Category

FAQ: Customer Development for Product Managers

What is customer development?

Customer development is the opposite of product development, or “if we build it, they will come” thinking.   We all know that’s not the case – often you build it, and no one cares.

The idea is to validate that you have a market, with problems, that they’re willing to pay to solve — and then build something that solves those problems.   The emphasis is on learning and discovery before you write a 50-page spec or spend months writing code. Read Eric Ries’ post  What Is Customer Development for a lot more detail.

“This doesn’t sound like anything new,” you may be thinking, and you’re pretty much right.   There are plenty of examples of successful companies who used interviews and cheap prototypes to validate ideas before committing to building them.

What has changed is the availability of free/cheap tools and direct access to customers through social media, making it more practical for an individual product manager to do this on their own, on a skunkworks basis even.

But asking the customer what they want never works –

I know.  Customers tend to ask for “me-too” features, or they ask for something and then after you build it, say “I know we asked for this, but it isn’t what we really wanted.”

Customer development isn’t asking customers what they want – it’s seeking to understand what they need, how they work, where their pain points and highest priorities are.  Customers may not be able to articulate what they want, but they can’t hide what they need.

What will I learn?

The short answer: how people are really getting a task done, who is doing what, and why it sucks.

The more detailed answer: What you should be learning from customer development interviews

How is this different from usability testing?

Usability testing teaches you whether or not people are capable of using your product; it doesn’t tell you how likely they are to actually buy it.

In usability testing, you learn about the product you’ve already built.   If your product hypothesis was wrong, it’s kind of too late to do much about it.  In customer development, you learn about your customer before you build the product.  That way, if your product hypothesis is proven wrong, you can change course quickly without having wasted resources and time.

How long will it take?

I don’t know.

Sorry, but that’s the truth.  I can’t guarantee that this methodology will get you useful answers in two days or two weeks.  I can guarantee that you’ll start learning useful new tidbits from your first customer interview, but it may not be something actionable.

At KISSmetrics, I quickly learned that the reason so many companies loved our Survey.io customer development survey is that “I don’t have to write anything – you tell what I should be asking and how to ask it”.

People don’t like to write – in fact, they’ll put off a task if it requires them to think and write something.  That was a good insight, but not enough (on its own) to drive any new product decisions.  We needed more of those insights before they added up to something we could base a product on.

For this reason, customer development needs to be a process — not a project.  Always be listening, always be asking why, and always be testing hypotheses, and it will pay off.  You just never know when.

How do I get started?

If you already have existing customers, reach out to one today and schedule some time to talk with them about how they get their jobs done.  Ask about how they use your products, but also take a step back and ask about the general task that your product is supposed to help them with (i.e. if your product is a bug tracker, ask them about QA testing in general).

You don’t have a hypothesis to test (yet), so this is just an open-ended conversation.  Let the customer talk.   The Evolution of the Customer Development Interview has good tips.

You may be at a company who has existing products and customers, but you don’t have access to them.  As insane as this is, it’s not uncommon to try and lock the product managers up in a little room to wrangle up requirements somehow.   The fastest way to get access is probably to bargain directly with sales.

Ask to join them on a sales visit or conference call.  Offer to help with demos.  If you have to promise to be a “fly on the wall” in order to make them feel comfortable, do it.    In my experience, customers love having a product manager in the meeting – they feel like you’re an ally who isn’t just trying to sell them — and as a result, they’re often MORE likely to buy.  (Tell your salesfolk that.)

How can I find customers before I’ve even built a product?

How were you planning on finding them after you’ve built a product?

Seriously, this is the million-dollar question, and the answer is not “we’ll build it and they’ll come” or even “we’ll advertise a LOT” — unless you’re Apple, Microsoft, Google, or Facebook, you don’t have the dollars or distribution to make those work.

So you have to get creative.   I’ve previously written about how to find prospective customers using methods that take less than $20 and a couple days.

How do I convince my boss that this is a good use of my time?

Unless your boss is already a devotee of Toyota Lean Manufacturing processes or Four Steps to the Epiphany, start out skunkworks style. Remember, bosses like solutions, not problems.  Don’t say “we need to be doing X”, figure out how it can be done and prove the benefits.

Carve out some time, do some customer interviews.  Work with a designer to throw together a fake splash marketing page for a new product and get feedback.  Once you’ve learned something useful, use that to get buy-in for making this a permanent part of your process.

How does this change when I have an established brand and customers?

You may need to create somewhat more polished splash pages/demos in order to not hurt your credibility.

You may also feel more comfortable testing concepts without connection to your company name.  Using another domain name is a good option and worth the time to set up if you’re going to be running experiments frequently.  But you can go even simpler and use tools like shared Google docs (create a new Google account that isn’t linked to your name) or Skitch to post screenshots privately.

Where can I learn how to do this?

Books:

Blog posts:

People to follow on Twitter:

User Testing Tactics (The Gory Details You Usually Have to Learn the Hard Way)

You know you have to do user testing, but how exactly do you get started?

I’ve run enough user testing sessions on a shoestring budget to know a lot of the gory little details, and yesterday I shared a bunch of them with the startups over at the fbFund incubator.

Why Not Online Testing?

Online user testing tools are cheap, and it’s tempting to think that you can get insight without having to figure out what to say to people face-to-face.  But the numbers can hide a lot – if a user successfully completes your face, but they have their face scrunched up in tension the whole time, or they’re cursing you under their breath – that’s critical detail that you’re missing.

The Crazy Guy

You usually get one “crazy person” per 7-8 person group.  You probably want to write that in your notes – “crazy guy” – so you can keep that in mind when reviewing his comments.  On the other hand, if three other people agree with the crazy guy, they probably all have a valid point.

“I Just Don’t Know What to Do Next”

If a user “freezes” and says they don’t know what to do next, resist the temptation to jump in and help.  Remember, you’re playing the neutral moderator, so you don’t take it personally.  Instead, ask what they would expect to do next.  It’s surprising how often you’ll hear something like “Well, I was expecting to see a button that said Pay Now, but all there is here is a link that says Enter Credit Card Information.  I don’t want to click it because I’m not sure…”

3 Experiments On This Blog

  1. BackType Connect I’ve been using the BackType Connect plug-in for the last couple of weeks to aggregate comments about blog entries (including tweets and comments posted on other blogs) and show them here.  I’ve been very happy with the results – showing a comment or two right away has really served to break the ice and get more people talking here.

       I really admire their general model of “don’t try to change the user behavior, work with it.”  I know my readers won’t spend all of their time here when there’s Twitter, Facebook, other blogs, and other sites – but we can all still benefit from pulling those conversations together in one place.

  2. Guest Posting I wrote my first guest post last week for SearchEnginePeople, and will definitely do that again.   Writing for a new audience was a nice change, and it forced me to be more clear with my thinking.  Add to that exposure to a brand-new audience and new interesting people to follow on Twitter, and it was a big win.

  3. Do Follow On As of today, links in my comments do not have the “nofollow” attribute enabled.   Nofollow means that Google ignores the presence of links on my site if they appear in my blog comments.   Search engines assume that the blog author doesn’t necessarily “endorse” the links placed in the comments, so No follow is the default for comments on WordPress blogs.

      However, the vast majority of my comments come from the Product Management and User Experience communities, from smart people that I do endorse.  So I’ve installed the NoFollow-Free plug-in which means that the readers who comment will be rewarded with some extra SEO love.  My spam filters have done a pretty good job so far, so I’m hopeful that I won’t have to disable this due to comment spam abuse.

10 Books To Make You A Better Product Manager

These are not books that tell you how to do product management. Rather, these books are full of ideas that will challenge you to work smarter, communicate better, and get in the heads of your users. Read them, share them with your cross-functional teams, and put them into practice.

  1. Crossing the Chasm: Marketing and Selling Technology Products to Mainstream Consumers by Geoffrey Moore

    Crossing the Chasm
    Realization: You can get early customers to love your product, but you can’t use those same methods to convert enough more people into customers to build a business.

    Things to remember: As a startup, you can’t do multiple things well. As a business, you need to focus on the most desperate needs of your customer (which means you must choose your the customers who have desperate needs.)

  2. Blue Ocean Strategy: How to Create Uncontested Market Space and Make Competition Irrelevant by W. Chan Kim and Renée Mauborgne

    Realization: You don’t need to compete on the same features and benefits that your competitors value.

    Things to remember: Don’t take the vectors you compete on for granted. Map yourself against the competition. Explore what would happen if you changed things.

  3. Four Steps to the Epiphany by Stephen G. Blank

    Four Steps to the Epiphany
    Realization: This is your job: First, reduce risk. Next, prove value. Continuously validate. Don’t try to skip any of these steps.

    Things to use: Clear checklists for how to create a market, and a product and get customers. If any of your plans require outlaying tons of money and resources up-front, you’re probably wrong.

  4. The Inmates are Running the Asylum: Why High-Tech Products Drive Us Crazy and How to Restore the Sanity by Alan Cooper

    Realization: Technology products need someone advocating for the user, and that someone is not going to be the engineers who build them.

    Things to use: If you’re in an organization where user experience design is nonexistent or under-empowered, this book lays out examples to help the product manager to step in as user experience advocate until the permanent resource is in place.(Can be heavy-handed and most of the examples are outdated, but still a great read.)

  5. The Innovator’s Dilemma: The Revolutionary Book that Will Change the Way You Do Business by Clayton Christensen

    Realization: Listening to your customers works great for releasing new product versions… until it doesn’t. You can’t predict where markets will emerge.

    Things to remember:The key to your success will, in the short term, be incredibly destructive. In short: stay on your toes and be ready to experiment on barely-formed ideas rather than waiting for them to fully form.

  6. Getting to Yes: Negotiating Agreement Without Giving In by Bruce M. Patton, William L. Ury, and Roger Fisher

    Realization: Negotiating instead of giving in doesn’t make you mean, it makes you effective.

    Things to remember: People want to feel heard and understood more than they need to ‘win’ in most situations.

  7. Freakonomics: A Rogue Economist Explores the Hidden Side of Everything by Stephen J. Dubner OR Predictably Irrational: The Hidden Forces that Shape our Decisions by Dan Ariely

    Predictably Irrational
    Realization: People generally don’t understand cause-and-effect, don’t behave rationally, and worry about the wrong things.

    Things to remember: You (and your coworkers fall prey to the same competitive traps that your users do, but knowing this can help you avoid them.(Both books are good, but you probably don’t need to read both unless you’re a psych/socio hobbyist.)

  8. Why Decisions Fail by Paul Nutt

    Realization: Really smart companies and people make decisions that seem ridiculous in hindsight.

    Things to remember: Recognizing potential problems can help you avoid them. If it’s too late for that, a more informed postmortem leads to better learning for next time.

  9. Super Crunchers: Why Thinking by Numbers is the New Way to Be Smart by Ian Ayres

    Realization: Nothing measures user behavior better than … measuring user behavior. Online, everything is measurable.

    Things to remember: Make sure what you’re measuring is as close as possible to the results you want. As I’ve said before, make sure you I your KP. Remember that your competitors probably have more data than you do and be appropriately concerned about that.

  10. The Creative Habit: Learn It and Use It for Life by Twyla Tharp

    The Creative Habit
    Realization: Creativity doesn’t just happen, it requires hard work and tons of practice.

    Things to remember: Staying out of bad habits and ruts is a constant process.