You are previewing Running Lean, 2nd Edition.

Running Lean, 2nd Edition

Cover of Running Lean, 2nd Edition by Ash Maurya Published by O'Reilly Media, Inc.
  1. Running Lean: Iterate from Plan A to a Plan That Works
  2. Dedication
  3. Praise for Running Lean, Second Edition
  4. Foreword
  5. Preface
    1. Safari® Books Online
    2. We’d Like to Hear from You
    3. Attributions and Permissions
  6. Introduction
    1. What Is Running Lean?
      1. Why Are Startups Hard?
      2. Is There a Better Way?
      3. What Will This Book Teach You?
      4. Is This Book for You?
      5. How Is This Book Organized?
    2. About Me
      1. Why This Book?
      2. Field-Tested
    3. Disclaimers
      1. Practice Trumps Theory
      2. There Are No Silver Bullets
  7. I. Roadmap
    1. 1. Meta-Principles
      1. Step 1: Document Your Plan A
      2. Step 2: Identify the Riskiest Parts of Your Plan
      3. Step 3: Systematically Test Your Plan
    2. 2. Running Lean Illustrated
      1. Case Study: How I Wrote Iterated This Book
  8. II. Document Your Plan A
    1. 3. Create Your Lean Canvas
      1. Brainstorm Possible Customers
      2. Sketching a Lean Canvas
      3. Now It’s Your Turn
  9. III. Identify the Riskiest Parts of Your Plan
    1. 4. Prioritize Where to Start
      1. What Is Risk?
      2. Rank Your Business Models
      3. Seek External Advice
    2. 5. Get Ready to Experiment
      1. Assemble a Problem/Solution Team
      2. Running Effective Experiments
      3. Applying the Iteration Meta-Pattern to Risks
  10. IV. Systematically Test Your Plan
    1. 6. Get Ready to Interview Customers
      1. No Surveys or Focus Groups, Please
      2. But Talking to People Is Hard
      3. Finding Prospects
      4. Preemptive Strikes and Other Objections (or Why I Don’t Need to Interview Customers)
    2. 7. The Problem Interview
      1. What You Need to Learn
      2. Testing the Problem
      3. Formulate Falsifiable Hypotheses
      4. Conduct Problem Interviews
      5. Do You Understand the Problem?
    3. 8. The Solution Interview
      1. What You Need to Learn
      2. Testing Your Solution
      3. Testing Your Pricing
      4. Formulate Testable Hypotheses
      5. Conduct Solution Interviews
      6. Do You Have a Problem Worth Solving?
    4. 9. Get to Release 1.0
      1. Product Development Gets in the Way of Learning
      2. Reduce your mVP
      3. Get Started Deploying Continuously
      4. Define your activation Flow
      5. Build a Marketing Website
    5. 10. Get Ready to Measure
      1. The Need for Actionable Metrics
      2. Metrics Are People First
      3. Simple Funnel Reports Aren’t Enough
      4. Say Hello to the Cohort
      5. How to Build Your Conversion Dashboard
    6. 11. The MVP Interview
      1. What You Need to Learn
      2. Formulate Testable Hypotheses
      3. Conduct MVP Interviews
    7. 12. Validate Customer Lifecycle
      1. Make Feedback Easy
      2. Troubleshoot Customer Trials
      3. Are You Ready to Launch?
    8. 13. Don’t Be a Feature Pusher
      1. Features Must Be Pulled, Not Pushed
      2. Implement an 80/20 Rule
      3. Constrain Your Features Pipeline
      4. Process Feature Requests
      5. The Feature Lifecycle
    9. 14. Measure Product/Market Fit
      1. What Is Product/Market Fit?
      2. The Sean Ellis Test
      3. Focus on the “Right” Macro
      4. What About Revenue?
      5. Have You Built Something People Want?
      6. What About the Market in Product/Market Fit?
      7. Summary
    10. 15. Conclusion
      1. What’s Next?
      2. Resources
  11. A. Bonus Material
    1. How to Build a Low-Burn Startup
    2. Why Premature Fundraising Is a Form of Waste
    3. How to Achieve Flow in a Lean Startup
      1. The Conflicting Pull for Time
      2. Creating Daily Flow
      3. Creating Weekly Flow
      4. Eliminating Software Waste
    4. How to Set Pricing for a SaaS Product
      1. What About Freemium?
      2. The Problems with Freemium
      3. How to Approach Freemium
    5. How to Build a Teaser Page
      1. How to Write a Sales Letter
      2. How to Create a Teaser Landing Page
    6. How to Get Started with Continuous Deployment
      1. Commit
      2. Test
      3. Deploy
      4. Monitor
    7. How to Build a Conversion Dashboard
      1. How to Collect Data
      2. How to Visualize Your Conversion Dashboard
      3. How to Track Retention
  12. Index
  13. About the Author
  14. Copyright
O'Reilly logo

Chapter 1. Meta-Principles

The proper application of any methodology first requires a clear understanding and separation of principles from tactics.

Principles guide what you do. Tactics show you how.

The essence of Running Lean can be distilled into three steps:

  1. Document your Plan A.

  2. Identify the riskiest parts of your plan.

  3. Systematically test your plan.

In this chapter, we’ll cover these meta-principles. The rest of the book will focus on the reduction of these meta-principles to practice.

Step 1: Document Your Plan A

There Is an “I” in Vision

All men dream: but not equally. Those that dream by night in the dusty recesses of their minds wake in the day to find that it was vanity: but the dreamers of the day are dangerous men, for they may act their dreams with open eyes, to make it possible.

T.E. Lawrence, “Lawrence of Arabia”

Everyone gets hit by ideas when they least expect them (in the shower, while driving, etc.). Most people ignore them. Entrepreneurs choose to act on them.

While passion and determination are attributes that are essential in order to drive a vision to its full potential, if they are left unchecked, they can also turn the journey into a faith-based one driven by dogma.

Reasonably smart people can rationalize anything, but entrepreneurs are especially gifted at this.

Most entrepreneurs start with a strong initial vision and a Plan A for realizing that vision. Unfortunately, most Plan A’s don’t work.

While a strong vision is required to create a mantra and make meaning, a Lean Startup strives to uphold a strong vision with facts, not faith. It is important to accept that your initial vision is built largely on untested assumptions (or hypotheses). Running Lean helps you systematically test and refine that initial vision.

Capture Your Business Model Hypotheses

Too many founders carry their hypotheses in their heads alone, which, though the fastest way to iterate, only helps to further support their own “reality distortion fields.”

The first step is writing down your initial vision and then sharing it with at least one other person.

Traditionally, business plans have been used for this purpose. But, while writing a business plan is a good exercise for the entrepreneur, it falls short of its true purpose: Facilitating conversations with people other than yourself.

Additionally, since most Plan As are likely to be proven wrong anyway, you need something less static and rigid than a business plan. Taking several weeks or months to write a 60-page business plan largely built on untested hypotheses is a form of waste.

Waste is any human activity which absorbs resources but creates no value.

James P. Womak and Daniel T. Jones, Lean Thinking (Free Press)

My format of choice is to use the one-page business model diagram (Lean Canvas) shown in Figure 1-1.

Lean Canvas

Figure 1-1. Lean Canvas

Lean Canvas is my adaptation of Alex Osterwalder’s Business Model Canvas, which he describes in the book Business Model Generation (Wiley).[4]

I particularly like the one-page canvas format because it is:

Fast

Compared to writing a business plan, which can take several weeks or months, you can outline multiple business models on a canvas in one afternoon. Because creating these one-page business models takes so little time, I recommend spending a little additional time up front, brainstorming possible variations to your model and then prioritizing where to start.

Concise

The canvas forces you to pick your words carefully and get to the point. This is great practice for distilling the essence of your product. You have 30 seconds to grab the attention of an investor over a hypothetical elevator ride, and eight seconds to grab the attention of a customer on your landing page.[5]

Portable

A single-page business model is much easier to share with others, which means it will be read by more people and probably will be more frequently updated.

If you have ever written a business plan or created a slide deck for investors, you’ll immediately recognize most of the building blocks on the canvas. I won’t spend time describing these blocks right now, as we’ll cover them in great detail in Part II of the book.

A key point I would like you to take away for now, though, is that your product is NOT “the product” of your startup.

Your Product Is NOT “the Product”

I purposely made the solution box less than one-ninth of the entire canvas because, as entrepreneurs, we are most passionate about the solution box and what we are naturally good at (see Figure 1-2).

Your product is NOT “the product”

Figure 1-2. Your product is NOT “the product”

Dave McClure of 500 Startups has sat through hundreds of entrepreneur pitches and will probably sit through hundreds more. During these sessions, he has repeatedly called out entrepreneurs for spending a disproportionate amount of time talking about their solution and not enough time talking about the other components of the business model.

Customers don’t care about your solution. They care about their problems.

Dave McClure, 500 Startups

Investors, and more important, customers, identify with their problems and don’t care about your solution (yet). Entrepreneurs, on the other hand, are naturally wired to look for solutions. But chasing after solutions to problems no one cares enough about is a form of waste.

Your job isn’t just building the best solution, but owning the entire business model and making all the pieces fit.

Recognizing your business model as a product is empowering. Not only does it let you own your business model, but it also allows you to apply well-known techniques from product development to building your company.

If you take a step back, you’ll see that these meta-principles are nothing more than the divide and conquer technique applied to the process of starting up.

Lean Canvas helps deconstruct your business model into nine distinct subparts that are then systematically tested, in order of highest to lowest risk.

Step 2: Identify the Riskiest Parts of Your Plan

Building a successful product is fundamentally about risk mitigation.

Customers buy from you when they trust you can solve their problems. Investors bet on you when they trust you can build a scalable business model.

Startups are a risky business, and our real job as entrepreneurs is to systematically de-risk our startups over time.

Another technique taken from the Product Development playbook is that of “tackling the riskiest parts first.” Not coincidentally, for most products, the solution isn’t what’s riskiest.

Unless you are trying to solve a particularly hard technical problem (like finding a cure for cancer, building the next big search algorithm, or splitting isotopes), chances are you will be able to build your product given enough time, money, and effort.

The bigger risk for most startups is building something nobody wants.

While what’s riskiest varies across products, a lot of that risk is driven by the stage of your startup, which we’ll cover next.

The Three Stages of a Startup

A startup goes through three distinct stages, as shown in Figure 1-3.

Three stages of a startup

Figure 1-3. Three stages of a startup

Stage 1: Problem/Solution Fit

Key question: Do I have a problem worth solving?

The first stage is about determining whether you have a problem worth solving before investing months or years of effort into building a solution.

While ideas are cheap, acting on them is quite expensive.

A problem worth solving boils down to three questions:

  • Is it something customers want? (must-have)

  • Will they pay for it? If not, who will? (viable)

  • Can it be solved? (feasible)

During this stage, we attempt to answer these questions using a combination of qualitative customer observation and interviewing techniques that we’ll cover in great detail Chapter 5 and Chapter 6.[6]

From there you derive the minimum feature set to address the right set of problems, which is also known as the minimum viable product (MVP).

Stage 2: Product/Market Fit

Key question: Have I built something people want?

Once you have a problem worth solving and your MVP has been built, you then test how well your solution solves the problem. In other words, you measure whether you have built something people want.

In Part IV of this book, we’ll cover both qualitative and quantitative metrics for measuring product/market fit.

Achieving traction or product/market fit is the first significant milestone for a startup. At this stage, you have a plan that is starting to work—you are signing up customers, retaining them, and getting paid.

Stage 3: Scale

Key question: How do I accelerate growth?

After product/market fit, some level of success is almost always guaranteed. Your focus at this stage shifts toward growth, or scaling your business model.

Pivot Before Product/Market Fit, Optimize After

Achieving product/market fit is the first significant milestone of a startup and greatly influences both strategy and tactics. For this reason, it is helpful to further delineate the stages of a startup as “before product/market fit” and “after product/market fit.”

Before product/market fit, the focus of the startup centers on learning and pivots. After product/market fit, the focus shifts toward growth and optimizations. (See Figure 1-4.)

Before and after product/market fit

Figure 1-4. Before and after product/market fit

Pivot is a term used by Eric Ries to describe a change in direction of a startup while staying grounded in learning. The best way to differentiate pivots from optimizations is that pivots are about finding a plan that works, while optimizations are about accelerating that plan.

In a pivot experiment, you attempt to validate parts of the business model hypotheses in order to find a plan that works. In an optimization experiment, you attempt to refine parts of the business model hypotheses in order to accelerate a working plan. The goal of the first is a course correction (or a pivot). The goal of the second is efficiency (or scale).

This may sound like a subtle distinction, but it has a significant impact on both strategic and tactical execution. Before product/market fit, a startup needs to be architected to maximize learning.

You stand to learn the most when the probability of the expected outcome is 50%; that is, when you don’t know what to expect.

In order to maximize learning, you have to pick bold outcomes instead of chasing incremental improvements. So, rather than changing the color of your call-to-action button, change your entire landing page. Rather than tweaking your unique value proposition (UVP) for a single customer segment, experiment with different UVPs for different customer segments.

Later in the book, we’ll visit many other examples that explain how you purposely architect for learning over optimization.

Where Does Funding Fit into All This?

It’s funny to note how the 37signals folks went from “Outside money is Plan B” to “Outside money is Plan Z” between their last two books: Getting Real and Rework (37signals.com). Once you’re profitable, it’s easy to make such a declaration, but some times are certainly better than others to consider external funding (see Figure 1-5).

Ideal time to raise funding

Figure 1-5. Ideal time to raise funding

Even though you may need to raise seed funding sooner, the ideal time to raise your big round of funding is after product/market fit, because at that time, both you and your investors have aligned goals: to scale the business.

Traction is a measure of your product’s engagement with its market. Investors care about traction over everything else.

Nivi and Naval, Venture Hacks

A lot of (especially first-time) entrepreneurs feel that Step 1 involves writing a business plan/building a slide deck and getting funded. Taking several months to write and pitch a business plan to investors is not the best use of time for a startup; especially since all you have at that point is a vision and a set of untested hypotheses. Selling this to investors without any level of validation is a form of waste.

Instead, your first goal should be to establish just enough of a runway to allow you to start testing and validating your business model with customers.

While not the same thing, bootstrapping and Lean Startups are quite complementary. Both cover techniques for building low-burn startups by eliminating waste through the maximization of existing resources before expending effort on the acquisition of new or external resources.

  • Bootstrapping + Lean Startup = Low-Burn Startup

(For more, see How to Build a Low-Burn Startup in the Appendix.)

Step 3: Systematically Test Your Plan

With your Plan A documented and your starting risks prioritized, you are now ready to systematically test your plan. In a Lean Startup, this is done by running a series of experiments.

The Lean Startup methodology is strongly rooted in the scientific method, and running experiments is a key activity. We’ll cover steps for running effective experiments in Part III of the book, but for now, let’s start by defining an experiment.

What Is an Experiment?

A cycle around the validated learning loop shown in Figure 1-6 is called an experiment.

Build-Measure-Learn loop

Figure 1-6. Build-Measure-Learn loop

The validated learning loop, or Build-Measure-Learn loop, was codified by Eric Ries and describes the customer feedback loop that drives learning in a Lean Startup.

It begins in the Build stage with a set of ideas or hypotheses that are used to create some artifact (mock-ups, code, landing page, etc.) for the purpose of testing a hypothesis. We put this artifact in front of customers and “measure” their response using a combination of qualitative and quantitative data. This data is used to derive specific “learning” that serves to validate or refute a hypothesis, which in turn drives the next set of actions.

The Iteration Meta-Pattern

While an experiment helps you validate or invalidate a specific business model hypothesis, an iteration strings multiple experiments together toward achieving a specific goal, such as getting to product/market fit.

Figure 1-7 shows the basic iteration meta-pattern we’ll use throughout this book.

Iteration meta-pattern

Figure 1-7. Iteration meta-pattern

The first two stages (Understand Problem and Define Solution) are about getting to problem/solution fit or finding a problem worth solving.

Then you iterate toward product/market fit by testing whether you’ve built something people want using a two-stage approach: first qualitative (micro-scale), then quantitative (macro-scale).



[4] To understand the differences between Lean Canvas and the original Business Model Canvas, see http://www.ashmaurya.com/why-lean-canvas.

[5] It is estimated that up to 50% of visitors to landing pages will bail in the first eight seconds. Source: MarketingSherpa’s “Landing Page Handbook” (2005).

[6] In The Four Steps to the Epiphany, Steve Blank points out the importance of in-depth customer interviews, which he terms “Customer Discovery.”

The best content for your career. Discover unlimited learning on demand for around $1/day.