The Real Lessons From Twitter
Posted on : 17-06-2009 | By : Tony Stubblebine | In : Uncategorized
Tags: customerdevelopment, lessonslearned, odeo, smallbiz, socialsoftware, twitter
34
In 2006, I was the director of engineering at Odeo, a podcasting startup notable for birthing a side project now known as Twitter. My major contributions were doing the statistical analysis that showed that our podcasting work hadn’t amounted to a hill of beans* and then not complaining when our most reliable engineer wanted to work on a side project. Still, it was fascinating to be in the building during Twitter’s conception and then to read all of the ways that people misunderstood those early days.
Here are three lessons I learned from Twitter that nobody seems to have caught on to.
1. If people use it, it’s valuable
Have you ever looked at a piece of social software and thought, or worse, blogged, that it was worthless? Here’s a trick for evaluating social software in a way that isn’t going to make you look stupid six months down the road: assume it’s valuable if people are using it. Then try to figure out what value they’re getting.
Even professionals make the mistake of dismissing social software despite active, growing communities. Consider this early TechCrunch article, Dodgeball vs. Twitter, where the author (not Arrington) insists that the way to compare software is feature by feature. Dodgeball won the comparison but within a few months was in the deadpool and now Twitter is part of TechCrunch’s everyday coverage. Why? The features that mattered were defined by social interactions, and each user had their own customized set of features based on the social interactions that were important to them. Dodgeball had more features by the traditional measure, but Twitter had the kind that mattered, loads of social interaction.
I even find that this is a good reminder for myself. I follow a startup advice blog from Eric Ries, cofounder of IMVU. The first time I heard what IMVU did I thought it was laughably stupid. They make 3D chat rooms, (like a mini Second Life without the flying), and make money by selling virtual clothing for people’s avatars. Yet he is able to explain IMVU with a straight face and then seems genuinely surprised when people express skepticism.
Here’s the reason he can keep a straight face: IMVU gets 1.3M unique visitors a month and makes tens of millions of dollars per year. He’s not judging the idea based on opinion, which is where most people get into trouble, he’s judging based on observation. Now, I feel stupid for not keeping an open mind.
2. Product, Team, Market? Team.
This is a fun little debate, what matters most the product, the team, or the market? At the time that Evan bought Odeo back from the investors, our podcasting product was widely seen as a failure. It didn’t have any growth and it certainly didn’t make any money for the investors. Here’s how Bryce at OATV put it:
Rockstar team, smoking hot market, all-star angels — and it didn’t deliver the hyper growth traditional VCs need for their return profile.
Was it the product? A year after Ev bought Odeo back, and after zero updates to the features, Time Magazine listed Odeo as one of their top fifty websites. Today, with a very similar product, Odeo.com is the only podcast directory of note. So the product was fine.
Was it the market? Marc Andreessen argues that the market is the only thing that matters for a startup. I just made the argument that Odeo was a strong product and I’m going to argue below that we had a strong team. Since no other web based podcast directory has proven otherwise, it looks like we were in a weak market. So is the answer that the market matters most?
That would look like the answer if not for Twitter, that pesky side project we launched that has had 10x growth in the last year. Market only looks like a good answer if you’re judging individual products, in this case the odeo.com podcasting directory.
A good team, that listens to its customers, is going to find a good market and put together a good product for that market. Steve Blank calls this process customer development (explained well in his book Four Steps to the Epiphany and in this Venture Hacks post).
We could see that Odeo.com didn’t have enough traction so we went looking for other ideas. You might think it was lucky that we hit on Twitter, and as a specific product, it was. If Jack wasn’t on the team, there would be no Twitter. But the team at Odeo had lots of ideas and plenty of people capable of carrying them out. Of the 19 or so people who contributed to Odeo, 13 had started or went on to start a business or major open source project**.
- Evan Williams, founder of Blogger, Odeo, and now Twitter
- Noah Glass, Audioblogger, Odeo
- Jack Dorsey, founded a courier dispatch startup and Twitter
- Biz Stone, launch team at Xanga, founder of Twitter
- Tim Roberts, co-founded BigStep and founder and CEO of Infectious
- Tony Stubblebine (me), founded CrowdVine
- Adam Rugel, founded 71Miles and Trazzler
- Dom Segoia, founder of DollarApp
- Jeremy LaTrasse, owned a tattoo parlor
- Rabble, co-founded protest.net, co-wrote Icalico
- Blaine Cook, started Starling project
- Dan Cederholm, co-founder of Corkd.com, author of Bullet Proof Web Design, many other things
- Kellan Elliott-McCrea, Magpie RSS, icalico
If Ev hadn’t bet on Twitter he would have bet on something else. Three of the companies above are currently live companies that support their founders and a few employees (Infectious is funded and doing well, Trazzler is funded by the Facebook fund, and CrowdVine is profitable). I chose a vertical route for CrowdVine, but the original idea, social networks for everyone, is an idea that’s nearly as big as Twitter (as evidenced by the size of Ning).
Because of the team, Ev had other options to overcome a weak market. So if you’re looking at it from the perspective of the company, team is most important***.
3. Rails was never the problem
Twitter had well-documented performance problems in it’s first few years. Many people, including programmers, pointed the blame at one piece of Twitter’s architecture, Ruby on Rails.
First, all Rails does for Twitter is serve up web pages. The vast majority of those scaling problems came in the back end, moving status updates around and then storing them in a way that Rails could retrieve them for display. So most people aren’t even looking at the right piece of the architecture.
Today Twitter has a much better performance track record and it still uses Rails to serve web pages. The difference is the backend.
So if the backend was such a problem why didn’t Twitter launch with a better backend or at least get it fixed earlier? That gets at the heart of the problem. I’ve never heard anyone get the blame right for all of those performance problems. They stem 100% from the way that we went about switching from the Odeo product to the Twitter product.
When a company kicks off their first project they do some long term thinking and might cover topics like architecture. But how do you launch your second project? Or fifth (approximately what Twitter was)?
Was it easy for the Flickr team to choose to double down on photo sharing, which initially was just a feature inside of a web-based multi-player game? For us, it wasn’t an orderly process at all. It wasn’t even clear that we were abandoning Odeo. We were running hackathons, which led to a condition where many people had competing ideas (and implementations!) of what our next product should be. But around those hackathons we were still continuing to develop Odeo. Twitter eventually won enough that we pulled two engineers off of the Odeo team, but the rest of us kept plugging away.
If you were thrown into a fight, would you start punching or would you open up your iphone and start browsing web pages about Karate? I’d argue that Twitter was launched in the middle of a fight for what we were going to do next, and any thought for long range planning was completely secondary to getting Twitter launched and proven. Without Rails, we might not have even given Jack time to finish the prototype.
So that’s why Twitter wasn’t ready to scale from day one. However, it took almost two years until it could scale reliably, and that certainly seems like longer than necessary. I think it’s an issue of engineering management. Until the Summize acquisition, there was no true engineering manager for Twitter. I had left before Twitter was spun out****. Everyone was a little wary of hiring middle management again since it was widely seen that we had been hired too early at Odeo. The job of middle management is to promote forward progress, and it took us awhile to figure out that wasn’t what Odeo needed. Twitter did eventually hire a VP of Engineering, but he didn’t pan out.
The result was that Twitter operated for a long time (until Summize was acquired) with a gap in engineering planning, someone who could put together a plan that everyone understood and could work from. They had people who could solve problems in brilliant ways, but they didn’t have someone who could get the entire company on the same page. That gap was just an unfortunate side effect of the jumbled team that emerged post-Odeo. So what’s the right way to change your company’s direction? It certainly had nothing to do with Rails.
* Odeo was eventually acquired and is today the only podcast directory of note. However, as a venture backed concern all we had really managed to build was a site with high page rank. We had terrible numbers on repeat visitors and our experimental features (podcast studio, send me a message, audio commenting) weren’t getting any use. Maybe we could have gone after libsyn’s podcast hosting business, but overall our stats said that if we wanted to strike out in a new direction we shouldn’t feel constrained by podcasting.
** Those remaining six include a former core contributor to Rails, Twitter’s current support lead and people that worked for Apple, Google, and Flickr.
*** The idea that Twitter is the same company as Odeo gets muddied because Ev bought the company back, laid off a chunk of Odeo and reincorporated Twitter as it’s own company. But I’d argue the difference isn’t important here. Twitter was launched and run in the early years by Odeo employees who worked at the same desks and the same office that they had when they were working on odeo.com.
**** People often ask me if I regret leaving, and I don’t. I made a list of reasons that included several that would have been sufficient on their own. Did they need me? Not at first, and I hate being idle. Was I happy? No, I was miserable. Every month I had told my team that what we were going to work on was critically important. And every month it had ended up not being important. It taught me an important lesson about what I want from work, to walk in every day believing I’m doing something important. I ended up with the opinion that the only way I could guarantee that was by owning my own company, hence CrowdVine.


A blog by
This is really interesting, I didn’t realise people from Odeo went on to work for “well known” companies/projects etc.
On the scaling point, I remember watching a video from last years FOWA, a talk with Blaine & Joe Stump called “Languages Don’t Scale” It seems so obvious! http://events.carsonified.com/fowa/2008/london/highlights/blaine-cook-joe-stump/
Also I can see what you mean about the gap in engineering due to where people were.
Doug, yeah, I was surprised by where Odeo people landed up also. I think that’s the great thing about startups: they fail all the time but you usually land on your feet.
Tony – great, clear, insightful post. A great read for any start free of the fluff of ideology and simply a straightforward recount and review. Thanks for taking the time to post it!
Thanks Michael! Although I think you should know that the Steve Blank and Eric Reis ideas are both headed toward ideology and that I’m a follower.
Twitter still uses Rails? I thought they’d switched languages and frameworks a few times….
Jeremy, maybe you’re thinking of how one of their engineers, Alex Payne, has become a fan of Scala and is even co-authoring a book on the subject?
http://programming-scala.labs.oreilly.com/index.html
The twitter website still says that they’re based on Rails and they still have Rails job openings.
I’m sure they’ve switched some things off of Rails, but I think the major driver is how much of their business doesn’t involve serving web pages.
Thanks for sharing this Tony.
great post tony. ahhh the memories.
Great, generous post.
Watching the Iran Election, we have even more lessons to learn about the value of Twitter; lessons to add to what we learned from Sarah Milstein’s and Tim O’Reilly’s excellent Twitter Book http://www.amazon.com/Twitter-Book-Tim-OReilly/dp/0596802811
[...] The Real Lessons From Twitter (post) – Tony [...]
@Julie: Thanks for the good word on our book!
@Tony: I especially like the idea that you should assume software that people use is, in fact, valuable. Readers here may not like this analogy, but about 20 million people a day (mostly women) watch soap operas. Lotta pundits like to say that soaps are crap. But if viewers didn’t get value out of them, they’d stop watching. Better to look and see where the value is than to dismiss the program.
compelling insights and lessons for the entrepreneur. Throw in a little color “slouched around their sole conference table crowded to capacity with a myriad silver cylinders of energy drinks since spent, the team strained to focus as Tony…” and you’d have a Fortune or Forbes magazine article. This is the rare breed of blog post that’s actually a good read as well as informative. thanks for putting in the time to tell a good story.
Thanks for the absolutely great post! Nothing more to comment :)
Glad I clicked on the link to this post (via ericries on Twitter). I get more traffic to my site via Twitter than any other referrer. You deserve some thanks for that . . . thank you.
Nice post, Tony. One nit — the accomplishments that you list for some of the team, like protest.net and MagpieRss, were pre-Odeo, not post-Odeo. They didn’t go on to those things, they came from them. I can imagine that they would have been an interesting bunch to “manage”, if you can use that word.
Tony, really great post. I enjoyed the lessons learned and clarity of your writing.
Point #1 was take home pay in and of itself. The Dodgeball vs Twitter; and IMVU examples were spot on.
I’ll be back to read more (as will my fellow co-founders of our soon to launch alpha).
Thanks for sharing. Best continued success with CrowdVine.
Nice post! We knew it was Twitters back-end btw, but then we are infrastructure layer guys.
Our view fwiw is that it was better to get a service up and running and get enough traction for funding than pay for the early costs of serious back-end work because, as you note, its quite hard to predict in advance what it will need to do.
popurls.com // popular today…
story has entered the popular today section on popurls.com…
[...] Stubblebine has written a great post about the lessons he’s learned from Twitter, which was created at Odeo while he was working there. This advice stands out for me: Have you ever [...]
@mlstotts if it helps you visualize, we were in a former office of Joe Boxer, right on South Park (a hidden park in the SF South of Market area). We did our scrum planning on a fifty foot white board and we had an amazingly comfortable pink chair (pink was one of the odeo colors).
@Tim The other pre-Odeo projects on that list are Tim with Bigstep, Biz with Xanga, Ev with Blogger, Jack with his courier dispatch startup (which was funded), and Jeremy’s tattoo parlor.
You’re right that they were interesting to manage, but I also feel like I never got the chance because we never truly had a direction.
@David Thanks for the kind words and good luck with your venture. Is it sports related?
great piece tony.
and I agree eric Ries & Steve blank are leading a revolution in thinking about web software design & marketing. count me among the faithful too :)
I’ve always been fascinated at how Twitter grew out of Odeo, mostly because it’s so hard to keep it together under the stress of the initial idea struggling in the marketplace. You guys must be a really tight crew. Hats off.
Glenn, it was hard. I wonder, is it ever easy?
Hey Tony,
Enjoyed the read. The TC comparison of Dodgeball and Twitter reminded me of a post I wrote in 2006 about why I Twittered:
http://bit.ly/q9×3E
For me, it came down to Twitter’s lack of specificity and rigidity in its use compared to Dodgeball.
I’d argue that yes, a great team matters most with a flexible enough mandate from investors/stakeholders to adapt to the markets and iteratively develop the best product. Plain and simple, hubris-filled inertia kills teams’ ability to be objective about results vs. ideas and conflicting investor interest/control undermines flexibility. If your investors are more excited about the product and market rather than your team, they are not the right investors for you and will shackle you to chase the trend.
@Chris you were way ahead of the curve on understanding how to evaluate social software. That was a good post and good explanation, twitter was better because it stayed out of your way.
@Greg we had good patient investors (as far as I could tell). But even so, it’s hard to tell them “we have no idea, so we’re just going to experiment.”
I couldn’t get the Chris Sacca link to work. Here’s another link to the same piece http://bit.ly/mDdXL
[...] Stubbleblog » Blog Archive » The Real Lessons From Twitter "Have you ever looked at a piece of social software and thought, or worse, blogged, that it was worthless? Here’s a trick for evaluating social software in a way that isn’t going to make you look stupid six months down the road: assume it’s valuable if people are using it. Then try to figure out what value they’re getting." (tags: twitter startup entrepreneurship) [...]
I like this bit best: “Without Rails, we might not have even given Jack time to finish the prototype.”
Don’t you think iTunes perhaps could lay claim to being the only podcast directory of note?
@Matt Well, I used “web based” as a caveat below and I should have used it there.
[...] after this, you are still a Twitter nay-sayer, I would suggest you take a look at this Tony Stubblebine post, where he explains that one of the things that he has learnt from Twitter is to assume that a [...]
[...] The Real Lessons From Twitter If you were thrown into a fight, would you start punching or would you open up your iphone and start browsing web pages about Karate? : [...]