How Zynga Tests New Game Mechanics

20 09 2010

Mark Pincus, CEO and Founder at Zynga, and Bing Gordon, Partner KPCB and ex-EA executive, spoke at a Stanford Technology Ventures lecture last year about Pincus’ entrepreneurial experiences and Zynga’s methodology in testing new game mechanics and ideas.

In the lecture, Pincus describes the Zynga process as constant iteration, design and testing with a starting stage at what he calls the “ghetto test”.  Ghetto testing is described in these steps:

1) The product manager creates a “5 word” description of the new idea.  For example “Want to run a Hospital?”

2) They post this idea on the web site, allowing it to go live for 5 minutes, monitoring hits and interest with their user base.

3) If sufficient audience interest is measured, then a one-week rollout of the first version of the game (mechanic) is created.

4) This game or feature is revealed to just one percent of the Zynga audience for play and feedback almost always with some modicum of “golden mechanics” – an appointment dynamic or viral, retentive quality – built in.

5) If these early efforts prove successful, the game grows more robust with each successive build.

Zynga avoids testing the same customer twice.  Pincus reports that the company is always testing several hundred products simultaneously, and that measuring this success online has never been easier or more affordable.

Around 1:04:00 of the video below, Pincus describes this process:

Tim O’Connor, CMO of PCDI/Ashworth, a Sterling Partners backed company describes “ghetto testing”, synonymous to “Interactive Dry Testing” in an article for Research Access:

Instead of surveys asking people about what they have done or what they might do, ghetto tests draw them in with an ad or suggetion of an offer, taking them to a landing page describing the offer and then asking some questions around that.

Now you might already be thinking that this sounds a little shady — a sort of “bait and switch technique”. But it isn’t. In his article Tim outlines some FTC guidelines and then shows how to create this type of survey.

“The Federal Trade Commission is normally OK with tests like this, so long as four conditions are met:

  • No representation is made that the product definitely will be produced.
  • There must be adequate notice of the conditional nature of the offer.
  • Those who order are promptly informed if it is not produced.
  • There can be no substitution of another product.”

Tim O’Connor’s complete article is found at

The social media online environment allows designers to rapidly create, deploy and test new features at relatively low cost, unlike traditional console or AAA games.  And that opens many opportunities for innovation with gamification.



One response

16 10 2010
APFIND - An account planning news community inspired by Digg™

Video and Article: How Zynga Tests New Game Mechanics « @StratSynergy…

This article has been featured on APFIND – An account planning news community inspired by Digg™…

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: