Category Archives: power-laws and networks

Behavior is Socially Viral, well duh!

The papers have recently been full of stories about yet another interesting pattern that researchers have gleaned from the data collected in the Framingham heart study. You can get a taste for the result by watching this annimation. What is shows is a social network (genetic and friends) changing over time. The primary focus of attention is body fat, and over time the member of this community get fatter, a lot fatter.

The sound bite associated with this study is that fat is contagious; and indeed the study showed that friends of fat folk had a higher likelihood of becoming fat than other people. Social networks exhibit a tremendous amount of “birds of feather flock together.” If I buy an conditioner, take up bicycling, start wearing a hat, or take a particular political position it is likely that I am following the lead of some of my friends and that my choice will lead others to come along.

While all behavior is socially viral I am troubled by the way that lots of people have gotten the impression that this study proves that weight gain is viral; i.e. the association with fat people is effectively dangerous because becoming fat is dangerous. I have trouble seeing how that conclusion isn’t exactly like the presumption that association with poor people (think here of the local high school) is likely to make you poor. While both of these may well have a modicum of truth to them the puzzle is exactly how concerned about the risk should a person be?

Reading the paper I’m struck by the apparent absence of references to other work on how ideas, behaviors, and real viruses spread across social networks. I.e. there id no framing of exactly how contagious this effect is relative to other things.

I’d love to see similar animations for other behavioral affectations. For example people who own air conditioners, folks who drive large cars, eating out at chain restaurants. It is inconceivable that the modern marketing industry doesn’t have reams of data like that. The this study is looking at something with a strong health component colors how we think about this. If the same data showed internet usage, or cell phone adoption, then we would presume that the primary driver certainly as much or entirely techo-economic rather than dragging in questions of individual will and infection. Of course ideas like choice, memes, viral spread would remain interesting but the wouldn’t be so highly energized.

Causality is very complex stuff; but I don’t see how this study is a big help in getting at the root causes of obesity. If we had a similar drawing that showed the association with internet users substantially increased the chance of adopting becoming an internet user would we announce that it was contagious? What about gun ownership? What about being a Republican? This animation looks to me like a simple illustration of how a behavior gains market share; i.e. decreasing barriers to adoption enable increased market share. That adoption trickles across the social network seems mind bogglingly obvious and actually quite unexceptional.

City

I’ve thought and read about cities for decades so it is extremely cool to encounter a new idea.  I’m currently on vacation in Ithaca NY, and before hand I wandered into the Architecture library at work to pick up a book about the Finger Lakes region.    That book was a disappointment, but nearby was a big thick book confidently called City about New Haven Connecticut and as is my wont I picked it up too.  City: Urbanism and Its End by Douglas Rae adds two new, to me, pieces to the puzzle of what happened to the American cities.

My father used to tell a story about a scholarly study of what climate is most suited to civilization.  The scholars plotted latitude of the great civilizations down through the ages.  Fitting a curve to their data they showed conclusively that the current optimal location of a civilization was New Haven Connecticut.  Needless to say the scholars were at Yale.  I grabbed the book in the hope it would turn out my father’s story wasn’t entirely tongue and cheek.

Geography does shape civilizations of course.  The presumption that Yankee thrift and innovation is a consequence of the Puritan culture, to take a common example, is thrown into question by the story of how the Puritans who migrated to Central America at the same time  ended up being slave owning oligarchs.  In that case the distinguishing factor appears to be labor availability.  In New England labor was dear, land wasn’t; while in the Central America it was the other way around.  Dear and innovation go hand and hand.

The thesis of “City: Urbanism and Its End,” beautifully and delicately presented in the first chapter, states that cities, like New Haven, made sense as a coordinating device only for a short period, less than a century.  It’s conventional to say that the automobile killed the center cities and in models of that kind the primary driver of how concentrated our settlements are is the transportation system used to glue them together.  Old cities in Italy have narrow streets because they were used on foot while modern urban spaces care more about tractor-trailers than tricycles.

The usual complement to the transportation based models of city concentration are ones about endowment.  First there were the natural endowments, a good and defensible harbor or along an existing trade route for example early London or New York’s are examples of that.    Later cities became their own endowment; aggregating social networks, capital, functional governance, etc. etc.  San Jose, and Silicon Value, is a modern example and Venice or Amsterdam a older one.  This model of cities as aggregating increasing returns in their endowments is my preferred model for what shapes the concentration of populations into cities; in part because it seems to fit well the power-law distribution of city sizes.

In the years prior to the rise of cities like New Haven the population was concentrating into what he calls Fall Line Cities, i.e. cities build along a river that was rapidly descending so as to take advantage of water power.  Labor, capital, expertise, the whole complex knot needed to make industrialism work, had to migrated to the power source.  That changed with the advent of steam power, railroads, coal, etc.

So that’s new to me.  Energy was no longer dear, or at least no longer immovable,it could no longer command all the other elements of the party to show up where ever it happened to be.  Once energy stopped being the key endowment other factors became the hard thing coordinate.  The city became the party.  One consequence of that insight is to wake up to the key role that electricity plays in blowing apart the 20th century central city.  It is, possibly, just a critical to the story as the automobile.  Before electricity you wanted to be near a rail or flat water to get your coal, to run your steam engines.  This reminded me of another of my father’s stories.  He had a friend who started a company making fiber optics, and that factory was carefully sited to be adjacent to a high tension power line near a small New England town with a concentration of optics expertise.

But there is yet another part to the story that is new to me.  Some years ago I was shocked to watch how real estate interests in Massachusetts were able to override the governance of the states principle cities using a statewide proposition.  Rae highlights how cities are seriously handicapped in the US by how their governance is structured.  In 1907 the Supreme Court wrote: “The State .. at its pleasure may modify or withdraw all [city] powers, may take without compensation [city] property, hold it itself, or vest it in other agencies, expand or contract the territorial area, unit the whole or a part of it with another municipality, repeal the charter and destroy the corporation.  All this maybe done, conditionally or unconditionally, with or without the consent o the citizens, or even against their protest.  In all these respects the State is supreme.”

That’s why, for example, suburban and rural voters could pass a referendum over the objections of city dwellers in Massachusetts.  That’s why New York city can’t get it’s hands on a half a Billion dollars from the feds for congestion pricing without sharing a large portion of the money with the rest of New York state.  Why New York is attacked by terrorists and we send money not to cities but to states where it buys toys for rural police departments rather than improved harbor security.  It’s why when the automobile began to undermine the numerous endowments that cities has accumulated they had such a hard time fighting back; and it goes a long way toward explaining why European cities were more successful in tempering the displacement of those endowments.

Of all the endowments cities have the diversity and richness their social and knowledge networks are the ones I find most fascinating.  My father’s friend needed electricity and a pool of optics expertise he could draw upon.  I’ve thought that eBay and Google couldn’t have happened in any other situation; they desperately needed the pool of expertise that only the bay area could provide.  These endowments are the ones that Jane Jacob’s emphasises in her works.  By the time she was writing cities were created innovation but as firms grew they threw their factories out into the periphery.  Just as Apple manufactures in Taiwan, or Google puts it’s servers next to hydroelectric plants.  It is, just possible, that the Internet will displace these social/knowledge endowment as well.  While I don’t know how that will play out for cities what I do know is that it’s harder than it looks replicating those in on the fabric provided by the net.

Craft v.s. Art.

This is a very elegantly written posting.

Most people are not aware of the depths of the argument that between the fine craft establishment and the dominate fine art elite.  I used to think about that debate more; but I’m pleased to note something about it.

Fine art is at it’s core about scarcity; fine craft is much less so; and what has come to be called crafting hardly at all.  The fine craft movement, which weaves it’s way back through all of history and all nations, in it’s modern manifestation, I’m surprised to note, a lot like open source.

I hate to play that card.  The term open source has almost fallen dead for me.  So many people play that card in an attempt to grab a bit of legitimacy for what every scheme they are executing that involves sucking talent out of the vast pool of people on the other side of the internet; and don’t get me started on the neologism ‘democratizing.’

What is going on in the modern crafting movement, as manifested in the web, is the thing I think is coolest about the Internet.  First off it has a pool of people of common interest finding each other, like a giant pot luck dinner or a stone soup.  They are creating energy and knowledge that wasn’t there before; in an commons.  Secondly the energy of this movement comes from the periphery; the respect of the participants faces toward the periphery.

When this works you get the opposite of scarcity based activities.  In fine arts the entire community is polarized by the pervasive question of who’s at the top, who can command the premium prices, who’s hot, who’s not.  In a periphery facing community the tension, the anxiety if you wish, is where on the vast periphery the next insight will emerge, the next cool trick of the trade, the next breath taking bit of design.

I Spy Class War

This image is lifted from an article at First Monday (A Practical Model for Analyzing Long Tails).

football-pl.gif

I’d seen this trick of using a sports field to help inform your intuition about power-law curves previously. In that case the distribution of wealth is the topic. These guys talk about the L-curve; shown here (video):

l-curve.png

theusual.jpgBoth of these do a nice job of helping to visualize the actual shape of these curves. They help to clarify why the politics and business models that serve the two legs are very different and why the appeals that emphasis middle class values are should be treated with some suspicion. The more typical illustration, shown to the right, is preferable if you want to deemphasis the polarization and highlight the uniformity of the underlying generative processes.

Friction

Today I noticed this ad offering to reimburse you for getting a passport.  $157 per adult.  I felt some sympathy for the advertiser, an island in the Caribbean.  A place people go for the weekend; well they used to.  The island tourism folks woke up recently to discover that numbers where down and they have discovered that the newly increased tedium of getting a passport has caused huge numbers of idle travelers to decided to, well, just go someplace else.

When my 1st son got his learner’s permit it took us three trips to the registry before we managed to accumulate enough documentation to convince them to let him have the learner’s permit.  My 2nd son submitted his first pay check’s stub rather than the check and the bank called to correct the error.  A bit got set on his account that didn’t get cleared.  So the ATM ate his bank card.  It took months to get a replacement card since his school was yet to issue the ID card they required.  All N of my financial institutions have recently insisted that I add four security questions, including one involving a photograph; which is a pain since I share access to these accounts with my spouse so all 30 odd questions and their answers all have to be in some shared location.  We recently got new passports, a project that was at least a dozen times more expensive and tedious than doing my taxes.

I once had a web product that failed big-time.  A major contributor to that failure was tedium of getting new users through the sign-up process.  At each screen they had to step  through we lost of 10 to 20% of our customers.  Reducing the friction of that process was key to our survival.  We failed. It is a thousand times easier to get a cell phone or a credit card than it is to get a passport or a learner’s permit.  That wasn’t the case two decades ago.

The Republicans have done a lot of work over the last decade to make it harder to vote; creating additional friction in the process of getting to the polling booth.  The increased barriers for getting a drivers license, passport, etc. are all part of that.  This make sense because now, unlike 30 years ago, there is now a significant difference in the wealth of Democratic v.s. Republican voters.

Public health experts have done a lot of work over the decades to create barrier between the public and dangerous items and to lower barriers to access to constructive ones.  So we make it harder to get liquor, and easier to get condoms.  Traffic calming techniques are another example of engineering that makes makes a system run more slowly.

I find these attempts to shift the temperature of entire systems fascinating.  This is at the heart of what your doing when you write standards, but it’s entirely scale free.  Ideas like this are behind the intuition of some managers who insist on getting everybody in the team working in the same room with no walls between them.

In the sphere of internet identity it is particularly puzzling how two counter vialing forces are at work.  One trying to raise the friction and one trying to lower it.  Privacy and security advocates are attempting to lower the temp. and increase the friction.  Thus you get the mess around the passport, real-id, and the banks.  Wearing that hat it seems perfectly reasonable that one should present photo id when you vote, or have your biometrics captured if you cross a boarder.  On the other hand there are those who seek in the solution to the internet identity problem a way to raise the temperature and lower the friction.  That more rather than less transactions would take place.  That more blog postings garner good coments, that more wiki pages will be touched up, that more account relationships will emerge rather than less.

Of course the experts in the internet identity space are trying to strike a balance.  It’s clearly one of those high-risk high-benefit cases that people have trouble holding in their head.

Colony Collapse

There is some deeply disturbing data about the decay of human social networks (pdf).
Meanwhile bees, a social insect appear to be in big touble too; something really bad is happening to the bee populations, Colony Collapse Disorder (Wikipedia).

“It is very frightening. We don’t know the cause. … The bees are quite strong. … A week later the colony has dwindled to nothing. … It’s a mystery. … We don’t know where they are going. … Fifty to ninety percent of the colonies. …” – U of Penn (podcast)

They (pdf) are very early in the process of puzzling out what’s going on, mostly just guessing at this point: mites, fungus, contamination, stress, a combination – who knows?

I wish I thought similar resources were being brought to bear on the breakdown in human social networks.

Long Tail Fallacy

I suspect we all know, but I just what to be sure it’s on the record, that Long Tail ideas suffer from the Base Rate Fallacy.

Which is to say that stocking more products in your store, more books on the library shelf, more details in your server logs, or keeping more of your options open does not automatically lead to a better experience. Unless of course you enjoy searching, sorting, organizing, or hording.

The New Supply Chain, same as the Old Supply Chain

Chris Anderson’s new book on the Long Tail is finally out. I got a review copy and sooner or later I’ll get around to picking apart my thoughts in some organized manner.

The idea in the book is simple; that there are bottlenecks in traditional supply chains, e.g. shelf space in the record store or movie theaters in your town this friday night. These bottlenecks shape what gets sold. I like his provocative idea that if you eliminated these bottlenecks then something he referes to as the true shape of demand would be revealed.

So this is a book about the shape of markets, where by shape we mean the distribution of market share across the set of products moving thru the market. It is refreshing to see that kind of thinking about markets appearing in a book targeted at the air plane business class reading demographic. And further more it’s delightful to see the discussion focus immediately on the issue of where the bottlenecks are; and how they shape the slope and edges of the power-law curves.

It drives me crazy that he appears to be willfully blind to how market players strive continously to create, own, and defend these bottlenecks. While he is enthusiastic in celebrate the freedom created when older bottlenecks are swept away he is entirely silent about the concern that the new bottlenecks might be more or less troublesome than the old ones.

Here, just to take one example, is a nice article in Fortune about how Google holds the fate of so many businesses carelessly in it’s hands now. The elephant doesn’t even notice when it steps on the ants. But actually it’s worse than that. In these Long Tail markets the giants aren’t elephants, they are ant eaters.

The Devil’s Long Tail

In this day and age you really can’t hope to achieve scale with deep relationships, you need broad light relationships that create vast probablistic oportunities for sucess. I’m glad to see that Neil Gaiman and Terry Pratchett know this:

Fourteenth-century minds, the lot of them. Spending years picking away at one soul. Admittedly it was craftsmanship, but you had to think differently these days. Not big, but wide. With five billion people in the world you couldn’t pick the buggers off one by one anymore; you had to spread your effort. But demons like Ligur and Hastur wouldn’t understand. They’d never have thought up Welsh-language television, for example. Or value-added tax. Or Manchester.

He’d been particularly proud of Manchester.