Archive for August, 2003

Network Maintainance

Friday, August 22nd, 2003

I’ve been thinking a bit recently about how accounting principles just don’t seem to work when applied to social network, and possibly not even to networks in general.

For example over at unfogged.com Ogged writes a nice little post where in he declines to take too seriously a bit-o-publish/perish research showing that women are generally less effective negotiators than men.

Meanwhile over at Crooked Timber we find Chris talking about the thousands of deaths during the recent heat-wave in France. He quotes Eric Klinenberg’s fascinating work on an analogous situation that happened in Chicago a few years back. Apparently in that disaster men tended to die in much greater numbers than women, in-spite of the data’s suggestion that pool of women was both larger and more vulnerable. Why? Because women have stronger social networks.

Clearly these two are related. You can optimize for the easy to measure short term benefit of optimal negotiated outcome, or you can optimize for a strong social network - which will deliver value in the long run. Of course that’s not black and white.

Finally I’ve been nurturing a model of why the electric grid in the Northeastern US fell apart the other day. A model that works from the assumption that the guys running elements of the grid all knew that there was good chance that it would collapse and were running the business on that basis - creating a feedback loop which accelerates the chance of a collapse. Each owner of an element in the network keeps lowering his trigger points for when he will exit the system because he’s thinking that when the collapse happens he better protect his capital investment. That makes the system increasingly susceptible to cascading failures.

There is another side to the story which is nicely summed up in this article by John Kay. The scenario he outlines involves the complex trade-off a firm makes between short-term income and long-term capital investments. Regulation and standard (ethics, professional standards, inspection regimes, etc.) all work to temper an a cyclic instability in that game.

Consider two identical power generators A and B are selling to the same customers in a competitive market. To first order their costs are identical. Mr. A comes in one morning and discovers that Mr. B is selling power for less than he is. Puzzled he drives by Mr. B’s plant and discovers he’s stopped trimming the trees under his power lines and repairing the roof. Incompetent he thinks. When he get’s back to the plant the next day the accountant comes into his office and explains that due to lost revenue they need to borrow money to meet payroll. The next day Mr. A fires the crew that trims the trees under the power lines and lowers his prices.

Both Mr. A and Mr. B are now caught in a rush to the bottom. If one of them can survive and the other one doesn’t the winner will be sitting pretty. The one with the most stored up fat in their business will survive.

While, there is plenty that’s different between a collapsing social network; and the collapsing electrical grid. In fact all the networks have important subtle differences. For example the triggers in the electrical grid are obviously very sharp, while social networks and the Internets packet networks are breakdown more gracefully, so the nature of the cascade failures are very different. Some networks are more brittle than others.

Another difference is the nature of what happens when the network does fail. Some network communities have what you might call social will to rebuild while others don’t. I suspect that the social network in authoritarian nations have a lot more trouble rebuilding than those in more liberal nations.

The players in the industry around the electric grid probably assume that after the collapse political will emerge to assure a stronger regulator hand and that will allow them to turn again toward investing in maintenance, capital equipment, talented staff, etc.

This faith that the social contract will save us is a beautiful thing. That people believe these things will heal themselves testifies to the faith people have in the social contract. That collectively people will work to create standards of behavior that serve the public good.

Of course the players might be wrong. For example in this article here we see President Bush deciding that upgrading standards for the distribution grid is really not that urgent a priority. Presumably that provides more time for the guys to get together and negotiate an optimal outcome. Meanwhile the old ladies always have their social networks.

Some people don’t believe in the public good, the social contract, need to regulate the networks, the markets, etc… Men!

Mailing List Metrics

Thursday, August 21st, 2003

I don’t know how many times I’ve watched somebody put up a slide showing how the distribution of posts in a mailing list, or commits to source code, or what ever are power-law distributed. So it’s nice to see somebody trying to drag some other statistics out of the posting data.

Who’s a regular? Who’s a flamer? Who’s an information provider?

A person with a high posts/thread ratio would seem to be a conversationalist. A person that tends to respond, but rarely post would seem to be a reactor - maybe even a flamer. A person who starts threads but rarely responds in threads would might well be a spammer.

You can read more in this news article about Marc Smith, Sociologist at Microsoft which appears to be connected to the PR around the release of NetScan .

Netscan’s pretty neat too. It shows that alt.sci.sociology’s near neighbors include alt.binaries.pictures.erotica.high-heels and alt.comedy.standup. Who knew?

Simple Measures Kill Diversity

Thursday, August 21st, 2003


Power-law distributions emerge when new nodes attach to the existing network with some preference for the current winners. You can increase the severity of the distribution by increasing the preferential attachment, and you can temper it by decreasing it.


For example to increase the severity the trick is to encourage the new comers in the belief that current leaders are a good proxy for their quality measures - it’s a simple message: ‘Go with the winner!’ To decrease the severity you need to provide to new commers with a more complex message: “Pick what’s best for you, here’s a bucket of information to help you do just that.”


Improving the information available to newly arriving members of the network, providing them with more complex subjective information, enables them to make their decision more rationally. That will make for a more diverse network and a less severe power-law distribution.


A system like Epinions.com manages this by creating a bit of a feed back loop that allows existing members to report to new members what they now know. Word of mouth can also help, since a new comer

Etzioni

Thursday, August 21st, 2003

A fat young man without a good word for anyone finally gives voice to something that’s been bothering me and I now take it back.

Meanwhile you gotta love: “astute readers will perceive here a man battling for his life against the forces of digression” - I certainly can relate to that!

Information & Power-laws

Thursday, August 21st, 2003


The simplest model of how a power-law distribution emerges presumes both urgency and ignorance. New players enter the network with an urgent need to connect and no time to evaluate their choices. To solve this problem they thrash around for something to substitute for knowledge, a proxy metric. If the proxy they pick leads to their preferentially attaching to already popular nodes the power-law emerges.


This is why advertising can be so powerful in an emerging market.


Bearing that in mind this posting from Clay is amusing. Nightmares are interupting the sleep of marketing executives at major motion picture studios! They wake up in a sweat imagining
that the audience at the first showing of BogusTeenMutantSpacemen IV are
fidgiting in their seats sending instant messages on their phones “mv scks! run awy!”


Always nice to see the vested interests disrupted by the increased ablity of the unwashed masses to coordinate their activities. But…


My nightmare is that this will mean they have to carefully craft movies so they
will get high ratings from the kind of people who watch the first screening at
4:30pm on a Friday afternoon and think that it’s ok to use your phone to IM during the movie. Teenagers!