UsableMarkets

markets, design, usability, research

UsableMarkets header image 1

An odd, but perhaps perfectly understandable, compulsion

October 12th, 2010 · Economics, Rating & Review Systems

The FT reports that Google has now created a Google Price Index.

Much like the Consumer Price Index (CPI), it is a measure of inflation. But while the CPI is constructed by real people (government and economist trained experts, we presume) entering real stores and recording real prices with pen and paper, the GPI is based on real prices found on the internet by, we presume, real search engines working with real algorithms, trained by real economists and programmers.

The idea is the brain child of Hal Varian, Google’s chief economist. He says of creating the idea: “What’s the first thing you want to do if you’re an economist [when confronted with a list of prices]? You want to construct a price index.”

Why, of course!

~alex

Comments OffTags:

What can be _____ will be ______

August 20th, 2010 · Information Markets

In the old Razorfish days they used to say, whatever can be digital will be digital. This rather catchy saying (despite perhaps being invalidated by one night of television) always seemed a rather clever way to describe the imminence of the digital revolution. My own conceit is to adjust the phrase to, whatever can be semantic will be semantic, which naturally (in my mind anyway) leads to, whatever can be transparent will be transparent.

In the current race for social (already handily won by Facebook) people often forget to look over the horizon. Savvy investor Esther Dyson, however, has not forgotten, and she’s written a nice piece in Project Syndicate describing what’s happening to make this next future possible.

From the article:

To me, the meaning was clear: when people search, they aren’t just looking for nouns or information; they are looking for action. They want to book a flight, reserve a table, buy a product, cure a hangover, take a class, fix a leak, resolve an argument, or occasionally find a person, for which Facebook is very handy. They mostly want to find something in order to do something.

As a result, Bing launched a few forays into vertical integration. And in the last few months Google has begun to react. First, it bought ITA Software, which provides the underlying data to several travel-booking sites (Hotwire and Orbitz) and to Kayak, as well as to Bing. Most resellers, a little nervous about Bing’s tool that sends users to book directly with airlines and hotels, are even more concerned about what Google might be up to.

Then, last month, Google acquired Metaweb and its user-generated database Freebase. While Powerset was a tool for understanding natural language and for structuring it “under the covers” (where programmers could see it), Metaweb lets partners and end-users create data structures or add information to structures created by others. For example, Metaweb/Freebase has an extensive structured database of movies, actors who appear in them, and their directors. You can ask (and get the answer) to “movies directed by Roman Polanski” and get only those movies – not those in which he only appeared. Try doing that with Google. You soon will be able to.

The future will not just be search based, but task based. And a semantic web will help make that happen.

~alex

Comments OffTags:

More recession predicting

August 19th, 2010 · Economics

Of course everyone reads this blog, which is why since I published a modest piece on the inverted yield curve as a recession predictor, everyone seems to be talking about predicting recessions.

Two recent articles caught my eye. One by the SF Fed on the Conference Board’s Leading Economic Index (LEI) prediction record, and how to improve it. And the other in the WSJ concerning the weekly claims for unemployment published weekly by the Labor department.

Starting with the SF Fed, they helpfully describe what is the Conference Board’s LEI:

The Leading Economic Index (LEI) prepared by the Conference Board (www.conference-board.org/data/bci.cfm) every month is an indicator of future economic activity designed to signal peaks and troughs in the business cycle. It comprises ten variables that can be loosely grouped into measures of labor market conditions (initial claims for unemployment insurance and average weekly hours worked in manufacturing); asset prices (the monetary aggregate M2, the S&P 500 stock market index, and the interest rate spread between 10-year Treasury bonds and the federal funds rate); production (new orders of consumer and capital goods, new housing units, and vendor performance); and consumer confidence.

They go on to say why its predictive ability is limited.

At least two reasons explain why the LEI’s predictive efficacy is limited. The first is that the index is a one-size-fits-all weighted average of indicators. By this we mean that weights are designed to distill the information contained in 10 variables into a single variable, rather than by selecting weights that would produce the most accurate turning-point predictions. Second, we find that no single combination of indicators is likely to predict well at every time horizon.

The WSJ seems to have better hopes for the unemployment claims.

The Labor Department’s weekly tally of new claims for unemployment benefits—released every Thursday—has a remarkable track record of foreshadowing economic turning points. Its recovery in spring 2009, for example, coincided with the stock market’s bottom and foretold what turned into an economic rebound.

I have yet to see any research to back this up, but the article does include some circumstantial evidence.

Still, claims haven’t risen enough yet to spark worries of a “double-dip.” They behaved similarly after the 2001 recession, improving pretty steadily until September 2002, then began to deteriorate again. That augured a 13% drop in the stock market over the next month, a widening in high-yield bond spreads and higher market volatility, notes Moody’s Investor Service. But it didn’t derail the turnaround.

The Fed’s article contains some charts. I have yet to see any on the unemployment stats, but perhaps that’s something I can create in the future, if the WSJ doesn’t beat me to it.

~alex

→ 1 CommentTags:

Animated Yield Curve

August 15th, 2010 · Economics

Spot the arbitrage opportunities here. Don’t worry, though, you already missed them.

HT to Econbrowser for the link.

~alex

→ 1 CommentTags:

Cost per base pair

August 15th, 2010 · Healthcare Markets, Information Design

The Economist has a nice story about how the cost of sequencing DNA (specifically of the DNA of homo sapiens) is decreasing at a rather rapid rate. They include a chart (which naturally has lots of blue in it).

economist, cost per base pair

The only problem with this chart is that it doesn’t really tell us much other than cost per base pair is decreasing.

But if I want to have my genome sequenced, what will I have to pay? In other words, how is this chart meaningful to me (which may sound selfish, but I am human after all).

I’m here to help you out (along with Wolfram Alpha).

In 1991: about $31 billion

In 2009: about $31,000

The calculations do not include taxes or account for potential insurance payments, in case you were wondering.

~alex

Comments OffTags:

Google struggles

August 11th, 2010 · Information Markets, Product Development, Product Markets

Google has been much in the news of late, and not for all the good reasons.

Net neutrality and privacy advocates now have (even more?) reason to question where the company stands on these important issues. Crucially, it appears the company is shifting from previously stated positions. Before they were for net neutrality. Now they’re compromising. Before they didn’t track and sell personal information on people. Now they’re thinking of starting a market in personal data (to say nothing of the street views debacle). The WSJ has published a wonderful series of articles on privacy and the web over the past week or so. It’s no accident that Google has featured highly in them.

In addition product development people of all stripes have to wonder what happened with Google Wave. Actually, truth be told, we know what happened: the product didn’t really solve problems for people, merely confused them. Perhaps someone at Google just got a bit ahead of themselves, to put it mildly.

So now people are left to wonder: is Google really just a plain old evil company after all; and is their product development strategy somehow … lacking. This is not the summer of love for Google.

But there are good reasons to remain bullish on Google, despite the public relations whacking.

The spirit of innovation appears to remain alive.
Perhaps it goes without saying that if you create as many new products as Google does, some are bound to suck. Success’s have far outweighed failures. More worrying would be the number of middling products that they are now required to support, such as Google Books, Scholar, and so on. The rules may be a bit different, though, when it comes to Google’s upcoming social network. Failure here would be a big problem.

Open platforms
The battle here is on new devices, mobile and tablet. Android has so far emerged as the only serious alternative to Apple. One wonders to what extent we’ll see history repeat itself (think Apple versus Gates), and how likely the outcome will be the same. Most think the ground has shifted in Apple’s favor (they’re older, wiser), and I won’t disagree. But one wonders. It’s a vicious, cost conscious world out there.

The (presumed) ethics of the founders
Having worked at a few places with some strong headed leaders, it does feel true to say that as go the founders so goes the company. At the very least, don’t underestimate the power of culture, and the power of the founders to influence company culture. With that in mind, you don’t come up with a company slogan like “Don’t be evil” without being willing to put some skin into it. I have to believe that Google will make serious attempts to address privacy concerns. As a start see their Ad Preferences page. One assumes more initiatives will follow. For example, if Google helped internet users learn how to manage their online profiles, they can go a long way mitigating privacy concerns.

I’m sure on second thought the founders at Google might consider their slogan “Don’t be evil” a bit rash. Mature companies shouldn’t put their reputations on the line over idealistic, fuzzy concepts. But that is, to a degree, what we love about Google. The real danger in this summer of unlove is that they become more conventional. I would hate to see Google become more safe in developing new products. Or not try to bring more information together in more useful ways. While we want our companies to be responsible, we don’t want them to lose their edge.

And they’re the subject of one really torturous chart from the WSJ
google privacy
click to view original

~alex

→ 1 CommentTags:

Sweet sports visualization: what it’s like to face Mariano Rivera

July 31st, 2010 · Information Design

Mariano Rivera of the NY Yankees has one pitch, but it’s an awesome pitch. The NYTimes does a sweet job of explaining its nastiness.

rivera1
rivera2
rivera3

~alex

Comments OffTags:

Beware of chart bergs

July 20th, 2010 · Book Reviews, Information Design

Yes, information visualization is heating up. With new wonderful software tools (like Tableau Public), and languages (like protovis) it seems that many can get into the game, (including yours truly, but perhaps to your detriment). And to satisfy this interest there are multiple new books, some of them quite good.

I’ve read a few of them of late (such as Now You See It and The Wall Street Journal Guide to Information Graphics), but I think the best one so far is the one I’m reading now, Picturing an Uncertain World. Perhaps counter-intuitively is does not start off with any charts or graphics. Rather, it zeros in immediately on the hidden part of any chart: the raw data.

Like an ice berg, any good chart is supported by a mass of raw numerical data. There is a fair amount of thinking that goes into selecting the data, gathering the data, aligning the data, and so on. And while this geeky grunt work is none to fun, if you don’t know the rules of the road you can easily end up selecting wrong and misleading data, and therefore creating a misleading chart.

Howard Wainer, the author of the book, starts with a discussion of standard error. He highlights what he calls “De Moivre’s Equation,” which helps us determine sample sizes to protect us against errors of sample size. And if that is confusing to you, it can perhaps be best summed up this way: small sample sizes give way to greater variability of results, making it more likely that your results will be misleading. If you aren’t aware of this issue then you could end up charting things like: boys are smarter than girls; and small schools are better at educating our children than large ones (both of which are untrue, just so we’re clear).

And while I haven’t even read half the book yet, I already highly recommend it to anyone who has anything to do with presenting data. While grabbing any old data set and firing up Tableau Public (or whatever your tool of choice is) can be fun like hellfire and hotcakes, it is the process of thinking through the data, and being aware of its foibles, that really helps make a chart meaningful.

Don’t sink the Titanic!
titanic

~alex

Comments OffTags:

The Baltic Dry Index. A misleading economic indicator …?

July 19th, 2010 · Economics

For those of you who follow such things, it has certainly been interesting to note the decline in the Baltic Dry Index (or BDI). I have, for the moment anyway, a chart of the BDI in the right column of this blog. A quick glance will show you its direction. Namely: down.

I wasn’t the only one who was wondering at the decline of the BDI, and stories from The Economist and FT’s Lex discuss the meaning behind it.

The Economist says:

There are growing doubts, however, about what the Baltic Dry is actually signalling. The confusion is whether the index is saying more about the supply of ships than the demand for their cargoes. The index spiked dramatically in 2008 as China’s imports of commodities soared at a time when the supply of ships was constrained and port congestion added to demand for capacity (see chart). The financial crisis soon caused the index to fall back but not before this period of dramatic growth in demand from China had prompted a surge of orders for bulk carriers, especially the very largest ones that are used on the China trade routes.

These ships take around three years to come on-stream. Despite the cancellation of some orders the new ships are now flowing in: in the first half of this year the global fleet increased by 23% as new vessels came into service at the rate of 16 a month. There are now 23 such vessels arriving each month, adding to oversupply.

So, oversupply of ships? The FT’s Lex concurs:

Several analysts have poured cold water on the BDI’s prescience though, given some obvious distortions. It takes about three years to build new capacity and, as the peak of the commodities bubble was two to three years ago, new ships are now depressing charter rates. The global fleet has expanded by about a quarter this year alone. For now, other indicators of commodities demand trump the BDI.

Cross-checking with ostensibly similar global measures such as air freight sheds little light on the matter, but rail traffic compares more reliably. Trains carry the same types of materials as shipping and volumes rather than tariffs are reported while capacity changes only slowly. American carriers provide the most detailed and timely data and they continue to report outstanding year-on-year gains for tonnage of key industrial commodities such as metallic ores, coke and lumber, up 93 per cent, 28 per cent and 11 per cent for the first 27 weeks of the year, respectively.

However, both articles hedge their bets. With the threat of a double dip recession, that’s probably smart. And if it comes to pass, the BDI may not be so misleading after all.

~alex

Comments OffTags:

Whither prediction markets?

July 13th, 2010 · Prediction Markets

It really didn’t seem that long ago that prediction markets were world beaters. Prediction market supporters knew they had the best predictive mechanism around, and they were not shy of saying it. They could predict presidential elections, Oscars, and average yearly rainfall in NYC, among other things. Prediction markets were even floated as a way to make legal and policy decisions. A few years ago there was a sense that prediction markets were about to take off. Have they?

Well, it’s true, they haven’t taken the world by storm, but, based on my (extremely) casual observations, there appear to be two main themes in the prediction markets arena of late.

1. Fewer, but more serious, offerings.
One sees fewer of the random prediction markets that used to pop up all over the place. Yootopia, Washington Stock Exchange (WSX), ProTrade, PicksPal, and so on. Even News Futures seems to have gone the way of the Dodo. But that doesn’t mean that new prediction markets aren’t happening. Witness the Hollywood Stock Exchange finally getting its real money market. And Mr. Pennock’s Predictalot.

In other words, fewer prediction markets are coming from hobbyists and idle entrepreneurs. Now it appears that new prediction markets have real money behind them, or at least a serious agenda.

And if they’re happening in the corporate world, well, we’re just not hearing about them.

2. (Even) more skepticism.
Take this recent quote from Constructive Economics.

I ultimately believe that a real-money HSX is unnecessary. These markets are supposed to provide a way to hedge risk on people seeing films (of course, shouldering such calculated risks should be the whole purpose of a studio in the first place, but regardless…), but if I were a studio with exposure risk on box office returns I would shop that risk around to creative hedge funds with good models willing to take an equity gamble. The two big things a market provides, consolidation and anonymity, are just not necessary in this scenario. On every contract there’s just one movie and one seller of exposure risk.

Certainly there was always intellectual rigor in the prediction market community, but that always seemed to take the form of true believers debating who’s using the best formula for automated market making. Now people are questioning whether a prediction market should even exist! Egads, where have we gone?

Furthermore, some of this sort of talk is coming from our prediction market luminaries (or at least under their guidance). Take the recent paper (pdf download) by Sharad Goel, Daniel Reeves, Duncan Watts, and Dave Pennock. Here they assert that, sure, prediction markets are better are predicting the future than other methods, but not so much that it makes a difference. In other words, why waste you time setting up a prediction market when you can just use a (gasp) poll!?!? The results will pretty much be the same.

Somewhere I feel like I can hear John Maloney talking about industry maturity, but that doesn’t quite seem right. Prediction markets, as an industry, doesn’t feel any further along than three years ago. Which is quite sad, since I think some people had high hopes selling prediction markets to all the companies in the world.

Maybe it’s the recent recession. Maybe it’s that I just don’t care as much as I used to, but prediction markets still seem like they have a ways to go before they are widely considered a useful tool to people other than gamblers, media companies looking for a quick story, and academics.

~alex

→ 1 CommentTags: