Tuesday, June 28, 2005

Local Media, Technorati, and Vertical Search

I am sitting here at SDForum's "Vertical LEAP" vertical search conference, where I've sat through a local search presentation from Google, Yahoo, Ask Jeeves, and MSN which pretty much missed the point entirely. I asked a question about a) events and b) local search as local media, since neither (enormous, gigantic, huge) topic had been mentioned by any of the assembled gigantic players. Credit to Brady Forrest, PM at MSN for their local search, for at least mentioning mobile -- yet another (enormous, gigantic, huge) topic they'd entirely slid past for a whole hour. If these guys get it, then they're holding their cards very close to their chests.

I'm working on an events search company called Zvents, which heretofore is unannounced. So there. I announced it. Secret closed demos on the web in a month, live beta by September, or faster if Tyler starts adding Red Bull to his coffee.

So I am spending a lot of time thinking about local media. And none of these local guys get it at all, and at the same time, Technorati (hats off to Dave Sifry!) gets it in a (enormous, gigantic, huge) way. I'll be the Nth guy to link to the Live8 page, and the second or third guy to link to Peter Caputa's discussion of that page (right on Peter, and we should talk about events) and I'll even throw in a bonus link to Chew Shop on Caputa on Technorati.

So what do I think?

Well here are a few relevant facts.
1) Local media is enormously fragmented. There are 70 newspapers in the Bay Area, plus tens of TV and radio stations, and they are *all* supported by ad dollars.

2) Classified ads were a nice chunk taken out of local media, but those dollars are largely gone; high-value categories like jobs, housing, and for-sale went to Monster, eBay, and the like long ago.

3) The three legs of local media are 1) reporting 2) editorial and 3) advertising. Let's take these in order.

Reporting: When we look at a project like Dan Gillmor's open media / bayosphere / We the People, you see the foundations of local reporting. Remember that this is not just going to be people doing this in their spare time -- we are going to get latter-day Ben Franklins running around researching stuff and writing it up (or podcasting or vblogging it) and publishing it online. Reportage = conceptually sorted, 20 years of implementation to go.

Editorial: I have a whole separate riff about how political blogging and tech blogging represent the explosion of the vertically integrated media model -- guys like Kevin Drum or Joshua Marshall provide me with more editorial insights than does the New York Times; but for the moment, they are reliant on the "MSM" mainstream media to provide the basic grist for their editorial mills. Most interesting to me is the extension of editorial blog voices beyond the narrow reaches of politics and emerging technology. I firmly believe that the reason these "went first" is that the foundation of bloggable news was firmly in place in textual form, and the blogging tools that sprang up made manipulation of that text very simple for bloggers. Myspace is actually an example of music blogging, I think -- 18 million people go there because, fundamentally, they gave indie bands the (different) tools they needed to post MP3s, talk about their shows, and post their band/brand image online. I think that with the emergence of "structured blogging" standards for other categories -- shopping, events, finance, and so forth -- we will see and explosion of new blogging editorial categories as, for instance, a financial blogger can quickly and easily point to financial data and charting information to make his (her) points.

Advertising: This is the part of local that has gone the furthest, and the least; local classified (in certain categories) went 10 years ago, but local newspaper display, local TV and radio, and lots of classified -- plus flyers, posters, billboards, etc. -- has yet to go. And we are talking tens of billions of dollars. It will follow the eyeballs, which will follow the tools, editorial voices, and reportage that is already moving to new media.

Technorati gets the media thing, as demonstrated by the Live8 page -- but it's not clear that they get the local media thing, which fundamentally has shaken out to be an oligopoloy the first time around between Knight-Ridder, Hearst, Tribune, Gannet, etc. with very little local competition. Will it happen that way again? I'm not sure - and this Technorati thing may be the emergence of a new NBC or a new USA Today, not a new Knight-Ridder -- but what I'm sure of is that none of the local papers get this, none of the big portals get this, and there is money laying all over the table to be scooped up.

Game on.

P.S. How much has the world changed? This places is full of VCs and entrepreneurs and the nicest thing that's happened to me today is that Marc Canter linked to me in his blog. Thanks, Marc!

Monday, June 27, 2005

Response to Kevin Drum - Three Thoughts on Future Media

In light of the recent Supreme Court decision on file-sharing, political blogger Kevin Drum asks:

"The year is 2015 and Columbia has just released Spiderman 7. The next day, 10 million people with no technical savvy at all go to their computers, stick a Blu-ray disc into their DVD drive, log on to Movies4Free... Three minutes later they have a 100% perfect DVD...As bandwidth increases, DVD technology improves, and software becomes as easy to use as a toaster, every piece of digital content on the planet will be available within minutes...Is this OK? Or do you have a different vision for the future? If profit-based movie/music distribution becomes essentially impossible, do you think the content industry will somehow adapt and get its revenue elsewhere? Or will content creators continue creating but just make a lot less money at it?"

Three thoughts:

1) Right now, radio broadcasters make more money from music than music labels do. U.S. CD sales are $17 billion, radio advertising is $20 billion. Broadcasters' ability to take the labels to the cleaners for the past, oh, ninety years is due to a court decision in the early days of the 20th century that set the recompense rate exceedingly low. The NAB has had enough political clout to keep it there ever since. Cool, huh? Note that they make all this moolah by... giving songs away for free.

2) Before Caruso (correct me if I'm wrong on this) there were no recorded-media stars, and instead there were many more local peformers of moderate skill who played directly to the people (y'know, live) and made a decent living doing so. If the hyper-promotion of mediocrity machine that is the labels goes away, perhaps we can move somewhat back in the direction of this former model. Quality will still rise to the top; with free distribution of songs, it would do so as a matter of course. But if the primary payment mechanism for musicians was for *playing music* instead of recorded album sales, then, it would be terrible! No one would get more rich than Jerry Garcia. Have you ever seen Jerry Garcia's house? That sounds OK to me.

3) Movies are a very social medium with extremely high costs of production. Right now, they emphasize cost-of-production over, say, quality. I get better acting at my local theatre than I do in watching a Jerry Bruckheimer $200m extravaganza -- but the "production values" of the local theatre are a bit lower. If production technologies get cheaper (and they will!) then the local theatre can start to compete -- meaning that we'll get a much wider base of content producers, similar to today's documentary situation. Unlike music, it's not unreasonable to hyper-encrypt movies during their initial "theatrical" phase and only show them there -- people seem to like watching movies together, and after you've made back your (much smaller) costs of production plus some profit, you throw the thing into the maw of the collective and start working on your next piece. Again, surprisingingly similar to the local-theater model, which seems to work just fine.

Trackback

Tuesday, June 21, 2005

So what about tag spam?

Tyler asks me another question:
"I'm a little concerned about tag spam. Is this a problem on Flickr and other sites that allow communal tagging?"

So I went and did a search.

I haven't found any discussion of it as an issue. Comment spam on blogs and comment trolls, on the other hand are well-known and much-discussed problems; none of the solutions are perfect, but include:

- Registration (know who posts something)
- Moderation (increase or decrease visibility by editorial intervention)
- Deletion (the ultimate in editorial intervention)
- Complication (making spam hard to do quickly and automatically)

Tag spam might be different than blog comments, because:
a) You can't include a URL (which spam needs to do in most cases to be effective)
b) You can't express yourself to others in a personalized way (which most trolls seem to want to do).

So it may be anodyne enough to not really be useful to vandal communities. Just a guess.

Some related links:
A loooong but fairly interesting post about tags. No mention of spam. John Dvorak pans tagging in PC Magazine. Some brief thoughts on vandalism in reply to Dvorak -- apparently del.icio.us has had some spam Another reply to Dvorak. A flat-out awesome post on the meaning of RSS

Are Tag Clouds Useful? And how to make them more so

Tyler asked:
"Is there a better way to display tag utilization than the tag cloud?"

I would say yes. The "tag cloud" was a cool concept but I find it of limited usefulness. Its axes of meaning include:
1) inclusion (vs. exclusion - the cloud is finite)
2) font size
3) order

I have seen clouds ranked both alphabetically (another one) and ranked by use; when listed alphabetically that means that there is only one axis of meaning (aside from the set limitation of inclusion) which is font size.

It would be possible to include font color as another axis, and even bold vs. italic, but what does that tell the user? It will not be clear.

Absolute popularity is a moderately interesting feature of tagclouds that, frankly, is best represented by a list; I assume that the reason that tagclouds were first done is that the resultant visual mass fits more neatly on to a web page than a 100-item vertical or horizontal list.

Here is an idea that might make tag clouds more useful: Create an actual honest-to-god 2D map representation of them. Sort of like a network diagram, but all node and no connection between node. User types in a tag -- "chocolate" and you create a custom 2D map based on "events that include tag chocolate also include these tags" and then let the user scroll around on that map or click on that map, in Google Maps fashion (can you tell that I have been profoundly influenced by Google Maps? ;-) and get to "food" "wine" "laborador" "ghirardelli" "roses" or whatever, and gradually scroll away to the outer bounds of the related-tags-surface.

Now what you have is a tagcloud that shows not overall popularity (a "who cares" feature -- when was the last time you checked out Google Zeitgeist, much less derived some useful information from it?) but relatedness to something the user cares about, presented in a navigable visual form.

Might be interesting.

Tuesday, February 22, 2005

How Google, A9, and Flickr create those awesome new web interfaces - "Ajax"

I recently wrote a short post about the fast and fabulous new web interfaces we're starting to see, which are changing how web apps work, and making them ever so much more rich and interactive -- for the first time, a real threat and alternative to the desktop.

Now we are getting some great insight and writing about how this is done.

Quoting Jesse James Garrett:
Take a look at Google Suggest. Watch the way the suggested terms update as you type, almost instantly. Now look at Google Maps. Zoom in. Use your cursor to grab the map and scroll around a bit. Again, everything happens almost instantly, with no waiting for pages to reload. Google Suggest and Google Maps are two examples of a new approach to web applications that we at Adaptive Path have been calling Ajax.
The name is shorthand for Asynchronous JavaScript + XML, and it represents a
fundamental shift in what’s possible on the Web. Ajax isn’t a technology. It’s really several technologies, each flourishing in its own right, coming together in powerful new ways.
Again, all credit to the link which led me there:

Preoccupations: "Ajax, who he?"

Marc Canter is a genius -- the "Digital Lifestyle Aggregator"

This is one of those off-the-top-of-the-head posts that would be oh so much better if I polished it and edited it and moderated the tone a bit. But I am really, really geeked out at finding Marc Canter's 10-month-old post on "Digital Lifestyle Aggregators" which is near enough to a spittin' image of what I have been working on for the last year, knowing nothing of this essay. We call our version the Extended Conversation, and since we're coming in from a telco tack, we are spending a lot of time thinking about voice and phones as a crucial component of this -- something that I think the largely web-based thinking of the U.S. folks may have missed. Or, I could just be a prisoner of the installed base of my client -- as Marc says, "...Based upon what assets, IP, market position, resources and existing technology base – each DLA customer will have their own unique set of requirements and implementation details..."

So true.

Marc says he works for Tribe.net, though he also says he hopes they fire him. Is this what Tribe is doing? Not that I was aware of... will find out.

Updated: Mark runs Broadband Mechanics, which is a technology provider to Tribe.net among [apparently] many other firms.

All credit due to the links that led me there:

"Thoughts on the Digital Lifestyle Aggregator"

"From blog to DLA" (tb)

Thursday, February 17, 2005

Three quick links - Web2 calendaring and mapping

Want to capture these though I don't have time to comment right now.

1) JWZ aka Jamie Zawinski of Netscape (past) and DNA Lounge (present) on "Groupware, Bad!" and the perils of not getting your customers laid... I found this via the peripatetic Tim Bray.

2) A guy I never heard of before, JGWebber (Joel), who I found via JWZ's site. He has a very detailed analysis of the nutz n boltz driving Google Maps, which incidentally was created by a friend of a friend. Under the radar, Google is doing a lot of hiring-by-acquiring in the Bay Area. About a year ago, I told this guy that he was totally wrong to be working on this project. So much for my omnipotent authority (re: another forthcoming post on that subject...)

3) A company I never heard of before, SandCodex, which has some interesting interface and mapping technology. Well, the demo is cool, anyway. I got this from JGWebber's site.

That is an example of the extended conversation... Maybe I should revisit del.icio.us for this kind of thing.

Thursday, January 27, 2005

So what does A9 Yellow Pages Mean?

I try to avoid me-too "look what just happened" blog posts, and despite a ream of content on that last amazon post, a lot of said content fell into the "wow how cool" hand-waving bucket.

Before I natter on a bit more, John Battelle (as usual) has nailed it in pithy form in his Business 2.0 story:

It's pushing Amazon's virtual-commerce business model -- where you can buy
anything you want online -- into the bricks-and-mortar local retail space.
Amazon wants to be part of any kind of commerce.

Update: And finally, before I natter, check out this very funny note from John Aboud, via Seth Godin.

Commence my nattering. Here's what this announcement actually means:

1) Amazon used to sell stuff. Call that the "database model" where they shipped first information, and then goods, from a centralized location.

2) Amazon created the marketplace. Call that the "network model" where they acted as an info-mediary who brought together buyers and sellers, with goods shipped around the periphery of the infospace, peer-to-peer, without Amazon actually ever touching them.

Note that quarter to quarter, Amazon derives either a majority, or all, of its profits from the marketplace.

3) Now Amazon has created what I would call the "embedded network model" which extends the network model into the fabric of everday life. Contrast to the marketplace -- you don't care who the seller is, or where the seller is, you just want the goods you found on this mystical Amazon site to show up at your doorstep. In the "embedded network model" Amazon is enabling you -- with your real location, real needs, and real-world context-- to seek out merchants who are also local, physical, and with whom you may interact directly. Today, it's not really embedded -- it's just a first-step extension of the marketplace model. But look where it can go:

1) Amazon links to the catalogs and inventory of the merchants, and you can search that. Amazon provides "merchant tools" (which eBay and PayPal are also working on) to help merchants do this.

2) Amazon offers its Visa card/shopping cart as a pre-payment system for its users. Want a pizza? Find it online, order it online, pay online, and go pick it up.

3) Amazon, working with a delivery partner, enables local delivery from local merchants for same-day, or perishable, goods. Speciality grocery + Amazon = WebVan 2.0??

And these are just the commerce implications. The non-commercial (social) implications are even more interesting -- see my previous comment on the Viper Room. Very, very interesting.

Google Voice - The Extended Conversation

The problem with the extended conversation it that it happens in so many places that sometimes, it's hard to consolidate, even in your own mind.

January 17:
First, there were rumors of Google getting into the voice business.
Then, John Battelle posted a piece on the rumor.
Where I wrote a comment.

For a week, it was all quiet on the Western Front.

January 24:
And then the whole world went absolutely apeshit.

And, incidentally (or not?) some guy from Bulgaria named Dimitar Vesselinov posted a comment on Battelle, nailing the issue:
It makes sense. Why? Do you want to search for your voice data? What about
transcripts? People want this kind of information and I suppose they will get
it. It’s about the data, stupid!

Throughout this all, I somehow had an image in my mind that I'd written a pithy post about all this and put it up here, but somehow, I never did so. This is now that (non-pithy) post.

Ahem. Let me discuss the Extended Conversation.

Oh, hell, let me just demonstrate it by linking to a photo on Flickr of a slide that I've made which introduces the "why" for both the Extended Conversation, justifies Google's move, and agrees with Dimitar, all in one go.

See? Wasn't that cool? It comprised multiple forms of media, hyperlinking, tagging, user-created content, diary --> conversation --> publication fuzziness, and about twelve other principles of What's Going On here in this new new world.

We used to have "conversations" on the telephone. Some of us had "correspondence" via letters, but not since the days of Voltaire could letters be considered "conversations". (Incidentally, did you know that in London, the Post Office delivered mail four times a day before the advent of telephony?) Then we added email, and IM, and suddenly the web went broadband and storage got cheap, and somewhere in there search engines actually started to work, and then a bunch of crazies went and invented the whole blogging paradigm, and there were digital cameras everywhere, and social networks had their moment of glory but left a lasting impression, and then (finally, in the US!) cellphones started getting smart instead of dumb (if only mobile operators would follow, the dummies!) and we are starting to see the emergence of this big gnarly thing called the extended conversation that is going to encompass everything in exactly the same way that the phone system used to touch on everything, except this time we aren't just stuck in voice, and we can tie it all together in a pretty package with a bright red ribbon.

Some people call this Web 2.0. I call it the Extended Conversation.

So let's look at Google. I think they get all, or most of this, already. Firstly, they recognize that search changes how you use information, most especially when you've got a lot of info to manage. Do you even look at the call record on your phone bill? Probably too much information. Do you search back through your email inbox to find stuff you wrote a month ago? Of course you do, because you can, especially with Lookout or Google Desktop or one of the really useful personal search engines.

They get user-created content, too. They have blogger, they have Picasa, they have GMail. They just launched Desktop. They get that user-created content equals communication... I think. When you look at the SIMS study, it's clear that the vast majority of "the world's information" which Google is determined to search is user-created content (see the Hal Varian "How Much Information" SIMS Berkeley study) or read the fantastic article "What's Next for Google" that Charles Ferguson wrote for MIT's Technology Review a few months ago, you can't help but think (if you are a Googler) OK, what are we gonna search/own/monetize next? And the big flaming answer is voice, voice, voice.

So yeah, they're gonna do Google Voice. But maybe not yet.

Why are they gonna do it?

Because all the content in the world comes from people, and most of it is voice.

How are they gonna do it?

Well, if I were a Googler told to do this tommow, I'd turn some of those 250K Linux servers they have into POTS NAPs around the United States and Canada, and I'd run Asterix on them (or a highly robust Googlized version of Asterix) and I'd throw the UI to it in with GMail (or keep it separate, but hold hands with GMail behind the scenes) and make a great inbox and outbox and CDR function, and record every call (allowing the user to delete, etc., just like email) and allow calls to be annotated and hyperlinked and blogged and so forth... and maybe even think about real-time linking of points within the call and what I am doing in the browser, for instance while I am talking (via Google Voice) I do a Google search, and that search is tagged and linked to that moment of the conversation. Whammo, you have a really compelling application-level extension to voice, and another knee in the groin of the dumb transport companies.

Oh, my. This is gonna be a fun decade.

Amazon takes a whack at telcos -- application trumping transport

A9 just annouced a way-cool extension to the Yellow Pages concept. From the Washington Post:

For the past several months, a fleet of nondescript vans equipped with digital
cameras and proprietary computer software has been traversing the streets of
several major U.S. cities, continuously photographing businesses on every block.
Operating secretly under the code name "Project Mercury," the vans have
transmitted more than 20 million images to a database compiled by A9.com Inc., a
wholly owned subsidiary of Amazon.com Inc. A9 set up shop last fall in Silicon
Valley, far from the Internet retailer's Seattle headquarters, with the goal of
creating new search technology for computer users to hunt for information and
products on the Internet.

Today, millions of the photos, coupled with their corresponding electronic yellow page listings, are scheduled to become available on the A9.com Web site. Only businesses that have paid to be in the A9 yellow pages will be featured. A9 will invite those retailers to take digital photos of their own that can be added to the Web site, potentially taking computer users inside stores to view merchandise.

A9's offering includes a way for computer users to take notes in an online "diary," and save and search the comments. It also offers a feature that automatically connects users to businesses by phone. Users input a phone number on the Web page, and, with a click of the mouse, can effectively be connected to any of the businesses listed free of charge. Special software connects the call by ringing a user's phone and the line at the business.


Here is an example search result from Boston.

There are two important points here. The first point is that geography is really, really important. The fact that all these businesses have a location matters to their customers; the fact that Amazon has GPS-tagged all the information around the pictures and listings is what makes this service work.

The second, even more important point, is that communications is becoming an extended conversation, and applications are trumping transport. When the world was about plain vanilla POTS, being a transport company (hello, AT&T) was a very valuable thing to be. But on the day it is announced that SBC might buy an AT&T that is a shadow of its former self, Amazon announces a feature that -- almost incidentally -- offers a free phone call between the user of its website and the merchant they are trying to reach. Given that the original intent of the yellow pages was to stimulate phone calls to businesses (and charge for the phone calls) that's an incredible turnabout.

Coupled with the potential for Google to get into the VoIP market -- again, as an extension to its current application-centric business of enabling conversations, not communications -- this now qualifies as a trend.

Incidentally, this also demonstrates that Time Warner was exactly right to buy AOL. They just bought at the wrong time, and may have bought the wrong company.

Also incidentally, the ability of users to add their own photos is really important. If Amazon is smart, they will allow a lot of clustering and linking to happen that has *nothing* to do with the core commerce focus of their yellow pages -- for instance, people linking their party photos from the Viper Room in LA to the geo/location of the Viper Room. There are all sorts of eVite possibilities here, too... it just goes on and on. Welcome to the future.

Finally, last incidental point -- Flickr had better get all the way to platform status soon, or sell themselves to the highest bidder, or they are going to be overwhelmed by the rollout of smart photo-inclusive features like this one.

Voice will be taken over by application providers if the telcos don't do something smart, or something sneaky (AKA regulatory relief). Get hot, boys...

Monday, January 24, 2005

Bellster, Technorati, Slashdot?

When I do a search on Technorati (5:40pm PST, 1/24/2005) for "Bellster" Slashdot is not any of the 41 results, even though Slashdot has a 128-comment post/article on Bellster that was created at 1/24/2005 at 5:08pm EST (3.5 hours ago). Why is that? Too recent? Slashdot hasn't implemented Dave Sifry's server-side code? Will try again tomorrow.

Update: It showed up on 1/25 at about noon.

Jeff Pulver at play again: Bellster launches

As noted by Kevin Werbach and others, Jeff Pulver, the originator of FreeWorldDialup, the Pulver Innovations WiSIP phone, and a host of other telco-tweaking apps, is at it again. He's launched Bellster, which allows its participants more-or-less no-extra-charge phone calls worldwide. "No extra charge" is significant because it's not free -- in order for the service to work, each participant has to have some sort of reasonably bulk usage plan in their local calling area/country.

My take? RIght now, the short answer is, it's a stunt. A cool stunt that is interesting and will cause big telcos more worries than actual revenue problems. Like BitTorrent, its gnarly technical requirements will keep it from touching more than 1% of the userbase. Basically, you have to set up a dedicated Linux Asterix PBX server in your house to share your phone line with others. Not something that the average user is going to do.

Now... when someone rewrites Asterix into a PC application that runs on Windows, with a slick user interface a la Skype, and adds Bellster functionality, and says to every dummy (cough) user in the world, "Plug your phone line into your PC, download our app, and you get free phone calls worldwide" ... then, the telcos have a problem.

Friday, December 17, 2004

The three-axis auto-match and Match.com

I met my girlfriend, Andrea, through Match.com, and thus I view the capabilities of such matching services in a fairly positive light. However, onece one sets out on the quest of finding across distance that "perfect someone" via multilple search categories, one must commit to the notion that an ever-more-perfect search mechanism will yield ever-more-perfect results.

The previous post on Matt Jones' bookshelf and my forthcoming post on location-based blogging beg the question -- what are fast and easy ways to identify whether someone is likely your type? I would argue that you can analyze three axes and get very good results on the interesting-conversation front, and probably the I-want-to-date-you front as well:

1) Personal: Height/weight/gender/gender preference/availability. Just the basics.
2) Bookshelf: What do you have on yours?
3) Geo-log -- where have you been, and how much time have you spent there?

Voila. A whole new way of doing dating.

More on Amazon - "My Work Bookshelf"


My Work Bookshelf
Originally uploaded by blackbeltjones.

Someone with the screen-name 'blackbeltjones' has uploaded his work bookshelf onto Flickr and annotated the jpg with the actual titles of the books. Can I just say that a) Flickr rocks b) this is a cool idea and c) this is an obvious extension of the content of my previous post on this subject. Prabal, are you taking note?

Click through on this photo to the right, and the full coolness will be revealed.

Tuesday, December 14, 2004

Real search engines and great search engine humor (no, really!)

If you think that Google is the end-all and be-all, read John Battelle on IBM's WebFountain. Wow. That is how a search engine is supposed to work, but the reason you can't access it is that it costs too much per query to give to you for free, and you're too cheap to pay for it.

I can't remember where it was that someone pointed out to me that the true genius of Google wasn't that they created such a great search result, but that they created a pretty decent search result on a less-computational-cost-per-search than could be repaid by advertising. Per might remember, I need to ask him. (task placeholder)

I am going to cross-post on WebFountain over at Onohoku (link placeholder) because this is the scary shit that is destroying the middle class as we know it, in both corporate and governmental applications. Technology can make you free, and it can also make you a robot (which means 'slave labor' in the original Czech)...

The Battelle piece also led me to a truly wonderful self-parody hidden within the Google corporate site. I won't spoil it other than to say fly over there now and check it out!

Monday, December 13, 2004

More on Amazon and the extended conversation

On a day when Google announces that they're digitizing a number of major libraries, Prabal and I happened to be having a conversation about Amazon and where all this virtual/physical stuff is going.

Here are a couple of datapoints.

Firstly, Amazon has this handy "search inside the book" feature which allows full-text searching of books.

Secondly, Amazon now does this very handy "this book references... this book is referenced by..." relational search for references to and from the book.

Now. Most people's libraries are made up of books published in the last 20 years. The vast majority of these books have bar codes on them, which either contain or link directly to the ISBN number of the book in some database online somewhere. Here's a scenario:

January 1, 2005: Amazon places a special offer on its website. By clicking in a special box on their order form, for just $5.99, Amazon will include in your order a USB bar-code reader and a CD with special book-organizing software -- kind of like iTunes for your books. When you receive the software and plug in the reader, you can scan the bar code on every book you own; and for the ones that don't have bar codes, you can type in the ISBN or Library of Congress catalog number. That combination will allow your average book owner to get 90% of their library online at a rate of about five books a minute, or a few hours for a reasonable library of 1000 books. Press a button, and your entire library is uploaded to Amazon.

Some trust and fair-use issues would need to be resolved; Amazon might negotiate with the holders of the copyrights that anyone who physically scanned a bar code would get unrestricted search and access to the text of the books online. Perhaps this would be limited to books you'd bought through Amazon, and they would effectively get into the DRM business. Books that you'd typed in the LC or ISBN number would need to be managed a bit more closely; perhaps such books would drive a query from the site to look up and enter a quotation from a chapter in the book, or some such method of ensuring that the customer actually held a physical copy.

This would also lead to issues with people walking into bookstores and scanning books. However, this battle will be fought soon over cell phones with good cameras in them. Already in Japan, it is reported as a serious issue that kids will enter bookstores and snap photos of pages in magazines that are of particular interest to them.

What would the result of such an upload be? Suddenly, one could manage and search one's personal library online. Search from a text perspective, anyway. Soon I'm going to get around to writing about the "fruit theory" which causes me to believe that books on bookshelves -- even lots of them, such as my library of about 3000 books -- are a highly efficient mental model by which to keep track of information. What's a great example of this? Prabal takes pictures of his bookshelves. He has shelves and shelves of books in Ohio, whereas he is in California -- and he knows where on the shelf a certain book is (efficient mental model). With the picture, he can a) remind/search to a greater degree of precision and b) tell his wife Wendy using a coordinate system that he might not remember, but can now communicate, e.g. "it's a little to the left of the big red book on the 2nd shelf from the bottom," and FedEx does the rest.

For manifold reasons, people are always? or at least for a very long time, going to want real physical books. This combined system would be a beautiful way to combine the benefits of the virtual and physical, and Amazon would be dumb or nuts (and they are neither) not to pursue it.

And then... Steve Wozniak is doing virtual/physical integration via his "Wheels of Zeus" startup -- which is aimed at the "where's my stuff" personal RFID market. For a deluxe package of $59.95, Amazon could mail out a combined RFID/bar code scanner and a big sticker sheet of WoZ tags... and not only you, but your entire family , could suddenly find and access all those great books on your shelves.

The combination of web-based management, personal possessions which come from a limited dataset, and scanning/tagging technologies is going to be flat-out amazing. Imagine managing your wine collection this way. Your tools. Your shoes. Anything (unlike CDs) where the virtual must remain no matter how far digitization goes.

This is gonna be cool.

And the best thing is, besides this great conversation, we had a billion-dollar idea tonight! Now we just need a billion-dollar implementation... ;-)

Friday, December 03, 2004

The Extended Conversation

I stole this citation from John Battelle's Searchblog. But it's cool enough that I want to write about it myself.

"Rageboy" has discovered, and briefly discussed, that Amazon is now providing hypertextual citation in both directions -- showing both the books that are cited in Book A, and all the books that cite Book A. This means that you can now not only find out all about Book A, you can quickly ascertain where Book A sits in the entire pantheon of scholarship in its topical field. The similarity of this to Google's PageRank algorithm will not be lost on any of the search cognoscenti, and the potential of that alone is enormous -- in addition to reading review, finding out "people who bought also bought," and looking at best-seller lists, I can now choose my books on the basis of how often they are cited, or how broadly they cite -- powerful applications of the "hubs and authorities" model which underlies PageRank. When this is suitably combined with a nice visualization and discovery tool like TouchGraph, we might really be on to something. Three cheers for social networks of data!!

Thursday, November 04, 2004

Final Results: Givers for Kerry, Takers for Bush

A few weeks ago, I posted a comparison between the Presidential polls and the Tax Foundation's tax tables on state-by-state net federal tax receipts (taxes collected vs. federal spending). Now that the people have spoken, I have updated this table to reflect the final results. It's still a very strong correlation:

Givers for Kerry, Takers for Bush.

No wonder we have an enormous deficit...


tax to vote final 2004
Originally uploaded by onohoku.


Tuesday, October 19, 2004

Types of Social Gatherings

Brainstorming with Andy about different types of social gatherings and their purposes.
This is neither complete nor fully sorted. (DRAFT)

Sports --> Teams get together to compete, fans get together to be entertained and vicariously compete.
House party --> people get together to socially network, which is fun.
Conference --> Information exchange and social networking
Bazaar --> Buying and selling; commerce.
"Activities" --> pleasurable activity -- like dinner (tasty) skiing (fun) hiking (fun and exercise)
"Activities" (b) --> Practice - increase skill for performance or competition
Performance (e.g. symphony) --> expertise/skill (of players) pleasure (of audience)
Cause --> result (fundraiser, politics, etc.)
Collaboration --> work/task
Education --> information exchange only (vs. +social NW of conference)
Interfaces (Waltzbot/DDR; karate-bot; musical instruments that are net-enabled and data-capture-laden)

Types of outputs of work/collaboration:
--> document
--> object a car, a chair, a house)
--> idea (this brainstorm... if we didn't write it down - docs are frozen ideas)
--> other action (e.g. Karl Rove gets you to vote Republican; his action begets your action)
--> performance? How does practicing for a play fit in? What is created there?

Thursday, October 14, 2004

Divded States: Givers for Kerry, takers for Bush?

Timothy Noah wrote an interesting piece on Slate today, which defends Massachusetts against the implicit attacks which George W. Bush levelled against it last night. The core of Noah's argument is that the much-maligned liberal hotbed of "Taxachussets" pays a heck of a lot more into federal coffers than it takes out -- in other words, it is a net giver to the country as a whole.

He links to Tax Foundation table of federal expenditures and receipts state-by-state.
I found this table absolutely fascinating.

I dropped this data into Excel, re-ordered the states by their FY2002 rank, and created a new column which represents the current (as of today) state poll standings for Kerry vs. Bush, taken from electoral-vote.com. Using Excel's handy conditional formatting, I colored this column blue if Kerry is +4 or greater, red if Bush is +4 or greater, and grey if the state is from -3 to +3.
The results are quite interesting, to say the least.
I am happy to send this original Excel document to anyone who wants it, but I have attached, for easy viewing purposes, a .jpg of the table. The main impact is visual, and the message it conveys is simple:

States which are net givers to the federal pie predominantly vote for Kerry, while states that are net takers from the federal pie predominantly vote for Bush.

This Bush hegemony of the dependent includes a large number of Western and Great Plains states where the "culture of self-sufficiency" and derision of poor urban welfare freeloaders are wildly predominant points of view.

A couple other observations jump out:

1) Just 16 states (about 1/3) are net givers, while 32 (about 2/3) are net takers. Two (FL, OR) are even at 1.00. This means that, grossly speaking, the givers have large economies, while the takers have small economies. Since the leading 16 are dramatically more liberal than the trailing 32, we can also conclude that as one's economy grows and one's state becomes more prosperous, it also becomes more liberal.

2) This is most aptly demonstrated by the case of Colorado, which has leaped 17 places on the list between 1992 and 2002, from significant net taker (1.06) to significant net giver (.79). In the same 10 years, the modern economy of Colorado has exploded; its population has vastly increased; and the state has become significantly more liberal, to the point where it remains very much in play for the Presidental election, despite its as-of-today +6 for Bush poll standing.

I could go off in any number of directions with this data set, but I'll leave that to the members of the list. If I have the time, I intend to drop in some state GNP data, and also electoral-vote data and possibly population data, so we can see the typical profile of liberal vs. conservative states.

Two points that I will add are:

a) I am just now finishing Neal Stephenson's 3-volume, 3000 page novel on the Baroque era, when both the Scientific Revolution and the commercial revolution transformed first England, and then the world. Stephenson has done a superb job of laying out that the competing factions of Whigs & Tories in England fought, quite explicitly, over whether the wealth of England would be based on commerce (the Whigs) or on land (the Tories, allies of the aristocracy). Fortunately for all of us, the Whigs won - I'm much happier as I am that I would have been as a gentleman's man-servant, I suspect. This recent exposure to these ideas, when added to the visual impact of this attached data, causes me to wonder if similar arguments can be made -- on the basis of this hard data -- about the different political parties of the United States.

b) I am going to go way out on a limb, and say that not only will Kerry win the election, but that he will win the election by capturing swing states Colorado, Ohio, Wisconsin, Pennsylvania, Michigan, Nevada, Florida, and New Jersey. A glance at the list will demonstrate why I chose these.