Tech-related musings. Occasional rogue war pieces. Hosted and led astray by Ethan Stock, founder and CEO of Zvents. This blog reflects my own views, not the position of Zvents.
Wednesday, June 29, 2005
Flickr takes Yahoo Social: My Web 2.0
Today Tyler drops me an email saying "Check out Yahoo's new My Web 2.0, it's social search and it's cool." And lo and behold, who's writing the Y! Searchblog section for MyWeb but Caterina...
Damn, it is cool. It's delicious Yahoo search.
So what does this mean? Well, there are four fundamental ways to ways to determine relevance in search results. These are:
1) Market/collective/algorithmic - Call it the law of large numbers, the wisdom of crowds, or statistical truth, but PageRank and similar "hubs and authorities" algorithms figure out, on average, what everybody thinks of a given site.
2) Expert/editorial - Roger Ebert on movies. Julia Child on cooking. Henry Kissinger on diplomacy. They've spent a lifetime figuring out what is the best, and the'll tell you so. Yahoo's roots are in this sort of directory/taxonomy/recommendation based organization.
3) Personal - Based on the user's past history and demonstrated interests, give them results that most closely match their tendencies. Amazon's A9 is the best current example.
4) Social - Based not only on the user's past history and demonstrated interests, but on those of all the people they know. This is a fascinating middle ground (possible sweet spot?) in between personal and collective/algorithmic -- you've got enough critical mass of opinions on key topics to hopefully eliminate outliers, but you've got a close enough connection to the user that you can bend your results to match their point of view.
A note on tagging: Tagging doesn't change any of the above four categories. The voting mechanism -- bookmarking, visiting, linking, tagging, reviewing, whatever -- which is being rolled up in any of the above methods is entirely (OK, largely) independent of the method used. Flickr is all about tagging, but don't forget that they started out as a social network -- and that social sensibility is what they've brought to My Web 2.0.
Google and Yahoo are introducing products like two boxers standing toe to toe and punching. Google is throwing stunning roundhouse technologies like Foreman, shaking everyone's perception of what's possible whenever they land a punch. Yahoo is jabbing and dodging like Ali, clever sneaky punches that do a lot of damage but don't cause the crowd to Oooh in quite the same way.
Ali beat Foreman the second time they fought.
Update: John Markoff in the NYTimes is all over this. He gets the fact that we're talking about the re-creation of local media, too. The curtains just lifted on the future, folks, and the play is about to begin...
Update Update: Battelle, as usual, is all over this first. If you want any more proof that all of media is changing, the fact that his book *still* isn't published (all of, what, three months later?) drives him to asterisked profanity. And to answer John's implicit question, yes, communities of experts will emerge who will tag and organize for a living. They'll be the modern-day equivalents of Ebert, Child, and Kissinger - but they'll express their expertise not in books, columns, and Wall Street Journal op-eds, but tags, blogs, social networks, and other forms of relevance votes, connections, and organizations of information. tb
Tuesday, June 28, 2005
"Inbound" vs. "Outbound" definitions: Vertical search is horizontal!
There are two simple answers to this. Firstly, there's what I'd call "Inbound" vertical search. This means that anyone in the world, at some given point in time, wants to do a certain thing:
Shop
Travel
Get a job
etc.
So the "Inbound" is people (temporarily) participating in a certain type of activity.
Visual:

Second, there's the "Outbound" concept of vertical. This is the sort of vertical that business-to-business publishers like Primedia and CMP and Reed Elsevier have been working on forever. Oh, and there was this cool "bricks and clicks" company called eBusinessMedia...
Here, the vertical is based on "who I am" rather than "what I do". The music business is a vertical. Agriculture is a vertical. Medicine, with several sub-verticals, is a vertical. Music, agriculture, and medicine all need employment/jobs services -- all need secondary markets for used capital equipment -- all need dedicated industry news sources -- but the "vertical" here is the fact that medical jobs, markets, and news are entirely different from agriculture jobs, markets, and news.
Visual:

Oddly enough, from the standpoint of this traditional view of "vertical," the distinctions that are driving this conference are actually horizontal.
Visual:

Hmmm. Leave it a bunch of technologists in Silicon Valley to mix up their X and Y axes ;-)
Local Media, Technorati, and Vertical Search
I'm working on an events search company called Zvents, which heretofore is unannounced. So there. I announced it. Secret closed demos on the web in a month, live beta by September, or faster if Tyler starts adding Red Bull to his coffee.
So I am spending a lot of time thinking about local media. And none of these local guys get it at all, and at the same time, Technorati (hats off to Dave Sifry!) gets it in a (enormous, gigantic, huge) way. I'll be the Nth guy to link to the Live8 page, and the second or third guy to link to Peter Caputa's discussion of that page (right on Peter, and we should talk about events) and I'll even throw in a bonus link to Chew Shop on Caputa on Technorati.
So what do I think?
Well here are a few relevant facts.
1) Local media is enormously fragmented. There are 70 newspapers in the Bay Area, plus tens of TV and radio stations, and they are *all* supported by ad dollars.
2) Classified ads were a nice chunk taken out of local media, but those dollars are largely gone; high-value categories like jobs, housing, and for-sale went to Monster, eBay, and the like long ago.
3) The three legs of local media are 1) reporting 2) editorial and 3) advertising. Let's take these in order.
Reporting: When we look at a project like Dan Gillmor's open media / bayosphere / We the People, you see the foundations of local reporting. Remember that this is not just going to be people doing this in their spare time -- we are going to get latter-day Ben Franklins running around researching stuff and writing it up (or podcasting or vblogging it) and publishing it online. Reportage = conceptually sorted, 20 years of implementation to go.
Editorial: I have a whole separate riff about how political blogging and tech blogging represent the explosion of the vertically integrated media model -- guys like Kevin Drum or Joshua Marshall provide me with more editorial insights than does the New York Times; but for the moment, they are reliant on the "MSM" mainstream media to provide the basic grist for their editorial mills. Most interesting to me is the extension of editorial blog voices beyond the narrow reaches of politics and emerging technology. I firmly believe that the reason these "went first" is that the foundation of bloggable news was firmly in place in textual form, and the blogging tools that sprang up made manipulation of that text very simple for bloggers. Myspace is actually an example of music blogging, I think -- 18 million people go there because, fundamentally, they gave indie bands the (different) tools they needed to post MP3s, talk about their shows, and post their band/brand image online. I think that with the emergence of "structured blogging" standards for other categories -- shopping, events, finance, and so forth -- we will see and explosion of new blogging editorial categories as, for instance, a financial blogger can quickly and easily point to financial data and charting information to make his (her) points.
Advertising: This is the part of local that has gone the furthest, and the least; local classified (in certain categories) went 10 years ago, but local newspaper display, local TV and radio, and lots of classified -- plus flyers, posters, billboards, etc. -- has yet to go. And we are talking tens of billions of dollars. It will follow the eyeballs, which will follow the tools, editorial voices, and reportage that is already moving to new media.
Technorati gets the media thing, as demonstrated by the Live8 page -- but it's not clear that they get the local media thing, which fundamentally has shaken out to be an oligopoloy the first time around between Knight-Ridder, Hearst, Tribune, Gannet, etc. with very little local competition. Will it happen that way again? I'm not sure - and this Technorati thing may be the emergence of a new NBC or a new USA Today, not a new Knight-Ridder -- but what I'm sure of is that none of the local papers get this, none of the big portals get this, and there is money laying all over the table to be scooped up.
Game on.
P.S. How much has the world changed? This places is full of VCs and entrepreneurs and the nicest thing that's happened to me today is that Marc Canter linked to me in his blog. Thanks, Marc!
Monday, June 27, 2005
Response to Kevin Drum - Three Thoughts on Future Media
"The year is 2015 and Columbia has just released Spiderman 7. The next day, 10 million people with no technical savvy at all go to their computers, stick a Blu-ray disc into their DVD drive, log on to Movies4Free... Three minutes later they have a 100% perfect DVD...As bandwidth increases, DVD technology improves, and software becomes as easy to use as a toaster, every piece of digital content on the planet will be available within minutes...Is this OK? Or do you have a different vision for the future? If profit-based movie/music distribution becomes essentially impossible, do you think the content industry will somehow adapt and get its revenue elsewhere? Or will content creators continue creating but just make a lot less money at it?"
Three thoughts:
1) Right now, radio broadcasters make more money from music than music labels do. U.S. CD sales are $17 billion, radio advertising is $20 billion. Broadcasters' ability to take the labels to the cleaners for the past, oh, ninety years is due to a court decision in the early days of the 20th century that set the recompense rate exceedingly low. The NAB has had enough political clout to keep it there ever since. Cool, huh? Note that they make all this moolah by... giving songs away for free.
2) Before Caruso (correct me if I'm wrong on this) there were no recorded-media stars, and instead there were many more local peformers of moderate skill who played directly to the people (y'know, live) and made a decent living doing so. If the hyper-promotion of mediocrity machine that is the labels goes away, perhaps we can move somewhat back in the direction of this former model. Quality will still rise to the top; with free distribution of songs, it would do so as a matter of course. But if the primary payment mechanism for musicians was for *playing music* instead of recorded album sales, then, it would be terrible! No one would get more rich than Jerry Garcia. Have you ever seen Jerry Garcia's house? That sounds OK to me.
3) Movies are a very social medium with extremely high costs of production. Right now, they emphasize cost-of-production over, say, quality. I get better acting at my local theatre than I do in watching a Jerry Bruckheimer $200m extravaganza -- but the "production values" of the local theatre are a bit lower. If production technologies get cheaper (and they will!) then the local theatre can start to compete -- meaning that we'll get a much wider base of content producers, similar to today's documentary situation. Unlike music, it's not unreasonable to hyper-encrypt movies during their initial "theatrical" phase and only show them there -- people seem to like watching movies together, and after you've made back your (much smaller) costs of production plus some profit, you throw the thing into the maw of the collective and start working on your next piece. Again, surprisingingly similar to the local-theater model, which seems to work just fine.
Trackback
Tuesday, June 21, 2005
So what about tag spam?
"I'm a little concerned about tag spam. Is this a problem on Flickr and other sites that allow communal tagging?"
So I went and did a search.
I haven't found any discussion of it as an issue. Comment spam on blogs and comment trolls, on the other hand are well-known and much-discussed problems; none of the solutions are perfect, but include:
- Registration (know who posts something)
- Moderation (increase or decrease visibility by editorial intervention)
- Deletion (the ultimate in editorial intervention)
- Complication (making spam hard to do quickly and automatically)
Tag spam might be different than blog comments, because:
a) You can't include a URL (which spam needs to do in most cases to be effective)
b) You can't express yourself to others in a personalized way (which most trolls seem to want to do).
So it may be anodyne enough to not really be useful to vandal communities. Just a guess.
Some related links:
A loooong but fairly interesting post about tags. No mention of spam. John Dvorak pans tagging in PC Magazine. Some brief thoughts on vandalism in reply to Dvorak -- apparently del.icio.us has had some spam Another reply to Dvorak. A flat-out awesome post on the meaning of RSS
Are Tag Clouds Useful? And how to make them more so
"Is there a better way to display tag utilization than the tag cloud?"
I would say yes. The "tag cloud" was a cool concept but I find it of limited usefulness. Its axes of meaning include:
1) inclusion (vs. exclusion - the cloud is finite)
2) font size
3) order
I have seen clouds ranked both alphabetically (another one) and ranked by use; when listed alphabetically that means that there is only one axis of meaning (aside from the set limitation of inclusion) which is font size.
It would be possible to include font color as another axis, and even bold vs. italic, but what does that tell the user? It will not be clear.
Absolute popularity is a moderately interesting feature of tagclouds that, frankly, is best represented by a list; I assume that the reason that tagclouds were first done is that the resultant visual mass fits more neatly on to a web page than a 100-item vertical or horizontal list.
Here is an idea that might make tag clouds more useful: Create an actual honest-to-god 2D map representation of them. Sort of like a network diagram, but all node and no connection between node. User types in a tag -- "chocolate" and you create a custom 2D map based on "events that include tag chocolate also include these tags" and then let the user scroll around on that map or click on that map, in Google Maps fashion (can you tell that I have been profoundly influenced by Google Maps? ;-) and get to "food" "wine" "laborador" "ghirardelli" "roses" or whatever, and gradually scroll away to the outer bounds of the related-tags-surface.
Now what you have is a tagcloud that shows not overall popularity (a "who cares" feature -- when was the last time you checked out Google Zeitgeist, much less derived some useful information from it?) but relatedness to something the user cares about, presented in a navigable visual form.
Might be interesting.
Tuesday, February 22, 2005
How Google, A9, and Flickr create those awesome new web interfaces - "Ajax"
Now we are getting some great insight and writing about how this is done.
Quoting Jesse James Garrett:
Take a look at Google Suggest. Watch the way the suggested terms update as you type, almost instantly. Now look at Google Maps. Zoom in. Use your cursor to grab the map and scroll around a bit. Again, everything happens almost instantly, with no waiting for pages to reload. Google Suggest and Google Maps are two examples of a new approach to web applications that we at Adaptive Path have been calling Ajax.Again, all credit to the link which led me there:
The name is shorthand for Asynchronous JavaScript + XML, and it represents a
fundamental shift in what’s possible on the Web. Ajax isn’t a technology. It’s really several technologies, each flourishing in its own right, coming together in powerful new ways.
Preoccupations: "Ajax, who he?"
Marc Canter is a genius -- the "Digital Lifestyle Aggregator"
So true.
Marc says he works for Tribe.net, though he also says he hopes they fire him. Is this what Tribe is doing? Not that I was aware of... will find out.
Updated: Mark runs Broadband Mechanics, which is a technology provider to Tribe.net among [apparently] many other firms.
All credit due to the links that led me there:
"Thoughts on the Digital Lifestyle Aggregator"
"From blog to DLA" (tb)
Thursday, February 17, 2005
Three quick links - Web2 calendaring and mapping
1) JWZ aka Jamie Zawinski of Netscape (past) and DNA Lounge (present) on "Groupware, Bad!" and the perils of not getting your customers laid... I found this via the peripatetic Tim Bray.
2) A guy I never heard of before, JGWebber (Joel), who I found via JWZ's site. He has a very detailed analysis of the nutz n boltz driving Google Maps, which incidentally was created by a friend of a friend. Under the radar, Google is doing a lot of hiring-by-acquiring in the Bay Area. About a year ago, I told this guy that he was totally wrong to be working on this project. So much for my omnipotent authority (re: another forthcoming post on that subject...)
3) A company I never heard of before, SandCodex, which has some interesting interface and mapping technology. Well, the demo is cool, anyway. I got this from JGWebber's site.
That is an example of the extended conversation... Maybe I should revisit del.icio.us for this kind of thing.
Thursday, January 27, 2005
So what does A9 Yellow Pages Mean?
Before I natter on a bit more, John Battelle (as usual) has nailed it in pithy form in his Business 2.0 story:
It's pushing Amazon's virtual-commerce business model -- where you can buy
anything you want online -- into the bricks-and-mortar local retail space.
Amazon wants to be part of any kind of commerce.
Update: And finally, before I natter, check out this very funny note from John Aboud, via Seth Godin.
Commence my nattering. Here's what this announcement actually means:
1) Amazon used to sell stuff. Call that the "database model" where they shipped first information, and then goods, from a centralized location.
2) Amazon created the marketplace. Call that the "network model" where they acted as an info-mediary who brought together buyers and sellers, with goods shipped around the periphery of the infospace, peer-to-peer, without Amazon actually ever touching them.
Note that quarter to quarter, Amazon derives either a majority, or all, of its profits from the marketplace.
3) Now Amazon has created what I would call the "embedded network model" which extends the network model into the fabric of everday life. Contrast to the marketplace -- you don't care who the seller is, or where the seller is, you just want the goods you found on this mystical Amazon site to show up at your doorstep. In the "embedded network model" Amazon is enabling you -- with your real location, real needs, and real-world context-- to seek out merchants who are also local, physical, and with whom you may interact directly. Today, it's not really embedded -- it's just a first-step extension of the marketplace model. But look where it can go:
1) Amazon links to the catalogs and inventory of the merchants, and you can search that. Amazon provides "merchant tools" (which eBay and PayPal are also working on) to help merchants do this.
2) Amazon offers its Visa card/shopping cart as a pre-payment system for its users. Want a pizza? Find it online, order it online, pay online, and go pick it up.
3) Amazon, working with a delivery partner, enables local delivery from local merchants for same-day, or perishable, goods. Speciality grocery + Amazon = WebVan 2.0??
And these are just the commerce implications. The non-commercial (social) implications are even more interesting -- see my previous comment on the Viper Room. Very, very interesting.
Google Voice - The Extended Conversation
January 17:
First, there were rumors of Google getting into the voice business.
Then, John Battelle posted a piece on the rumor.
Where I wrote a comment.
For a week, it was all quiet on the Western Front.
January 24:
And then the whole world went absolutely apeshit.
And, incidentally (or not?) some guy from Bulgaria named Dimitar Vesselinov posted a comment on Battelle, nailing the issue:
It makes sense. Why? Do you want to search for your voice data? What about
transcripts? People want this kind of information and I suppose they will get
it. It’s about the data, stupid!
Throughout this all, I somehow had an image in my mind that I'd written a pithy post about all this and put it up here, but somehow, I never did so. This is now that (non-pithy) post.
Ahem. Let me discuss the Extended Conversation.
Oh, hell, let me just demonstrate it by linking to a photo on Flickr of a slide that I've made which introduces the "why" for both the Extended Conversation, justifies Google's move, and agrees with Dimitar, all in one go.
See? Wasn't that cool? It comprised multiple forms of media, hyperlinking, tagging, user-created content, diary --> conversation --> publication fuzziness, and about twelve other principles of What's Going On here in this new new world.
We used to have "conversations" on the telephone. Some of us had "correspondence" via letters, but not since the days of Voltaire could letters be considered "conversations". (Incidentally, did you know that in London, the Post Office delivered mail four times a day before the advent of telephony?) Then we added email, and IM, and suddenly the web went broadband and storage got cheap, and somewhere in there search engines actually started to work, and then a bunch of crazies went and invented the whole blogging paradigm, and there were digital cameras everywhere, and social networks had their moment of glory but left a lasting impression, and then (finally, in the US!) cellphones started getting smart instead of dumb (if only mobile operators would follow, the dummies!) and we are starting to see the emergence of this big gnarly thing called the extended conversation that is going to encompass everything in exactly the same way that the phone system used to touch on everything, except this time we aren't just stuck in voice, and we can tie it all together in a pretty package with a bright red ribbon.
Some people call this Web 2.0. I call it the Extended Conversation.
So let's look at Google. I think they get all, or most of this, already. Firstly, they recognize that search changes how you use information, most especially when you've got a lot of info to manage. Do you even look at the call record on your phone bill? Probably too much information. Do you search back through your email inbox to find stuff you wrote a month ago? Of course you do, because you can, especially with Lookout or Google Desktop or one of the really useful personal search engines.
They get user-created content, too. They have blogger, they have Picasa, they have GMail. They just launched Desktop. They get that user-created content equals communication... I think. When you look at the SIMS study, it's clear that the vast majority of "the world's information" which Google is determined to search is user-created content (see the Hal Varian "How Much Information" SIMS Berkeley study) or read the fantastic article "What's Next for Google" that Charles Ferguson wrote for MIT's Technology Review a few months ago, you can't help but think (if you are a Googler) OK, what are we gonna search/own/monetize next? And the big flaming answer is voice, voice, voice.
So yeah, they're gonna do Google Voice. But maybe not yet.
Why are they gonna do it?
Because all the content in the world comes from people, and most of it is voice.
How are they gonna do it?
Well, if I were a Googler told to do this tommow, I'd turn some of those 250K Linux servers they have into POTS NAPs around the United States and Canada, and I'd run Asterix on them (or a highly robust Googlized version of Asterix) and I'd throw the UI to it in with GMail (or keep it separate, but hold hands with GMail behind the scenes) and make a great inbox and outbox and CDR function, and record every call (allowing the user to delete, etc., just like email) and allow calls to be annotated and hyperlinked and blogged and so forth... and maybe even think about real-time linking of points within the call and what I am doing in the browser, for instance while I am talking (via Google Voice) I do a Google search, and that search is tagged and linked to that moment of the conversation. Whammo, you have a really compelling application-level extension to voice, and another knee in the groin of the dumb transport companies.
Oh, my. This is gonna be a fun decade.
Amazon takes a whack at telcos -- application trumping transport
For the past several months, a fleet of nondescript vans equipped with digital
cameras and proprietary computer software has been traversing the streets of
several major U.S. cities, continuously photographing businesses on every block.
Operating secretly under the code name "Project Mercury," the vans have
transmitted more than 20 million images to a database compiled by A9.com Inc., a
wholly owned subsidiary of Amazon.com Inc. A9 set up shop last fall in Silicon
Valley, far from the Internet retailer's Seattle headquarters, with the goal of
creating new search technology for computer users to hunt for information and
products on the Internet.Today, millions of the photos, coupled with their corresponding electronic yellow page listings, are scheduled to become available on the A9.com Web site. Only businesses that have paid to be in the A9 yellow pages will be featured. A9 will invite those retailers to take digital photos of their own that can be added to the Web site, potentially taking computer users inside stores to view merchandise.
A9's offering includes a way for computer users to take notes in an online "diary," and save and search the comments. It also offers a feature that automatically connects users to businesses by phone. Users input a phone number on the Web page, and, with a click of the mouse, can effectively be connected to any of the businesses listed free of charge. Special software connects the call by ringing a user's phone and the line at the business.
Here is an example search result from Boston.
There are two important points here. The first point is that geography is really, really important. The fact that all these businesses have a location matters to their customers; the fact that Amazon has GPS-tagged all the information around the pictures and listings is what makes this service work.
The second, even more important point, is that communications is becoming an extended conversation, and applications are trumping transport. When the world was about plain vanilla POTS, being a transport company (hello, AT&T) was a very valuable thing to be. But on the day it is announced that SBC might buy an AT&T that is a shadow of its former self, Amazon announces a feature that -- almost incidentally -- offers a free phone call between the user of its website and the merchant they are trying to reach. Given that the original intent of the yellow pages was to stimulate phone calls to businesses (and charge for the phone calls) that's an incredible turnabout.
Coupled with the potential for Google to get into the VoIP market -- again, as an extension to its current application-centric business of enabling conversations, not communications -- this now qualifies as a trend.
Incidentally, this also demonstrates that Time Warner was exactly right to buy AOL. They just bought at the wrong time, and may have bought the wrong company.
Also incidentally, the ability of users to add their own photos is really important. If Amazon is smart, they will allow a lot of clustering and linking to happen that has *nothing* to do with the core commerce focus of their yellow pages -- for instance, people linking their party photos from the Viper Room in LA to the geo/location of the Viper Room. There are all sorts of eVite possibilities here, too... it just goes on and on. Welcome to the future.
Finally, last incidental point -- Flickr had better get all the way to platform status soon, or sell themselves to the highest bidder, or they are going to be overwhelmed by the rollout of smart photo-inclusive features like this one.
Voice will be taken over by application providers if the telcos don't do something smart, or something sneaky (AKA regulatory relief). Get hot, boys...
Monday, January 24, 2005
Bellster, Technorati, Slashdot?
Update: It showed up on 1/25 at about noon.
Jeff Pulver at play again: Bellster launches
My take? RIght now, the short answer is, it's a stunt. A cool stunt that is interesting and will cause big telcos more worries than actual revenue problems. Like BitTorrent, its gnarly technical requirements will keep it from touching more than 1% of the userbase. Basically, you have to set up a dedicated Linux Asterix PBX server in your house to share your phone line with others. Not something that the average user is going to do.
Now... when someone rewrites Asterix into a PC application that runs on Windows, with a slick user interface a la Skype, and adds Bellster functionality, and says to every dummy (cough) user in the world, "Plug your phone line into your PC, download our app, and you get free phone calls worldwide" ... then, the telcos have a problem.
Friday, December 17, 2004
The three-axis auto-match and Match.com
The previous post on Matt Jones' bookshelf and my forthcoming post on location-based blogging beg the question -- what are fast and easy ways to identify whether someone is likely your type? I would argue that you can analyze three axes and get very good results on the interesting-conversation front, and probably the I-want-to-date-you front as well:
1) Personal: Height/weight/gender/gender preference/availability. Just the basics.
2) Bookshelf: What do you have on yours?
3) Geo-log -- where have you been, and how much time have you spent there?
Voila. A whole new way of doing dating.
More on Amazon - "My Work Bookshelf"
Someone with the screen-name 'blackbeltjones' has uploaded his work bookshelf onto Flickr and annotated the jpg with the actual titles of the books. Can I just say that a) Flickr rocks b) this is a cool idea and c) this is an obvious extension of the content of my previous post on this subject. Prabal, are you taking note?
Click through on this photo to the right, and the full coolness will be revealed.
Tuesday, December 14, 2004
Real search engines and great search engine humor (no, really!)
I can't remember where it was that someone pointed out to me that the true genius of Google wasn't that they created such a great search result, but that they created a pretty decent search result on a less-computational-cost-per-search than could be repaid by advertising. Per might remember, I need to ask him. (task placeholder)
I am going to cross-post on WebFountain over at Onohoku (link placeholder) because this is the scary shit that is destroying the middle class as we know it, in both corporate and governmental applications. Technology can make you free, and it can also make you a robot (which means 'slave labor' in the original Czech)...
The Battelle piece also led me to a truly wonderful self-parody hidden within the Google corporate site. I won't spoil it other than to say fly over there now and check it out!
Monday, December 13, 2004
More on Amazon and the extended conversation
Here are a couple of datapoints.
Firstly, Amazon has this handy "search inside the book" feature which allows full-text searching of books.
Secondly, Amazon now does this very handy "this book references... this book is referenced by..." relational search for references to and from the book.
Now. Most people's libraries are made up of books published in the last 20 years. The vast majority of these books have bar codes on them, which either contain or link directly to the ISBN number of the book in some database online somewhere. Here's a scenario:
January 1, 2005: Amazon places a special offer on its website. By clicking in a special box on their order form, for just $5.99, Amazon will include in your order a USB bar-code reader and a CD with special book-organizing software -- kind of like iTunes for your books. When you receive the software and plug in the reader, you can scan the bar code on every book you own; and for the ones that don't have bar codes, you can type in the ISBN or Library of Congress catalog number. That combination will allow your average book owner to get 90% of their library online at a rate of about five books a minute, or a few hours for a reasonable library of 1000 books. Press a button, and your entire library is uploaded to Amazon.
Some trust and fair-use issues would need to be resolved; Amazon might negotiate with the holders of the copyrights that anyone who physically scanned a bar code would get unrestricted search and access to the text of the books online. Perhaps this would be limited to books you'd bought through Amazon, and they would effectively get into the DRM business. Books that you'd typed in the LC or ISBN number would need to be managed a bit more closely; perhaps such books would drive a query from the site to look up and enter a quotation from a chapter in the book, or some such method of ensuring that the customer actually held a physical copy.
This would also lead to issues with people walking into bookstores and scanning books. However, this battle will be fought soon over cell phones with good cameras in them. Already in Japan, it is reported as a serious issue that kids will enter bookstores and snap photos of pages in magazines that are of particular interest to them.
What would the result of such an upload be? Suddenly, one could manage and search one's personal library online. Search from a text perspective, anyway. Soon I'm going to get around to writing about the "fruit theory" which causes me to believe that books on bookshelves -- even lots of them, such as my library of about 3000 books -- are a highly efficient mental model by which to keep track of information. What's a great example of this? Prabal takes pictures of his bookshelves. He has shelves and shelves of books in Ohio, whereas he is in California -- and he knows where on the shelf a certain book is (efficient mental model). With the picture, he can a) remind/search to a greater degree of precision and b) tell his wife Wendy using a coordinate system that he might not remember, but can now communicate, e.g. "it's a little to the left of the big red book on the 2nd shelf from the bottom," and FedEx does the rest.
For manifold reasons, people are always? or at least for a very long time, going to want real physical books. This combined system would be a beautiful way to combine the benefits of the virtual and physical, and Amazon would be dumb or nuts (and they are neither) not to pursue it.
And then... Steve Wozniak is doing virtual/physical integration via his "Wheels of Zeus" startup -- which is aimed at the "where's my stuff" personal RFID market. For a deluxe package of $59.95, Amazon could mail out a combined RFID/bar code scanner and a big sticker sheet of WoZ tags... and not only you, but your entire family , could suddenly find and access all those great books on your shelves.
The combination of web-based management, personal possessions which come from a limited dataset, and scanning/tagging technologies is going to be flat-out amazing. Imagine managing your wine collection this way. Your tools. Your shoes. Anything (unlike CDs) where the virtual must remain no matter how far digitization goes.
This is gonna be cool.
And the best thing is, besides this great conversation, we had a billion-dollar idea tonight! Now we just need a billion-dollar implementation... ;-)
Friday, December 03, 2004
The Extended Conversation
"Rageboy" has discovered, and briefly discussed, that Amazon is now providing hypertextual citation in both directions -- showing both the books that are cited in Book A, and all the books that cite Book A. This means that you can now not only find out all about Book A, you can quickly ascertain where Book A sits in the entire pantheon of scholarship in its topical field. The similarity of this to Google's PageRank algorithm will not be lost on any of the search cognoscenti, and the potential of that alone is enormous -- in addition to reading review, finding out "people who bought also bought," and looking at best-seller lists, I can now choose my books on the basis of how often they are cited, or how broadly they cite -- powerful applications of the "hubs and authorities" model which underlies PageRank. When this is suitably combined with a nice visualization and discovery tool like TouchGraph, we might really be on to something. Three cheers for social networks of data!!
Thursday, November 04, 2004
Final Results: Givers for Kerry, Takers for Bush
A few weeks ago, I posted a comparison between the Presidential polls and the Tax Foundation's tax tables on state-by-state net federal tax receipts (taxes collected vs. federal spending). Now that the people have spoken, I have updated this table to reflect the final results. It's still a very strong correlation:
Givers for Kerry, Takers for Bush.
No wonder we have an enormous deficit...
tax to vote final 2004
Originally uploaded by onohoku.

