21 Nov 2004

wal-mart has more data than the internet?

from this new york times article about wal-mart tracking sales (say, similar to the nectar card in uk) to stock more items (read: non-evil uses):

By its own count, Wal-Mart has 460 terabytes of data stored on Teradata mainframes, made by NCR, at its Bentonville headquarters. To put that in perspective, the Internet has less than half as much data, according to experts."

there are some fatal flaws in this paragraph. firstly, 460 terabytes of data can mean anything. what is it of? barcodes? security camera footage? pr0n? i mean, have these people looked at how much "data" is on p2p networks. which leads me to the second point here, which EXPERTS have deemed that internet has half as much data? what does that even mean? are the EXPERTS saying that the internet has 230 terabyte of data? like, for instance enough data to fill 55,000 DVDs? how have they arrived at this figure? but web crawling? by asking google. how much data is accessible without a webpage? like p2p networks (again!) and images/data hidden behind uncrawlable databases. i would like to meet these EXPERTS.

You can reply to me about this on Twitter: