Wednesday, November 19, 2008

the depths of information


Bright Planet

I am an avid user of Google. Refining a search, and locating better reference terms are part of my continual search for information. I have refined my techniques over time and I'm always looking for new and better methods. During class discussion, in Digital History, we talked about the mechanics of information searching, digitization and encoding of text. At first I was uneasy with Cohen's raw and cooked data analogy but I began to realize that my admiration for such creations as the Dublin Core limited my appreciation for raw data. Raw data is a frontier of sorts.
Later, I began to think over other problems with data. The skewed results from information systems because data engineering, data architecture and design are imperfect. The bottom line is a lot of uncharted data. There are places in which software spiders cannot search. The searcher must turn to directories and portals, searchable sites and databases. My search for information on the Deep Web and the Dark Web led me to Robert Lackie, at Rider University. He offers links and advice on searching in those Dark Hiding Places. http://www.robertlackie.com/invisible/index.html

Searching is about the question as much as the answer in the multidimensional repository of the web. If the answer exists in non-text format it is invisible to the searcher unless some tagging is in place. How does one search such sources? At Bright Planet I learned of Data Federation and Symantics, and found the helpful diagram at the top of this page. TCP/IP and XML standards are the current tools, with the next step being semantic mediation or semantic heterogeneities. Bright Planet claims there are nearly 40 distinct types of which there are three categories; structural conflicts, data conflicts and domain conflicts. The Web ontological description languages (OWL) are the emerging standards for machine-readable means to communicate the semantics of data. OWL is used by life sciences, physics, pharmaceuticals and the intelligence sector. Bright Planet designs and develops the world's most powerful search, harvest, and document federation technology which I learned about from their website. In short, my quest to understand invisible data has helped me understand business and government data searching, and even my own searches. A recent ready request in the ARCC while composing our labels and checking our references.

Question could I find Bucke's article "Sanity" in the American Journal of Psychiatry?
I did, quite handily, but then it wasn't raw data!!

R. M. Bucke SANITYAm J Psychiatry, Jul 1890; 47: 17 - 26. ...ARTICLE SANITY R. M. Bucke Asylum for Insane, London...Ontario. I propose to say a few words about sanity as compared with insanity; not in the...accept it as our proper mental habitat. Sanity we take for granted-think little or not...... PDF

I'm in favour of everyone adding metadata to their websites, Web 2.0 is available.

No comments: