The ecosystem in which both library-generated metadata and vendor-generated search environments are players has changed radically with unprecedented swiftness:

• search engines continue to morph, witness Bing, WolframAlpha, Siri
• Google surfaces its things not strings work as Knowledge Graph
• schema.org announces a W3C vehicle to extend its core vocabulary
• Microsoft’s Academic Search provides glimpses of new ways to find connections
• Nature Publishing Group initiates linked-data access to some of its metadata
• the BNB and Harvard’s cataloging come out of the closet as CC0 data
• many national libraries release CC0 bibliographic and authority data
• Europeana continues to expand open access to cultural heritage metadata
• OCLC moves toward ODC-BY for VIAF and other of its data environments
• W3C Library linked data incubator group issues its final report
• Library of Congress announces [linked data] modeling initiative

Richard Wallis (late of Talis, now OCLC) recently summarized these trends in terms of web-wide factors in his post A data 7th wave approaching:

With the advent of many data associated advances, variously labelled Big Data, Social Networking, Open Data, Cloud Services, Linked Data, Microformats, Microdata, Semantic Web, Enterprise Data, it is now venturing beyond those closed systems into the wider world.

Well this is nothing new, you might say, these trends have been around for a while – why does this constitute the seventh wave of which you foretell?

and

It is precisely because these trends have been around for a while, and are starting to mature and influence each other, that they are building to form something really significant ….

Indeed, for those in pursuit of a broader-than-library take on what’s going on in the web-wide world of structured data, one should take advantage of Richard’s experience including a deep understanding of libraries as a member the Talis library systems group and spanning the company’s evolution toward its present-day provision of Kasabi, “a startup business spun out from and backed by Talis. Our aim is to unlock the value in the World’s data by enabling new business models for producers and consumers of structured data at all scales.”  Among his posts and presentations worth close review are those that can be had at his Data Liberate site, for example:

• Create data not records
• Libraries through the linked data telescope
• Who will be mostly right – Wikidata, Schema.org

My own views on the potential benefits to be had from a rapidly evolving web that is increasingly dominated by well-structured and well-curated data were shaped in large part by exposure to the vision, concepts, and people involved in a set of antecedents to the current flurry of activity and developments.  The thread leads from a turn of the century piece written by Danny Hillis, through his Applied Minds and Metaweb companies, leading to Freebase and John Giannandrea, and onward from there to the recent Wall Street Journal interview with Amit Singhal and the subsequent discussions surrounding Knowledge Graph and things not strings:

Hillis: With the knowledge web, humanity’s accumulated store of information will become more accessible, more manageable, and more useful. Anyone who wants to learn will be able to find the best and the most meaningful explanations of what they want to know. Anyone with something to teach will have a way to reach those who want to learn. Teachers will move beyond their present role as dispensers of information and become guides, mentors, facilitators, and authors. The knowledge web will make us all smarter. The knowledge web is an idea whose time has come.  Hillis, W. Daniel. “Aristotle”: (The knowledge web), 2000, published in The Edge (138) in 2004.

 Freebase:  A new company founded by a longtime technologist is setting out to create a vast public database intended to be read by computers rather than people, paving the way for a more automated Internet in which machines will routinely share information.  Markoff, John. Start-up aims for database to automate web searching. NYT (9 March 2007).

Giannandrea:  Freebase is an open database of the world’s information, built by a global community and free for anyone to query, contribute to, and build applications on. … Part of what makes this open database unique is that it spans domains, but requires that a particular topic exist only once in Freebase. Thus freebase is an identity database with a user contributed schema which spans multiple domains. For example, Arnold Schwarzenegger may appear in a movie database as an actor, a political database as a governor, and in a bodybuilder database as Mr. Universe. In Freebase, however, there is only one topic for Arnold Schwarzenegger that brings all these facets together. The unified topic is a single reconciled identity, which makes it easier to find and contribute information about the linked world we live in. Giannandrea, John. Freebase: an open, writable database of the world’s information (a one-hour lecture delivered in October 2008).

 [Amit Singhal] said in a recent interview that the search engine [Google] will better match search queries with a database containing hundreds of millions of “entities”—people, places and things—which the company has quietly amassed in the past two years. Semantic search can help associate different words with one another.  Efrati, Mair.  Google gives search a refresh. WSJ (15 March 2012).

Knowledge Graph: [W]e’re focused on comprehensive breadth and depth. It currently contains more than 500 million objects, as well as more than 3.5 billion facts about and relationships between these different objects. And it’s tuned based on what people search for, and what we find out on the web.  Britt, Phil.  Google unveils knowledge graph. (24 May 2012).

Taken together, these and other suggestive developments in the linked-data ecosystem represent a confluence of tools, data, and methodologies of sufficient potential to warrant efforts that pursue:

new opportunities for addressing the traditional and prevailing problems of too many silos of content, too many disparate modes of search and access, and too little precision and too much ambiguity in search results in the extreme environments of academic information resources intended to support and report on the research and teaching in large research enterprises. Keller, Michael A. Linked data: a way out of the information chaos and toward the semantic web. EDUCAUSE Review 42 (4): July/August 2011.

Such opportunities are inextricably bound up with linked-data’s potential for (1) reshaping the infrastructure that supports web-wide management of information, knowledge, and data, and for (2) fueling unprecedented improvements in the efficiency and efficacy of navigation and discovery capabilities.  It’s long past being a matter of if, now it’s about when—the game that’s afoot is about finding roles that libraries can play in aiding and abetting the creation of an increasingly dense tapestry of facts and links woven together from the flows of intellectual resources that the global academic community consumes and produces in the course of its research, teaching, and learning.

Members of LITA’s Linked Library Data Interest Group and other contributors have added many resources to the LOD-LAM Zotero group to date. In order to increase the usefulness of the group, we are asking for community involvement in two ways:

• As you come across new tools and resources—either from conferences or in the course of your professional reading—please add them to the LOD-LAM Zotero group.
• As you use the LOD-LAM Zotero group—either as a contributor or as a browser—please send us any feedback you may have.

Through collective effort, we hope the LOD-LAM Zotero group will become the “go to” place for information about linked data and its particular uses by libraries, archives, and museums.

Items added to the LOD-LAM Zotero group can be viewed in the group’s library. Alternatively, you may view the group’s library or collections within the group’s library through your feed reader. Click “Subscribe to this Feed” on the page of the library or collection that you wish to follow via RSS.

A Zotero account is not required for “read” access to the group’s library, but it is required for “write” access. To contribute, simply create a Zotero account, download either the Zotero browser plugin or standalone client, and begin adding items. More information about getting started and tips for contributing resources can be found in the README document in the group’s library.

We hope the LOD-LAM Zotero group will create more opportunities for DLF and LOD-LAM community members to learn from one another. We especially encourage community members interested in playing in the linked data sandbox to browse the collection titled LOD 101: Primers, Tutorials, etc. In addition, we encourage contributors to use the “Notes” field to share information about tools from their experience when adding new resources to the group’s library.

Management of the LOD-LAM Zotero group is shared by the DLF and LITA’s Linked Library Data Interest Group. For more information, or to send feedback, please email lodlamzotgrp -at- yahoogroups -dot- com.

For the program’s first cohort, CLIR is now recruiting six data curation fellows in cooperation with its partner institutions: Indiana University, Lehigh University, McMaster University, Purdue University, the University of California Los Angeles, and the University of Michigan.

Information about the program and position descriptions are available at http://www.clir.org/fellowships/datacuration. Applications will be accepted on a rolling basis until all positions are filled, but no later than June 30, 2012.

The inaugural winter 2012 issue, “From Planning to Implementation”, describes what Bamboo has been developing since fall 2010, in response to the needs described by scholars, librarians and IT professionals during the 2008-2010 Bamboo Planning Process. Future issues will continue to center around a theme, whether targeted at the digital humanities, collections, the citizen scholar or newly released tools.

Please email comments, inquiries, or requests to be added to the mailing list (electronic or print copy) to Emma Millon, Community Lead at feedback [at] lists [dot] projectbamboo [dot] org.

For further information on Project Bamboo visit https://sites.google.com/site/projectbambooarchive/.

“OSTP previously conducted a public consultation about policy options for expanding public access to federally funded peer-reviewed scholarly articles (the full set of comments can be viewed here). The current RFIs take that process another step, seeking further guidance on access to scientific publications and initiating a parallel process relating to digital data, as called for in the COMPETES Act.

OSTP has established two interagency policy groups under the National Science and Technology Council—the Task Force on Public Access to Scholarly Publications and the Interagency Working Group on Digital Data—to identify the specific objectives and public interests that need to be addressed by any policies in these two areas. The groups will take into account the varying missions, types of data, and dissemination models associated with the range of Federal science agencies and scientific disciplines, and will help OSTP address other public access requirements of COMPETES—keeping in mind the need to follow statutory requirements and best practices for protecting personal privacy, proprietary interests, intellectual property rights, and author attribution.

We highly encourage stakeholders to consider the questions in the RFIs and provide comments to the questions by email to digitaldata@ostp.gov and publicaccess@ostp.gov. OSTP will make all comments available on its website, including the names of the authors and their institutional affiliations soon after the conclusion of the comment periods, so please do not include any proprietary or confidential information when responding to the RFIs. All comments are due by January 2, 2012.

You can see the RFI on public access here and the RFI on digital data here.”

To view the original article, view the White House Blog post.

Responding to Brinkley’s call via the DPLA listserv, Karen Coyle observes:

“A big and powerful chunk of knowledge organization that is just begging for exploitation is the fact that library records have classification numbers and subject headings from thesauri. All of this could now be correlated with an analysis of the full text. It’s only another step to associate this same information with non-library materials. The classifications have the advantage of being organized knowledge with implicit class membership and lots of interesting sibling relationships. What libraries have is not complete nor perfect, but it’s a seed to be built on, something that doesn’t exist when you do keyword indexing without any semantics.”

Join the conversation by commenting on Brinkley’s post or chiming in on the listserv thread!

Based on an earlier talk given at NYPL Labs, Voss’s presentation will “explore the fundamental elements of Linked Open Data and discover how rapidly growing access to metadata within the world’s libraries, archives and museums is opening exciting new possibilities for understanding our past, and may help in predicting our future.”

This event is free and open to the public, so register soon. For a sneak peek, check out this slideshow from Voss’s earlier talk.

As described by Evan Sandhaus, its developer, Longitude links NYT subject headings to geographic and corporate or biographical data from Geonames and Freebase:

“When you open Longitude you’ll see a number of “Times T” pins plotted out in a Google Map. The locations for these pins were all derived from Geonames. Click on any pin and you’ll be presented with a pop-up balloon containing a list of the ten most recent, relevant Times articles. But wait, there’s more! For some locations such as Missouri, your balloon will have one or two additional tabs: “Natives” and/or “Companies.” Click on one of these tabs and you’ll be presented with list of locally-born people and locally-headquartered organizations. You can even view Times articles for these people and organizations.”

Read Sandhaus’s pitch for Longitude, in which he also promises future posts about technical details of the app.

“The concern that open data may simply empower the empowered is not an argument against open data; it’s an argument against looking at open data as an end in itself. Massive data dumps and even friendly online government portals are insufficient. Ordinary people need to know what information is available, and they need the training to be conversant in it. And if people are to have anything more than theoretical access to the information, it needs to be easy and cheap to use. That means investing in the kinds of organizations doing outreach, advocacy, and education in the communities least familiar with the benefits of data transparency. If we want truly open government, we still have to do the hard work of addressing basic and stubborn inequalities. However freely it flows, the data alone isn’t enough.”

View the afternoon session below, or view the morning session here.

Video streaming by Ustream

On the day of the conference, the British Library also introduced their new approach to publishing the British National Bibliography using linked data practices. Users can now preview the first subset of the LOD BNB, including books published or distributed in the UK since 2005, via the search service, the describe endpoint, and the SPARQL endpoint. Below are slides from a presentation by Neil Wilson, who heads the British Library’s Metadata Services, outlining the process behind creating the library’s LOD model.