Page
1
(This page has no text content)
Page
2
Metadata Metadata 10237.indb 1 9/25/15 10:41 AM
Page
3
The MIT Press Essential Knowledge series Auctions, Timothy P. Hubbard and Harry J. Paarsch Understanding Beliefs, Nils J. Nilsson Computing: A Concise History, Paul Ceruzzi The Conscious Mind, Zoltan L. Torey Crowdsourcing, Daren C. Brabham Free Will, Mark Balaguer Information and the Modern Corporation, James Cortada Intellectual Property Strategy, John Palfrey The Internet of Things, Samuel Greengard Memes in Digital Culture, Limor Shifman Metadata, Jeffrey Pomerantz MOOCs, Jonathan Haber Open Access, Peter Suber Paradox, Margaret Cuonzo Waves, Fred Raichlen 10237.indb 2 9/25/15 10:41 AM
Page
4
Metadata Jeffrey PoMerantz The MIT Press | Cambridge, Massachusetts | London, England 10237.indb 3 9/25/15 10:41 AM
Page
5
© 2015 Jeffrey Pomerantz All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher. MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please email special_sales@ mitpress.mit.edu or write to Special Sales Department, The MIT Press, 1 Rogers Street, Cambridge, MA 02142. Set in Chaparral Pro by the MIT Press. Printed and bound in the United States of America. Library of Congress Cataloging-in-Publication Data Pomerantz, Jeffrey, author. Metadata / Jeffrey Pomerantz. pages cm.—(The MIT Press essential knowledge series) Includes bibliographical references and index. ISBN 978-0-262-52851-1 (pbk. : alk. paper) 1. Metadata. 2. Information organization. I. Title. Z666.7.P66 2015 025.3—dc23 2015030578 10 9 8 7 6 5 4 3 2 1 10237.indb 4 9/25/15 10:41 AM
Page
6
Contents Preface ix 1 Introduction 1 2 Definitions 19 3 Descriptive Metadata 65 4 Administrative Metadata 93 5 Use Metadata 117 6 Enabling Technologies for Metadata 133 7 The Semantic Web 153 8 The Future of Metadata 187 Glossary 209 Further Readings 215 Figure Credits 223 Bibliography 225 Index 233 10237.indb 5 9/25/15 10:41 AM
Page
7
10237.indb 6 9/25/15 10:41 AM
Page
8
series foreword The MIT Press Essential Knowledge series offers acces- sible, concise, beautifully produced pocket-size books on topics of current interest. Written by leading thinkers, the books in this series deliver expert overviews of subjects that range from the cultural and the historical to the sci- entific and the technical. In today’s era of instant information gratification, we have ready access to opinions, rationalizations, and super- ficial descriptions. Much harder to come by is the founda- tional knowledge that informs a principled understanding of the world. Essential Knowledge books fill that need. Synthesizing specialized subject matter for nonspecialists and engaging critical topics through fundamentals, each of these compact volumes offers readers a point of access to complex ideas. Bruce Tidor Professor of Biological Engineering and Computer Science Massachusetts Institute of Technology 10237.indb 7 9/25/15 10:41 AM
Page
9
10237.indb 8 9/25/15 10:41 AM
Page
10
PrefaCe This book was borne largely out of a massive open online course (MOOC) that I taught for the University of North Carolina at Chapel Hill on the Coursera platform, in the fall of 2013 and again in the spring of 2014, titled “Meta- data: Organizing and Discovering Information.” Online teaching and learning is not a new idea by any means, but MOOCs focused a great deal of attention on this form of pedagogy, both inside and outside the academy. I had been teaching online for many years when MOOCs hit the news in 2011, but the sheer scale of a MOOC captured my atten- tion. I got to thinking about what teaching and learning in Information Science might look like, if it were entirely online. I believed then, and still do, that the first course in any Information Science curriculum should be a course on metadata: almost everything else in the field depends on metadata, and the subject provides a hook into most of the issues in the field. So when Carolina decided to launch its MOOC initiative, I was very excited to have the oppor- tunity to launch a course on metadata, to put my ideas to the test. I’m very pleased about how well the metadata MOOC was received. And I’m equally pleased that the course caused metadata to come to the attention of the editors of the MIT Press, as a topic worthy of being included in the Preface Preface 10237.indb 9 9/25/15 10:41 AM
Page
11
x Preface Essential Knowledge series. So my first thank you must be to Margy Avery, for first suggesting the idea of this book. Naturally I also must thank the University of North Carolina at Chapel Hill, for launching its MOOC initiative in the first place, and for supporting us MOOC instructors during the production process. I must also express a great deal of thanks to my teaching assistant for the MOOC, Meredith Lewis. I would like to thank the nearly 50,000 students who registered for the course… and especially to the 17,464 students who actually participated in the course across both sessions. I recorded several interviews for the MOOC, with people who are doing interesting and cutting-edge things with metadata. This provided (I hope) useful supplemen- tary material for the course, and saved the students from having to watch my ugly mug all the time. I learned a great deal in conducting these interviews, and that inevitably made it into this book as well. So let me thank my inter- viewees: Murtha Baca, of the Getty Research Institute; Robert Glushko, Adjunct Full Professor in the School of Information at the University of California at Berkeley; Steve Hogan, Music Analyst at Pandora; Hunter Janes, Data Analyst at Red Storm Entertainment; Clifford Lynch, Director of the Coalition for Networked Information; and Jason Scott, of the Internet Archive. 10237.indb 10 9/25/15 10:41 AM
Page
12
Preface xi The interviews for the MOOC went so well that I de- cided to do some more, specifically for this book. Thanks to Mary Forster, Joel Steinpreis, and Joel Summerlin of Getty Images for a fascinating conversation about image metadata. Thanks to Clifford Lynch, again, for bringing pen regis- ters to my attention, and for pointing me in the right direc- tion while researching the history of the word “metadata.” Thanks to Ted Johnson, of Studio 713, for helping me to understand music metadata. Thanks to Jessamyn West, for helping me find images of catalog cards. This book is dedicated to my daughters, Charlotte and Eleanor, who thought it was cool that I was writing a book. 10237.indb 11 9/25/15 10:41 AM
Page
13
10237.indb 12 9/25/15 10:41 AM
Page
14
introduCtion Metadata is all around us, all the time. In the modern era of ubiquitous electronics, nearly every device you use relies on metadata or generates it, or both. But when metadata is doing its job well, it just fades into the background, un- noticed and nearly invisible. And this is partly how, in the summer of 2013, metadata came to be a cause célèbre. Edward Snowden, a subcontractor to the United States National Security Agency, flew to Hong Kong in May of 2013 to meet with journalists from The Guardian. There, Snowden handed over a large number of classified docu- ments about the NSA’s surveillance program within the United States. One of these programs, PRISM, included collecting data on telephone calls directly from telecom- munications companies. Needless to say, this was very big news when The Guardian published the story. Reactions in the US media to the Snowden revela- tions were varied, and their evolution was significant. The 1 IntroductIon chaPter 1 10237.indb 1 9/25/15 10:41 AM
Page
15
2 chaPter 1 immediate reaction was anger that the NSA was collect- ing data on US citizens. This was quickly tempered by re- lief, when it became clear that the NSA was only collecting metadata about calls, and not the calls themselves—in other words, the NSA was not engaging in wiretapping. After that came punditry, as the media explored just how much information about individuals could be inferred from “only” metadata. The MetaPhone study, conducted by researchers at the Stanford Law School Center for Internet and Society in late 2013, attempted to replicate the NSA’s data collec- tion of phone metadata. What they discovered was that a truly incredible amount of information can be inferred from “only” metadata. One example that the MetaPhone researchers report is of a study participant who called “a home improvement store, locksmiths, a hydroponics dealer, and a head shop.” Perhaps this individual had per- fectly innocent reasons for placing all of these calls, and perhaps these calls were entirely unrelated… but that’s not the inference that most of us are likely to make. A lot of metadata is associated with phone calls, par- ticularly cell phone calls. Probably the most obvious pieces of metadata about a call are the phone numbers of the caller and the recipient. Then, of course, there’s the time and duration of the call. And for calls made from smart- phones—most of which have GPS functionality—there are the locations of the caller and the recipient, at least to 10237.indb 2 9/25/15 10:41 AM
Page
16
IntroductIon 3 the level of precision of the range of the cell phone towers in which the phones are located. There’s more metadata than this associated with cell phone calls, but even this small amount is enough to give privacy advocates pause. Because your phone exchanges data with local cell towers, even when you’re not on a call. And, of course, your phone is presumably being carried by you. A record of your loca- tion at any given moment, and your movements over time, may therefore be collected by your cell phone service pro- vider … and is in fact collected, as the Snowden revelations revealed. Thus did the word “metadata” enter the public conver- sation. Though, given how pervasive metadata is, a public conversation about it is probably overdue; it deserves to be better understood. In the modern era of ubiquitous com- puting, metadata has become infrastructural, like the elec- trical grid or the highway system. These pieces of modern infrastructure are indispensible but are also only the tip of the iceberg: when you flick on a lightswitch, for example, you are the end user of a large set of technologies and poli- cies. Individually, these technologies and policies may be minor, and may seem trivial… but in the aggregate, they have far-reaching cultural and economic implications. And it’s the same with metadata. Metadata, like the electrical grid and the highway system, fades into the background of everyday life, taken for granted as just part of what makes modern life run smoothly. 10237.indb 3 9/25/15 10:41 AM
Page
17
4 chaPter 1 As citizens of the modern world we all are familiar with and have a reasonable (though probably incomplete) understanding of the electrical grid and the highway sys- tem, and many other pieces of modern infrastructure. But unless you’re an information scientist—or an intelligence analyst working for the NSA—the same is probably not true of metadata. And so we arrive at the purpose of this book. This book will introduce you to the topic of metadata, and the wide range of topics and issues that metadata touches on. We will discuss what metadata is, and why it exists. We will look at a range of different types of metadata, for different users and use cases. We will talk about some of the tech- nologies that make modern metadata possible, and we will speculate about the future of metadata. And by the end of the book, you will be seeing metadata everywhere. It’s metadata’s world, and you’re just living in it. Invisible Metadata When you picked up this book from your local bookstore shelves, you were using metadata. What attracted you to this book, to cause you to pick it up? Was it the title, the publisher, the cover art? Whatever it was, it almost cer- tainly was not the content of the book itself. Of course, now that you are reading this, you have some information 10237.indb 4 9/25/15 10:41 AM
Page
18
IntroductIon 5 about the content of this book, but you did not have that information before you picked it up. You had to rely on other cues, other pieces of information about the book. Those other pieces of information are metadata: data about this book. When metadata is doing its job well, it fades into the background, almost to the point of being invisible. You’re so used to seeing books with titles and publishers and cover art, that it probably didn’t even register with you that this book has those things too. It would probably only have registered if this book didn’t have a title or publisher or cover art. We’re so conditioned to metadata about books being part of our book-buying environment that we don’t even think about it. We’re so conditioned to metadata about lots of things being part of our everyday environ- ment that we don’t even think about it. How did it come to be this way? A Brief History of Metadata The word metadata only came into the English language in 1968, but the idea of metadata goes back to the first library. The word is a deliberate play on Aristotle’s Metaphysics. Though Aristotle never called those particular works by that name, they have historically been collected together under that title, to indicate that they came after, or dealt with 10237.indb 5 9/25/15 10:41 AM
Page
19
6 chaPter 1 topics beyond the Physics. Similarly the word “metadata” indicates something that is beyond the data: a statement or statements about the data. Linguistically this is a loose translation of the Greek prefix “meta-,” but it is consistent with what has become the everyday use of the word “meta,” to indicate something at a higher level of abstraction. Although the word “metadata” is only a few decades old, librarians have been working with metadata for thou- sands of years. Though what we now call “metadata” has historically just been called “information in the library catalog.” The information in a library catalog is intended to solve a very specific problem: to help users of the library find materials in the library’s collection. The Pinakes is considered by historians to be the first library catalog, created by Callimachus for the Library of Alexandria, around 245 BC. Only fragments of the Pinakes have survived the intervening millennia, but here’s what is known: works were listed by genre, title, and author’s name, along with some biographical information about each author. Additionally a summary, and the total num- ber of lines of a work were included. Fast-forward more than two thousand years, and we’re still using many of the same pieces of information in library catalogs: author, sub- ject, blurb, length. To be fair, however, we now use more pieces of in- formation in library catalogs than Callimachus did. The call number of the work is ubiquitous: a number or other 10237.indb 6 9/25/15 10:41 AM
Page
20
IntroductIon 7 alphanumeric string, according to some scheme (the Dewey decimal system, for example), that lets the library user locate a work on the shelves. Call numbers are espe- cially critical for large collections, as users must navigate the correspondingly large physical space occupied by the collection to find individual items. It’s difficult to imagine how Callimachus could have developed the Pinakes with- out also inventing call numbers, since the Library of Alex- andria is said to have included half a million works, which is a fairly large collection even by modern standards. The Pinakes was a set of scrolls. If you have ever read from the Torah in synagogue, you know that a scroll is not the most user-friendly interface: moving between sections is a challenge. Indeed there’s an entire holiday in the Jew- ish calendar (Simchat Torah) that celebrates coming to the end of reading the Torah, and rolling the whole thing back to the beginning. If you’ve never read from the To- rah, think about using other scroll-like technologies: an audiocassette, or a VHS tape. Indeed stickers exhorting us to “Be kind, please rewind” used to be common on rental VHS tapes. In short, the Pinakes could not have been a pic- nic from the standpoint of usability. The codex—what we moderns just call the book—is in many ways a superior user interface to the scroll. Thus, in- evitably, once the codex was invented, it was adopted for use as library catalogs. Library catalogs in book form were often what is called a “shelf list,” which is exactly what it 10237.indb 7 9/25/15 10:41 AM