Today is the first day of “Mixing and Remixing Information 2010: Open Government and the Web” (MRI 2010) — welcome!
- General welcome
- Conceptual overview of the course: APIs, mashups, and open government
- Hands-on activity
- Walk-through of the course syllabus & schedule
- Assignments for Day 2
- Closing Q&A
Conceptual overview of the course
The purpose of this section is to Introduce people to three main topics of the course: APIs, mashups, and open government.
- APIs are “application programming interfaces”
- A mashup, in the words of the Wikipedia, is a web site or web application “that seamlessly combines content from more than one source into an integrated experience.”
How to Understand Mashups
You can understand a specific mashup by answering a number of basic questions:
- What is being combined?
- Why are these elements being combined?
- Where is the remixing or recombination happening?
- How are various elements being combined (that is, first in the interface but also behind the scenes in the technical machinery)?
- How can the mashup be extended?
One pattern you will see repeated among mashups that link two web sites is the combination of three actions:
- Data is extracted from a source web site.
- This data is translated into a form meaningful to the destination web site.
- The repackaged data is sent to the destination site.
- HousingMaps (a mashup of Craigslist and Google Maps)
- Jon Udell: The LibraryLookup Project
- Interesting to talk about what happened to chicagocrime.org: http://chicago.everyblock.com/crime/ — part of EveryBlock, which has now been open sourced (http://code.google.com/p/ebcode/)
- Flickr Services lists some mashups using the Flickr API including Flickr Sudoku , Flickr Postcards and fd’s Flickr Toys: Do fun stuff with your photos . One of my favorite Flickr mashups is two ways in which Picnik interacts with Flickr: a) Flickr’s photo-editing functionality uses Picknik’s API and b) you can edit Flickr photos in Picnik (via Flickr’s API).
- What are some good Google Maps mashups? I like Africa Map but there are so many: look at Google Maps Mania 2007 intro and a directory for some sample mashups.
- ProgrammableWeb lists APIs and mashups that use these APIs.
How APIs are being used today
- Google: The Maps API is responsible for the proliferation of Google’s maps to tens of thousands of websites. With the popularity of the Maps API, Google began offering APIs to many more of its offerings, including YouTube, Google Search, Documents, AdSense, Calendar, and App Engine.
- Facebook: Facebook Apps, driven by the website’s API, enhances Facebook’s standing as one of the central online social networking platforms.
- Amazon: The online retailer, which started its API offering with a product advertising API that mirrors its retail store, has expanded its API to encompass its utility computing platform
- Yahoo!: APIs, which are central to the Yahoo! Open Strategy (YOS), to “deliver open, industry-leading platforms that attract the most publishers and developers“, provide access to such services as Flickr, Yahoo! Search, Maps, Local listings. Yahoo! also created Pipes and YQL to let developers program more easily with APIs.
- Microsoft: Not to be outdone by Google, Microsoft is building Windows Azure, a large set of APIs to services hosted on its servers.
- Salesforce parlayed its customer relationship management system into a major business platform via its APIs.
- The New York Times provides an API to give access to millions of its articles dating back about three decades.
- Etsy, a site for artists to sell handmade goods, released an API to officially bless work by third party developers who had been driving useful traffic to Etsy.
- Twitter has built an empire of third-party services that uses its API; the traffic to the API is an order of magnitude greater than that to its own regular website.
- OCLC, a major library consortium, provides access to the records of its WorldCat catalog via an API.
- WordPress: Every installation of the popular open source weblogging software, ships with a built-in API, resulting in thousands of websites with APIs that can be used right away.
Sample API calls
<dc:description>700 14th St, Denver CO 80202</dc:description>
Library of Congress SRU
This is the fifth time I’m teaching MRI. This year, I’m introducing a thematic element to the course to bring some unity in the choice of content area and problems to address. Open government is a fascinating field, a good match for the methodologies of information remix. (Let’s use a definition from the Wikipedia as a starting point for open government:
Open government is the political doctrine which holds that the business of government and state administration should be opened at all levels to effective public scrutiny and oversight. In its broadest construction it opposes reason of state and national security considerations, which have tended to legitimize extensive state secrecy. The origins of open government arguments can be dated to the time of the European Enlightenment: to debates about the proper construction of a then nascent civil society.
How did I get into open government and the Stimulus in particular?
- my own interests in APIs + mashups + open data
- stimulus collab with Erik Wilde and Eric Kansa: Proposed Guideline Clarifications for American Recovery and Reinvestment Act of 2009 and Web Services for Recovery.gov
- I’m now very interested in “making sense of the stimulus”, including integrating it into my spring information remixing course at Berkeley.
The Sunlight Foundation is a major player in the area of US government transparency. It is doing great work, which is worth following and understanding.
- Apps for America: Sunlight Labs Mashup Contest and Winners of the Apps For America Contest Announced
- Apps for America 2: The Data.gov Challenge and Sunlight Labs: Blog – The Apps for America Winners and honorable mentions
- Sunlight Labs API
- YQL interface — worth studying — interface to sunlight + usaspending.gov: Using Public Data for Good With the Power of YQL (Yahoo! Developer Network Blog)
- see query in YQL interface — perform actual query
Obama and Open Government
A lot of excitement in this field in the US because of the Obama administration’s pledges of open government.
- Transparency and Open Government The White House was issued on Jan 22, 2009 — the first day of the Obama administration (see On First Day, Obama Quickly Sets a New Tone – NYTimes.com NYT Jan 22)
- On Dec 8, 2009 Open Government Initiative The White House was unveiled: White House Publishes Open Government Directive — Making
- Data.gov and ideas about Data.gov 2.0: Sunlight Labs: Blog – It’s Official: Data.gov 2.0 is Coming:
Local efforts emerging — not all federal
- DC: Data Catalog
- San Francisco: DataSF – Liberating City Data
- New York City: NYC Data Mine
- Vancouver: Vancouver’s Open Data Catalogue – Beta version
- Toronto: toronto.ca Official website for the City of Toronto
- Manor City, TX: Manor Labs
How about Pittsburgh (my other city)? I see Connecting Citizens, Government and Political Professionals – MyGov365.com and Sunlight Labs: Projects – OpenGov.
Citycamp (Jan 22-23, 2010): BarCamp / CityCamp
Think about crime data, transit data, etc. See City-Go-Round – Bus schedules, train schedules, trip planners, transit maps, and public transit apps.
Other backgound links
- 8 Principles of Open Government Data
- Gov 2.0 Expo 2010 – Co-produced by TechWeb & O’Reilly Conferences, May 25 – 27, 2010, Washington, DC
- 21Gov.net » Book
- Open Government – O’Reilly Media (Feb/March 2010)
- Publishing Open Government Data
- dretblog: The Linked Data™ Police
We can brainstorm project ideas but also look at the list of ideas at unlight wiki list: Project Ideas – Sunlabs wiki
Supplementary References for my talk
For a highly readable article on how companies get into creating APIs to enable mashups, read How to Manage Volunteer Software Developers, Managing Technology Article – Inc. Article — it’s the story of how cutting-edge usage of Etsy prompted Etsy to hire Mashery to build an API.
Recently, I attended a Workshop on Application Programming Interfaces for the Digital Humanities (Oct 2009)
You might enjoy a very accessible CBC segment on mashups at Online activism, lurking, mashups, and APIs (Episode 76 – May 6 & 9, 2009 | Spark | CBC Radio)
Get into groups of 2-3 and look through the entrants and winners of the Sunlight Foundation Apps for America and Apps for America 2. Look also at DataSF. Discuss what you think are good and useful and what is missing from what you saw. Brainstorm 3 apps that you think would be useful to be created.
Course Syllabus and Schedule
MRI 2010 is a project-driven course; students will be proposing and creating projects related to open government. It’s useful to look at what students in previous installments of MRI have created:
1. Write me an email (firstname.lastname@example.org) telling me the following:
1) What you hope to learn and accomplish in the course?
2) What programming and other technical background do you have? (e.g., programming languages you know, what you have programmed, how much experience do you have with web programming)
3) What concerns you might have?
4) Create a flickr and twitter account and send me the userID for your accounts.
I’ll have more of the computer infrastructure set up when we meet next on Monday.
Don’t hesitate to contact me!
Leave a Reply
You must be logged in to post a comment.