Category: Libraries

JISC INF11 Programme Meeting: From unprojects to services

Joss Winn / / Data, Fun, Hacks, ICT, Libraries, Mashups, Mobile, Open Source, Presentations, Projects, Student as Producer, Web

I’m going to the JISC Information Programme Meeting on Thursday and have been asked to join a panel where I’ll talk about our work at Lincoln under the heading ‘from unprojects to services’. Here are my notes.

Over the last couple of years, staff in CERD, The Library and ICT have worked closely together on a number of ‘rapid innovation’ projects, which have sometimes later attracted JISC funding.  Much of our work has been undertaken at the initiative of individual staff, who have benefited from a supportive ICT environment that allows us the freedom to develop and test our ideas without running into bureaucratic walls. ICT – in particular the head of the department, Mike Day, and head of the Online Services Team, Tim Simmonds – recognised the benefits of employing undergraduate students and recent graduates, and established a post which Nick Jackson and Alex Bilbie share. Alongside this, I have been applying for JISC funding and successful bids have allowed us to employ Nick and Alex full-time rather than part-time. In recent months, this has worked very well and currently much of their time is spent working on JISC-funded projects which bring value to the University. Below, are a list of the services that this culture of innovation has allowed us to work on over the last year or so. Click on the links to go to the services.

The Common Web Design: Distributed HTML5/CSS3 template for internal services
Posters: A repository for visual communications
lncn.eu: The official URL shortner for the university. Provides real-time stats, API and acts as branded/trusted proxy for other services.
Single Sign On: OAuth/SAML/Shibboleth/NTML/Eduroam integration
Zen Desk: University Help Desk
My Calendar: An aggregation of space-time data into a flexible web service. JISC-funded.
Nucleus: Datastore for People, Events, Bibliographic and Location data (and more to follow). Provides (open) APIs to all other services. MongoDB.
James Docherty, a third year student, used the nucleus datastore as a source of data for his final year project: Situated Displays for buildings, showing room booking information, posters and announcements.
Staff Directory: Fast, versatile people-focused search engine
Jerome: Fast, modern, personalised library search portal aggregating books, journals and EPrints data. JISC-funded.
Mobile: A directory of university services for mobile devices
Online Server Monitoring: A simple dashboard for anyone to check whether a service is working
QR Codes: Will be used for asset tags and already being used in rooms to create Help Desk tickets.
  • Most of these services push and pull data to Nucleus, the central, open datastore built on MongoDB. e.g. Zen Desk=People + Locations, My Calendar=Events, Jerome=Bibliographic
  • We’re currently looking at how Nucleus can also be a source for Linked Data. It has open(ish) APIs.
  • CWD sites transparently sign the person in to the site, if they are signed in elsewhere.
  • We like Open Source. SSO is mostly open source software. Alex has released his OAuth 2.0 code. CWD likely to be open source; MongoDB, bits and pieces from Jerome and My Calendar.
  • As we build these services, they are being integrated, too. e.g. lncn.eu will be a URL resolver for Jerome offering realtime monitoring; posters will show up in My Calendar events; CWD is the design framework for My Calendar.
  • Most of these services are for official launch in September. They will be included in the new ICT Handbook, included in brochures and other announcements.
  • We’re working with the Student Union to develop the use of FourSquare around the university.
  • Now that we know we can develop this way and that it works and we enjoy it, we’re hoping to expand from two to four student/graduate developers and have our own budget for hardware/software/conferences and to give to staff and students that want to join us.
  • Our approach links into the University’s Teaching and Learning Strategy: Student as Producer. We want to work with students and staff across disciplines to create useful, innovative and enjoyable online services that make the University of Lincoln a great place to work and study at. It’s not about a team that works on ‘educational technology’, but rather a network of people who develop and support technologies that make Lincoln a productive environment for research, teaching and learning. It’s inclusive, with students (and therefore learning) at its core.

Falling in love (with libraries)

Joss Winn / / Libraries, PhD, Theory, Web

I’ve just come from the Library, having been invited to join colleagues in a day long strategy workshop, led by a nice bloke called Ken Chad. Throughout the day, we discussed library users’ needs, took a pragmatic view in assessing the work to be done, looked at the barriers we face and some potential solutions. One of the contributions I made was around the benefits of getting to know the users of our Library better and using that knowledge to further improve our library services. There’s nothing remarkable about that. What got me thinking throughout the day was a brief discussion about the role of surveys in soliciting feedback on the services we provide. It got me thinking about some reading I’ve been doing recently around ‘resilience theory’ and a key component of resilience theory is learning from feedback so as to adapt and survive. Resilience theory is a branch of the ecological sciences that “emphasizes non-linear dynamics, thresholds, uncertainty and surprise, how periods of gradual change interplay with periods of rapid change and how such dynamics interact across temporal and spatial scales” (Folke 2006). Folke lists the attributes of a resilient social-ecological system as:

  1. the amount of disturbance a system can absorb and still remain within the same state or domain of attraction,
  2. the degree to which the system is capable of self-organization (versus lack of organization, or organization forced by external factors), and
  3. the degree to which the system can build and increase the capacity for learning and adaptation.

It’s the last point that interests me here. That is, the degree to which something has the capacity to learn and adapt. So, resilience theory is a theory of learning, adaptation and change. It’s not a theory of preservation but rather one of sustainability. Hopkins (2008) has likewise summarised the ‘ingredients’ of resilient systems as:

  1. Diversity
  2. Modularity
  3. Tightness of feedbacks

I think resilience theory is a theory which can be usefully applied to eco-systems, single organisms, individuals, even library systems. Anything that has an interest in longevity or sustainability in the face of inevitable change. So it seems to me that the use of surveys is an implicit admittance of failure in terms of knowing the people who you are surveying.

In our relationships we don’t issue quarterly or annual surveys to find out what people think about us. As I said in the workshop, I’ve never surveyed my wife. I listen to her, I get to know her as she changes and I change, adapt and respond to her needs. This is what it’s like to fall in love. In my experience, you meet someone and the first few months are a concentrated effort to get to know that person. Long days and late nights, talking to each other, discovering connections, sharing ideas and ideals, each person looking for a sense of surprise and delight as we unfold our lived experience in front of each other. In other words, we get to know that person and at the point or the period of falling in love, we commit ourselves to continually learning more about that person, listening to them, taking their feedback and adapting ourselves, growing old together. A relationship where neither or only one person takes on this commitment to listen, learn and adapt is, frankly, living hell.

And in a way, that’s what the most successful online services are engaging in. I’ve never been issued a survey from Google or Amazon. They don’t need to survey me, because they’ve been learning about me, with every click, every purchase, every email, every movement and decision they can track. ((I completely neglect to discuss privacy issues here. Needless to say, falling in love is quite different to being stalked.)) And using that feedback, that learning, they’ve adapted their services to respond to what they think are my needs. ((Sometimes they impose features on users and the technology can drive our actions and create artificial needs, and many of us recognise this manipulation or domination of the technology and begin to reject it, calling off the relationship. Sometimes people can become subservient in the relationship, too.)) The ‘tightness of feedbacks’, as Hopkins puts it, is essential to long-term friendships, marriages and, yes, the sustainability of library services. We need to get to the point where the feedback we receive from surveys is not necessarily perfect (what relationship is?), but is no longer of any use to us, because we already know what library users need, enjoy and are interested in. By creating a library system that learns from every person who uses it and adapts over time to the environment it is part of, we create a resilient and therefore a sustainable library system that its users fall in love with.

OPACPress: Our Talis Incubator proposal

Joss Winn / / Fun, Funding, Hacks, Libraries, Open Education, Projects

Yesterday, I submitted a proposal to Talis under their Incubator fund. If successful, I would have the pleasure of working with Paul Stainthorp, E-Resources Librarian at the University of Lincoln, and Casey Bisson,  Information Architect at Plymouth State University. The bid is to develop an idea which I’ve posted about before, based on Casey’s work on Scriblio and our adventures with WordPress MU, in particular, JISCPress.

Anyway, rather than re-iterating the bid here. You can read it in full by clicking here.

Comments are very welcome. Thanks.

UPDATE: We made it into the second round of judging but were unsuccessful in the end. Here’s the useful and fair feedback we received.

  • like the idea and how, like the Moodle repository, it can help open up existing content through data sharing. The same question as for others remains of how and why institutions would subscribe to the service.
  • I like this but I think it significantly underestimates the IP issues around library catalogue records which has been a major stumbling block for other activities in this area. That said, I think it is worth taking forward at this stage. The team looks very strong.
  • Ambitious in scope and technology, but /feels/ right for the innovative approach of this fund.
  • “Imagine that a significant number of UK universities and colleges… chose to make use of such a platform.” This type of language frightens me, indicating that they have no partnerships established, where other proposals already do. The point on issues with catalog records (above) should not be overlooked.
  • The use cases won me over. Not without risks ( as they say) and some major challenges
  • this one strikes me as particularly promising, because it has such strong ties to UK institutions and could connect to things Talis does

Open Education: Talis Incubator Proposal

Joss Winn / / Commons, Data, Fun, Funding, Libraries, Mashups, Open Education, Projects, Web

Back in May, I woke up with an idea in my head which, in a slightly modified form, I’d now like to try and find funding for. ((I figure that if I repeat this idea enough times, someone will see that it’s worth funding ;-))) The idea is based on work we’re doing on our JISCPress project, which itself is based on work Tony and I have been doing with WriteToReply since February. In my original blog post, I proposed that WordPress Multi User ((and here I’ll repeat what is becoming my mantra: ‘the same software that runs six million blogs on wordpress.com’ )) and Scriblio, a set of plugins for WordPress which allows you to import an OPAC library catalogue and benefit from all the advantages of the WordPress ecosystem, would together allow libraries to host independently branded catalogues on an open, union platform.

Imagine that JISC, Talis or Eduserv offered such a platform to UK university libraries. It could be a service, not unlike wordpress.com, where authorised institutions, could self-register for a site and easily import their OPAC, apply a theme, tweak some CSS, choose from a few useful plugins, and within less than a day or two, have a branded, cutting-edge search and browse interface to their OPAC, running under their own domain.

Paul and I gave a Lightening Talk about this at Mashoop North, which I present to you below.

Bibliografreedom

View more presentations from Joss Winn.

Slide four is the useful one. It show the various slices of the platform and, by implication, the various uses each layer offers.  The bottom slice shows the OPACs converge with WPMU to the benefit of the institution. It’s a nice, easy, hosted service that would offer an end-user experience not unlike the one that Plymouth State offer to their users. The middle slice – the WPMU bit – is where the OPACs converge together in union, under a single administrative interface that is easy to manage, widely used and supported. For $5000/year, Automattic, the company that leads the development of WordPress and runs wordpress.com, would provide support and advice with a six hour SLA. On top of that, anyone with a knowledge of PHP, can quickly learn the guts of WordPress, as Alex who’s working on JISCPress, will testify. My point is that this is a well tested and widely understood technology.

Now, once you have one or more OPACs hosted on WPMU, you bring together a lot of library catalogue data into one database and the platform’s web analytics (i.e. usage trends) can be a rich source of data for learning about what library users are looking for. Each library, would have access to their own analytics, while the analytics for the entire platform would also be collected. I do this on our university WPMU installation.

The next slice in our diagram, shows a few different ways of getting data out of the platform (and this would also apply to each individual catalogue site, too).  First, you can see that the platform as a whole could act as a union catalogue where, from a single site, users could search across library holdings. That union catalogue would have all the useful features of WordPress, too. Next to that, you can see Triplify, a nice little web application that transforms a relational database into RDF/N3, JSON and Linked Data. Triplify could re-present the data in each catalogue as semantic data and this could be subsequently hosted on the Talis platform.  We’re already doing this with JISCPress. Every night, changes to any of the library catalogue data could be pushed to Talis, where the data can be queried and mashed up using the Talis API. Finally, don’t forget good old RSS and Atom feeds, which are available for almost every WordPress endpoint URL, as I’ve previously documented.

Given the work we’ve done on JISCPress, which covers our experience with WPMU and Triplify, I think that a demonstrator prototype, using entirely open source software, could be developed within the constraints of the Talis Incubator fund. I canvassed my original idea to the Scriblio mailing list and had positive and useful feedback from Ross Singer at Talis. Leigh Dodds at Talis also sees potential in the use of WPMU and Triplify, although I understand that neither of these people are endorsing the idea for the Talis Incubator fund, but their interest has been encouraging.

So, what I’m proposing is that Paul and I work with Casey Bisson, the Scriblio developer, on a short project to get this all up and running. In my mind, Scriblio needs some more work to make the set up process easier for a variety of library catalogues and the last time I looked, it needed documenting better, too. I think that the maximum of £15,000 from the Talis fund is workable. In fact, I’d like to bring it down a little to make it more attractive to the judges. Paul would bring his knowledge and expertise from working with our university library catalogue, I would bring what we’ve learned from JISCPress and could manage the WPMU server side of things and the project in general, as well as write documentation, while Casey could be funded to spend some dedicated time fine tuning Scriblio to meet our objectives.

So what do you think? A wordpress.com like platform for library OPACs that pushes semantic data to the Talis platform. Each catalogue remains under the control of its owner institution, while contributing to a wider union OPAC that will benefit users and offer the library community some useful analytics. The platform as a technology, would be as flexible as WordPress itself is, so additional features could be developed for the platform by other future projects. Only last week, Tony was discussing on his new Arcadia project blog, how it would be useful to be able to capture library catalogue links as QR codes. Well, using WordPress in the way I’ve described, we could implement that across every UK HEI Library catalogue in a snap using this plugin. Hoorah!

Mashoop North!

Joss Winn / / Data, Fun, Libraries, Mashups, Projects

Paul and I have just presented our ‘lightning talk’ on the use of WordPress MU and Scriblio to create a platform for publishing multiple OPAC catalogues and then exposing the aggregate data as RDF using Triplify. I blogged about this idea a while back and this is the first presentation we’ve given. Not sure what people made of it. Too ambitious? Threatening? Confusing? All I know is that from where I’m standing, it would require a relatively small amount of funding to show it working in principle with a handful of library catalogues. The difficult part would be scaling it to work for 100+ catalogues (though bear in mind, wordpress.com hosts 6 million sites) and satisfying the politics of each institution. Still, that shouldn’t stop us from trying.

[slideshare 1691768&doc=bibliografreedom-090707092316-phpapp01]

Scriblio, Triplify and XMPP PubSub

Joss Winn / / Data, Fun, Libraries, Mashups, Standards & Specs, Web

It occured to me this morning, as I woke from my slumber, that the work I’ve been doing recently with WordPress, could also be applied to a library catalogue using Scriblio.

Scriblio (formerly WPopac) is an award winning, free, open source CMS and OPAC with faceted searching and browsing features based on WordPress. Scriblio is a project of Plymouth State University, supported in part by the Andrew W. Mellon Foundation.

Which means that you can import your library catalogue into WordPress and the user can search for and retrieve a record for The Films of Jean-Luc Goddard. Have a look around Plymouth State’s Scriblio and you’ll get a good feel for what’s possible.

Anyway, taking Scriblio’s functionality for granted, you could easily add Triplify to the mix as I have discussed before. So with very little effort, you can convert your library catalogue to RDF N-Triples (and/or JSON). My questions to you Librarians is: knowing this is possible and fairly trivial to do, is there any value to you in exposing your OPACs in this way?

Next, as I lay listening to my daughter chat to her squeaky duck, I thought about the other stuff I’ve been looking at recently with WordPress.  Once you think of your library catalogue as a WordPress site, there’s quite a lot of fun to be had.  You could ramp up the feeds that you offer from your OPAC, use the OpenCalais API to add semantic tags, plugin some more semantic addons if you wish (autodiscovery of SIOC, FOAF, OAI-ORE data??), and, perhaps most fun of all, publish OPAC records in realtime over XMPP PubSub.

Which brings me to JISCPress, our recent #jiscri project proposal, which we may or may not get funded (what are we, a week or two away from finding out??).  In that Project, we’re proposing a WordPress MU platform for publishing and discussing JISC funding calls and project reports (among other things).  There’s a lot of cross-over between the above Scriblio ideas and JISCPress. So much so, that it’s probably no more than a days work to transform the JISCPress platform, hosted as an Amazon Machine Image, to a multi-user OPAC platform where, potentially, all UK University libraries, publish their OPACs via separate Scriblio sites.

You could then, like wordpress.com has done, publish an XMPP firehose from every catalogue over PubSub for search engines or whoever is interested in realtime data from UK university library catalogues. Alternatively, instead of the WPMU set up, each University library could maintain their own Scriblio install and publish an XMPP feed to an agreed server (though that approach seems like more hassle than is necesary if you ask me. You’re bound to have some libraries falling behind and not upgrading their sites as things develop. For less than a collective £4K/year, we could all buy into commercial support for a WPMU site from Automattic to help maintain server-side stuff).

I dunno. Maybe this is all off the wall, but the building blocks are all there. Is anyone experimenting with Scriblio in this way? Don’t tell me, a bunch of you have been doing it for years…