data.lincoln.ac.uk

Recently, I posted on the LNCD blog about our work on data.lincoln.ac.uk. You might find it interesting.

One of the by-products outcomes of our recent ‘proper’ projects is data.lincoln.ac.uk. This is simply a site that documents the data we are warehousing in our MongoDB datastore (called ‘Nucleus’), and the programatic methods by which we (and the public) can access that data. Most of the data is licensed for public use, but where appropriate (e.g. personal data), a secure access token must be requested. Currently, outside of our own projects, the only people needing/wanting secure access tokens are some third year computer science students who are using data.lincoln.ac.uk as the basis for their dissertation projects and require access to their own personal event data.

Our approach to publishing open data at the University of Lincoln has been to do so in a way that was immediately useful to the work we were doing…

Read more about ‘an open platform for development‘.

Speaking in NYC

Mike Neary and I were in New York City from the 11-16th October, speaking about Student as Producer. We held seminars at Adelphi University, Baruch College CUNY and were part of a panel at the Mobility Shifts Conference at The New School. Here is a recording of the CUNY event, where we had the pleasure of sharing the seminar with Jim Groom, someone who’s been an inspiration for my work on the university WordPress platform.

LNCD, DevXS and Orbital

It’s been a busy summer, to say the least.

The DIVERSE project is up and running and the Linking You and Jerome projects came to a successful end. We were joined by Jamie Mahoney, a new full-time Web Developer Intern and established a new group (LNCD). We’re co-organising a national student developer conference (DevXS) and have just been awarded a £241,500 grant for Orbital, an 18 month project to develop and pilot a new research infrastructure for the School of Engineering. Orbital is a great opportunity to build on some of our earlier work and get stuck into the challenges of managing raw research data. Which reminds me: data.lincoln.ac.uk is live, too 🙂

Please do tell your students about DevXS.

    Orbital: A proposed Managing Research Data project

    Following my usual tradition, I am dutifully posting a bid document that I submitted today to JISC’s Managing Research Data Programme. As you might already know, I do this in an attempt to open up the process of bid writing a bit more, in what is normally a competitive environment. I also hope that it might attract some interest from and possible future collaboration with other people in the university sector, whether we are successful in winning funding or not. We’ve been pretty successful with our bids over the last couple of years, too, and have received good feedback from JISC on the quality of our bids, so it seems like the decent thing to share good practice.

    Our proposed project is called Orbital because we’re intending to build services for managing research data that ‘orbit’ around Nucleus, the data store we built during the Total Recal and Jerome projects. The bid was a pretty easy one to write, to be honest. Everything felt right as soon as I read the call documentation because I could see a way of re-using and further developing the work we’ve been doing since I joined the university in 2007. Of course, we’ve set ourselves some new challenges with this project and much work needs to be done in all phases of the project, but having the experience of building web services around large institutional data sets, gives me the confidence that we can tackle what is a really important issue for us – for any university: managing a growing body of research data. It’s also a project that takes me back to my roots, having joined the university to work on our Institutional Repository project. Prior to that I was an Archivist at the BFI National Film and Television Archive and Project Manager for the development of Amnesty International’s Digital Asset Management system. It was good to revisit the the whole digital archiving domain again and I even re-discovered a blog I kept in 2006 while on JISC’s week-long Digital Preservation Training Programme.

    Although the bid has been sent off now, and who knows whether it will be funded or not, the process of writing the bid has been really useful. I had planned to spend much of July drafting a journal paper but seeing the call, switched into bid writing mode. Writing bids regularly, I try to get something out of them, despite knowing that they may not be funded. The idea of retrospectively viewing unfunded bids as a waste of time would depress the hell out of me and so I try to approach it as a reflective process, where I talk with colleagues about what we’ve done, where were are now and where we want to go with our work. Through writing this bid, it became really clear how the work we’ve been doing on other projects has brought us to the point where we have a good team of people who have developed a very modern, extensible and flexible technical framework which we can deploy in a number of domains, including managing research data. It’s all in the bid, so I won’t repeat it here, but it’s something we should be proud of.

    I think that one of the things that good developers do is identify and/or build the tools they need to do their job effectively. That’s what we’ve been doing with WordPress, the Common Web Design, OAuth, Nucleus, data dot lincoln,  the Jerome discovery tool and the Linking You toolkit, so that now we have the skills and the tools to tackle future work more efficiently and have fun, too. There’s nothing that kills the fun of development more than having to work with crap tools.

    Open Data at Lincoln: What have we got?

    Tony Hirst recently blogged about the Open Data scene in UK HE, mentioning Lincoln as one of the few universities that are currently contributing HEI-related #opendata to the web. Sooner or later, I’ll write a more reflective post, but here I just wanted to document the current situation (that I’m aware of) at Lincoln. There are two groups that take an interest in furthering open data at Lincoln: LiSC, led by Prof. Shaun Lawson, and LNCD, the new cross-university group I co-ordinate which consolidates a lot of the previous and current work listed below. (For a broader overview of recent work, see this post).

    Derek Foster in LiSC recently released energy data from our main campus buildings, updated every 2hrs on Pachube. I was just speaking to Nick and Alex and I think they plan to pull this data into our nucleus datastore, combine it with the campus location-based work we’ve done and generate dynamic heat maps (assuming Derek isn’t already working on something similar??)

    LiSC are also mashing open data from the UK Police Crime Statistics database to create a social application called FearSquare and last week put together MashMyGov, a site that randomly suggests mashups using data sourced from Data.Gov.UK.

    In the past couple of years, LNCD have worked on:

    JISCPress, a 2009/10 project we worked on that didn’t release any data but developed a prototype WordPress platform that atomises documents for publication and comment on the web and spits out lots of data in open formats. It also uses OpenCalais, Triplify and can push RDF Linked Data to the Talis Platform. JISC now use it to publish documents for comment.

    Total Recal, a JISC-funded project we completed recently and will roll out across the university this September. As well as providing a fairly comprehensive and flexible calendaring service at the university, it allowed us to work on our space-time data and develop a number of APIs on top of…

    Nucleus, the epicentre of our open data efforts. This is a data store, using MongoDB, which aggregates data from a number of disparate university databases and makes that data available over secure APIs. Through a lot of hard work over the last year, Alex and Nick have compiled the single largest data store that we have at the university. Currently, it offers APIs to university events, calendars, locations and people. We’ll also be adding APIs to over 250,000 CC0 licensed bibliographic records held in Nucleus, too (see Jerome below). It also uses the OAuth-based authentication that Alex has developed.

    Linking You, is a JISC-funded project we delivered last week to JISC, which looked at our use of URIs, undertook a comparative study of 40 HEI websites (more to come), proposed a high-level data model for use by the HEI sector and made some recommendations for further work. What we’ve learned on this project will have a lasting effect on the way we present our data and on our wider advocacy of open data to the university sector. I really hope that our recommendations will lead us to more discussion and collaboration with people interested in opening university data.

    lncn.eu, a URL shortener that Alex and Nick developed in their spare time for a while and has since been formally adopted by the university. Naturally, lncn.eu has an API and can be used (e.g. Jerome) as a proxy for other services, collecting real-time analytics.

    Jerome, is a current JISC-funded project that will release over 250,000 bibliographic records under a CC0 license. The data is stored in Nucleus and documented APIs will be available by the end of July. This is a very cool project managed by Paul Stainthorp in the Library (who’s also a member of LNCD).

    We’re currently using data.online.lincoln.ac.uk to document the data that is accessible over our APIs. At some point, I can see us moving to data.lincoln.ac.uk – we just need to find time to discuss this with the right people. So far, we haven’t really gone down the RDF/Linked Data route, preferring to offer data that is linked (e.g. locations and events data are linked) and publicly accessible over APIs that are authenticated where necessary and open whenever possible. We are keen to engage in the RDF/Linked Data discussion – it’s just a matter of finding time. Please invite us to your discussions, if you think we might have something to contribute!

    DIVERSE: A new JISC-funded project

    I’m pleased to report that this week, Dr. John Murray and I were awarded one of JISC’s Teaching and Learning Innovation Grants. As usual, you can read the full bid to JISC on Google Docs. Very roughly, it’s a study of what happens when Social Bookmarking and Learning Analytics meets Student as Producer. I think it’s going to be a really interesting project, and I’m looking forward to working with John, the Principle Investigator, and two of his students.

    This project will undertake a cross-departmental study of the use of ‘resource clouds’ for subject research, peer-review and validation of materials. It will build on DIVERSE, a tool for crowd-sourcing relevant subject resources, to determine student understanding of lecture and assignment topics. Through an analysis of qualitative and quantitative data, it will examine why students favour particular resources, determine how reading lists can be more effectively created and provide case studies of how students can contribute to lecture design.

    This programme of funding requires a different application process, using a template and interview format. I think this is to improve the efficiency of bidding and judging, although in my case I spent more time on this bid and then preparing for the interview than any previous application! I quite enjoyed it and the online interview afforded me a bit more confidence than sitting face to face in a room as I was able to refer to written notes a lot more than if were I in right in front of the panel.

    While talking to the interview panel I realised that I am in a fortunate position to be working in the Centre for Educational Research and Development, which leads the University’s Teaching and Learning Strategy (Student as Producer), as well as sharing the responsibility for technology for research, teaching and learning with the Library and ICT department. It’s these close working relationships with all the right people and the great support and enthusiasm we have from the Vice Chancellor’s Office, the Dean of Teaching and Learning, Head of ICT and the University Librarian, that allows me to talk with confidence about undertaking and sustaining our work.

    As you’ll see from the full grant application, development of the DIVERSE tool was funded internally by the Student as Producer project under our Fund for Educational Development. I’m happy to say that DIVERSE will be the first project that our new group provides support for as we intend to do for many other projects. We’ll be ensuring that John and his students are able to integrate the DIVERSE tool into our CWD+Nucleus+OAuth framework over the summer in time for the new academic year.

    This is exactly the model that I hope we can keep repeating: students and staff with good ideas around the use of technology for education (it doesn’t have to be software development!)  bid internally for a small amount of funding where required and, if successful, then we provide the appropriate institution-wide advocacy and support (technical integration, training, joint research, etc.). If such projects are also able to attract external funding, it suggests we’re doing the right thing.

    Technology for education: A new group

    I offer this as one response to my previous post. Much more needs to be done to ‘reverse imagineer’ EdTech, but this will be my practical focus for the foreseeable future and the nexus of where theory is put into practice, where pedagogy meets technología: “The processes and practices of doing things, understanding things and developing knowledge”? (Selwyn 2011, p7)

    A new group

    In January, I wrote about how I had written a paper for the university about the role of technology in the context of Student as Producer. The paper included a recommendation that a new team be convened to “further the research, development and support of technology” at the university. January feels like a long time ago now, and I wanted to write about what’s been happening since then, because it’s all good 🙂

    Following my presentation of the original paper to the Teaching and Learning Committee, I was asked to provide more detail on what the proposed team would do and a justification for the budget I had outlined. Both papers were written on behalf of and with the co-operation of, the Dean of Teaching and Learning, the University Librarian, the Prof. of Education, the Head of ICT and the Vice President of Academic Affairs in the Student Union. The second paper went back to the T&L Committee and, following their approval, then went to the university’s Executive Board in early April.

    I began the paper by outlining what the team is for:

    The team will consolidate and extend the existing collaborative work taking place between Centre for Educational Research and Development, The Library and ICT Services ((Since writing this, I’ve listed examples of our existing work in a recent blog post. You can add JISCPress and ChemistryFM, this WordPress platform and our e-portfolio system to that list, too.)) and invite staff and students from across the university to join the team. The team will offer incentives to staff and students who wish to contribute to the rapid innovation of appropriate technology for education at the university, through work-experience, research bursaries and internal and external applications for funding. Through our experience of the Fund for Educational Development (FED) and Undergraduate Research Opportunity Scheme (UROS) funds, we know this is an effective method of engaging staff and students in research and development. A core principle of the team will be that students and staff have much to learn from each other and that students as producers can be agents of change in the use of technology for education.

    I then went on to argue:

    The Student as Producer project is anticipated to take between 3-5 years to fully embed across the university. During this time, significant changes will occur in the technologies we use. In just the last five years, we have seen the rise of web applications such as YouTube, Facebook, Twitter, and Web 2.0 in general. Aside from such applications, networked infrastructure has developed considerably, with access to broadband now widespread and the use of smart phones and netbooks rapidly increasing. For a student at the University of Lincoln in 2011, high-speed networks are now ubiquitous across the city campuses and such networks themselves are now the ‘learning landscape’, in which the university is but one part.

    There is a strong argument for shifting away from the idea of ‘educational technology’ to address technology straight on, recognising that any technology can support and enhance the research, teaching and learning process, and that the use of these technologies increasingly lies outside the institution’s control. We would argue that it is not the university’s role to compete with or determine the use of any technology but rather support access to technology in the broadest terms. This can be achieved through incremental improvements to infrastructure (e.g. network capacity and ease of use), supporting staff and students (e.g. training, workshops, courses) and personalising and integrating the services we do provide so that staff and students have a useful and enjoyable experience of technology at the university and understand how it fits within their wider networks. In particular, we should consider whether Blackboard can be better enhanced through mobile applications and the integration of other popular services such as Facebook. It is a key technology for the support of teaching and learning and if extended through the work of the proposed team, could be a platform for innovation. All of this work should be informed by a broad understanding of the social roles of technology and the objective of producing critical, digitally literate staff and students.

    I presented a list of risks that I thought would present themselves if we didn’t take this approach:

    1. Poor co-ordination: Poorly co-ordinated investment in technology to support strategic objectives, resulting in competing interests in limited resources.
    2. Disjuncture: Growing disjuncture between student expectations and institutional provision of technology and support.
    3. Inertia: No locus for technological experimentation and innovation.
    4. Unattractive to potential post-graduates and staff: Technological provision compares poorly to other institutions, putting off new staff and post-graduates.
    5. Loss of income stream: Under-investment in ‘seeding’ projects that may attract external income.
    6. Business As Usual: During a period of significant change in Higher Education, our progressive T&L Strategy is hindered by poorly co-ordinated technological development.
    7. Student as Consumer: Technology remains something ‘provided’ by the university, rather than produced and informed by its staff and students.

    Finally, I provided more detail about the costs. After taking into account existing budgets available to us and anticipated external research income, the total I asked for was £22K/yr to pay for an additional 12-month Intern position and a contribution to the staff and student bursaries we want to make available.  This was approved.

    I was pleased with the outcome as it means that our current work is being recognised as well as the strategic direction we wish to go in. In terms of resourcing, we will have at least one more full-time (Intern) post and hold a £20K annual budget which will be used to provide grants and bursaries to staff and students, pay for hardware and software as needed and pay for participants to go to conferences to discuss their work and learn from the EdTech community at large. This doesn’t include any external income that we hope to generate. The nature of our applications for research grants is unlikely to change other than we hope to have more capacity in the future including both students and academic staff as active contributors to the development, implementation and support of technology for education at the university.

    Team? Group? Network? Place?

    The core members of the group (i.e. CERD/ICT/Library) met for an afternoon last week to discuss the roadmap for getting everything in place for the new academic year. We began by discussing the remit of the group (as detailed in the two committee papers), which is principally to serve the objectives of Student as Producer, the de facto teaching and learning strategy of the university. We spent a while discussing the nature of the group; that is, whether it was a team, a network, a group or even a place. In the first committee paper I wrote, I described it as “a flexible, cross-departmental team of staff and student peers”, but have since come to refer to it as a ‘group’, as ‘team’ does not reflect the nature of how we intend to work, nor the relationships we hope to build among participants, nor is a ‘team’ inclusive enough. I’d like to think that we’ll develop a network of interested staff and students and even attract interest and collaboration from outside the university, but I think it’s too early to call what we’re doing a network, although we are networked and working on the Net.  We’ve given ourselves a couple of weeks to come up with name but whatever we call it, we agreed that in principle we’d govern the group by consensus among us. Ideally, though not always in practice, the Net can help us create flatter structures of governance, so we’ll try to shape the way we work around this ideal.  My role will be to co-ordinate the work of the group by consensus.

    UPDATE: We decided upon LNCD as the name for our group. It’s a recursive acronym: LNCD’s Not a Central Development group.

    All participants will be encouraged to write about their work in the context of Student as Producer, building on the progressive pedagogical framework that is being implemented at the university, theorising their work critically and reflexively. We’ll support this approach, too, building a reading list for people wanting to think critically about EdTech and an occasional seminar series where we’ll discuss our ideas critically, reflexively and collegially.

    Road map and tools

    We will be up and running by the start of the next academic year. Over the summer, we’ve got a timetable of work that we plan to do to ensure we’ve got a clearly defined identity and the tools in place to support the nature of our work. By the end of September, we’ll have a website that offers clear information on what we do, what we’re working on, how to get involved and the ways we can support staff and students at the university. The site will allow you to review all aspects of our projects as well as propose new projects which can be voted up and down according to staff and students’ priority. There will be an application form for you to apply for funding from us and a number of ways for you discuss your ideas on and offline. We’ll be continuing our current provision of staff training, but will be looking to re-develop the sessions into short courses that are useful to both staff and students. The 2009 Higher Education in a Web 2.0 World report recommended that

    The time would seem to be right seriously and systematically to begin the process of renegotiating the relationship between tutor and student to bring about a situation where each recognises and values the other’s expertise and capability and works together to capitalise on it. This implies drawing students into the development of approaches to teaching and learning. [Higher Education in a Web 2.0 World, p.9]

    This is very much what Student as Producer is aiming to do through embedding research-engaged teaching and learning across the curricula and the approach we plan to take around support and training for the use of technology in teaching and learning. We’ll be working with the Student Union and the Principle Teacher Fellows across the university to identify ways that students and their tutors can be encouraged to support each other and we welcome the input and collaboration of anyone who wishes to adopt and advocate this approach. We’ll be designing some posters, flyers and business cards over the summer so that people around the university know who we are and how to get in touch in time for Fresher’s Week.

    For the Geeks, you might be interested to know that we’ve decided upon a set of tools for managing our work online in a distributed environment where most of us work in different parts of the university campuses. We’ll have a dedicated virtual Linux box (as well as our usual development servers) and the main website will be run on WordPress using our own custom CWD theme. We’ll be migrating all of our code to Git Hub very soon and we’ll be using Pivotal Tracker to manage our development tasks in an agile and open way. We’ll be using our existing combination of Get Satisfaction and Zen Desk to manage peer-to-peer user support and bug reports and we’ll also be looking at alternatives such as User Voice and the Open Source Q&A tool to provide a way for you to suggest and vote for project ideas. Notably, through the use of their APIs, most of these tools integrate well, so that we can create tasks in Pivotal Tracker from bug reports made with Zen Desk and associate those tasks with commits on Git Hub. We’ll be using Twitter just as we always do, and we’ll be using Google Groups for longer discussions around each project (as well as regularly meeting face-to-face, of course). For projects that don’t involve writing code (which we certainly welcome), we’ll be looking at tools that assist with resource development and document control, such as digress.it, MediaWiki, Git Hub, Google Docs, EPrints and Jorum, depending on the nature of the project. We won’t be prescriptive with the tools we adopt, using whatever is appropriate, but with an emphasis on those that offer decent APIs, data portability and good usability. Proprietary software lacking APIs and with poor usability (we can all think of a few) won’t get much of a look in. Finally, through RSS and widgets, we’ll be presenting a coherent picture of each project on the main website.

    There’s quite a bit to do but we know how to do it.  If you’ve got any suggestions (a name would be useful!), ideas or even want to join us, for the time-being, leave a comment here and we’ll get back to you. Thanks.

    JISC INF11 Programme Meeting: From unprojects to services

    I’m going to the JISC Information Programme Meeting on Thursday and have been asked to join a panel where I’ll talk about our work at Lincoln under the heading ‘from unprojects to services’. Here are my notes.

    Over the last couple of years, staff in CERD, The Library and ICT have worked closely together on a number of ‘rapid innovation’ projects, which have sometimes later attracted JISC funding.  Much of our work has been undertaken at the initiative of individual staff, who have benefited from a supportive ICT environment that allows us the freedom to develop and test our ideas without running into bureaucratic walls. ICT – in particular the head of the department, Mike Day, and head of the Online Services Team, Tim Simmonds – recognised the benefits of employing undergraduate students and recent graduates, and established a post which Nick Jackson and Alex Bilbie share. Alongside this, I have been applying for JISC funding and successful bids have allowed us to employ Nick and Alex full-time rather than part-time. In recent months, this has worked very well and currently much of their time is spent working on JISC-funded projects which bring value to the University. Below, are a list of the services that this culture of innovation has allowed us to work on over the last year or so. Click on the links to go to the services.

    The Common Web Design: Distributed HTML5/CSS3 template for internal services
    Posters: A repository for visual communications
    lncn.eu: The official URL shortner for the university. Provides real-time stats, API and acts as branded/trusted proxy for other services.
    Single Sign On: OAuth/SAML/Shibboleth/NTML/Eduroam integration
    Zen Desk: University Help Desk
    My Calendar: An aggregation of space-time data into a flexible web service. JISC-funded.
    Nucleus: Datastore for People, Events, Bibliographic and Location data (and more to follow). Provides (open) APIs to all other services. MongoDB.
    James Docherty, a third year student, used the nucleus datastore as a source of data for his final year project: Situated Displays for buildings, showing room booking information, posters and announcements.
    Staff Directory: Fast, versatile people-focused search engine
    Jerome: Fast, modern, personalised library search portal aggregating books, journals and EPrints data. JISC-funded.
    Mobile: A directory of university services for mobile devices
    Online Server Monitoring: A simple dashboard for anyone to check whether a service is working
    QR Codes: Will be used for asset tags and already being used in rooms to create Help Desk tickets.
    • Most of these services push and pull data to Nucleus, the central, open datastore built on MongoDB. e.g. Zen Desk=People + Locations, My Calendar=Events, Jerome=Bibliographic
    • We’re currently looking at how Nucleus can also be a source for Linked Data. It has open(ish) APIs.
    • CWD sites transparently sign the person in to the site, if they are signed in elsewhere.
    • We like Open Source. SSO is mostly open source software. Alex has released his OAuth 2.0 code. CWD likely to be open source; MongoDB, bits and pieces from Jerome and My Calendar.
    • As we build these services, they are being integrated, too. e.g. lncn.eu will be a URL resolver for Jerome offering realtime monitoring; posters will show up in My Calendar events; CWD is the design framework for My Calendar.
    • Most of these services are for official launch in September. They will be included in the new ICT Handbook, included in brochures and other announcements.
    • We’re working with the Student Union to develop the use of FourSquare around the university.
    • Now that we know we can develop this way and that it works and we enjoy it, we’re hoping to expand from two to four student/graduate developers and have our own budget for hardware/software/conferences and to give to staff and students that want to join us.
    • Our approach links into the University’s Teaching and Learning Strategy: Student as Producer. We want to work with students and staff across disciplines to create useful, innovative and enjoyable online services that make the University of Lincoln a great place to work and study at. It’s not about a team that works on ‘educational technology’, but rather a network of people who develop and support technologies that make Lincoln a productive environment for research, teaching and learning. It’s inclusive, with students (and therefore learning) at its core.