An introduction to guerrilla impact evidence gathering
A
Artefacto
In our last blog post, we looked at how collecting feedback from researchers can be built into existing library services. The idea is to capture evidence while doing your everyday work, not as a one-off, separate evaluation project.
Researcher feedback can be strong impact evidence, but there are other ways to collect valuable insights from your users. In this post and in the series to follow, we will explore these other approaches, which we are calling guerrilla impact evidence gathering, and look at how you can use them in your library.
But first of all, what do we mean by guerrilla impact evidence gathering?
Put simply, it’s a fast and informal way of capturing feedback and observations while people are engaging with our services. Like other ‘guerrilla’ approaches in other fields, such as guerrilla usability testing, it is done where people are, using simple and low-cost methods, such as short conversations, observations, sticky note walls and more.
These methods don't necessarily require a detailed evaluation plan, lengthy setup or complicated tools. We can start by making the most of the opportunities that already exist in our everyday work. For example, by asking a follow-up question at the end of an enquiry, paying attention to how people use library space or having a quick chat with a group at the end of a workshop.
Why we should integrate it in everyday work
First of all, we need to acknowledge that library staff are using these informal methods all the time. Frontline staff are already having conversations and making observations every day. But the next step is to record what is already happening.
People who work in libraries and engage with users every day know they are making a difference in people’s lives. But during these informal conversations, we also have an opportunity to find out about people’s experiences of our services. This is a unique chance to connect with users in a personal way, and to show that we are interested in their experience, not just in the data we can report back to funders.
These approaches are accessible and easy to implement within your team. Even staff who feel a bit daunted by formal evaluation can begin with something small and manageable. Acknowledging that they are already doing these sorts of interventions might be a first step in encouraging curiosity within your team and a chance for collaborative experimentation and learning.
There is a practical benefit too. Funders and other stakeholders will often ask for tangible evidence. Comments, observations and users’ own words can help illustrate the difference library services are making. If we record these interactions on an everyday basis, we build up a solid and authentic evidence base that we can share with them.
Guerrilla impact evidence gathering is useful but it has its own limits. It is not a replacement for rigorous, systematic evaluation processes. But these methods can be used to identify possible impacts, illustrate your users’ experiences, generate insights into what works and what doesn’t. Think of it as complementary evidence to rigorous research. These methods can complement more structured evaluation with minimal effort and without requiring changes to your team’s current practices.
Let’s talk about some of the methods you can use.
Some ways to gather guerrilla impact evidence in your library
Observations
Observation is already a part of everyday library work. When staff are roving or on their floor duty, they check not only whether everything is at it should (printers running, the study space clean and so on) but also make themselves visible for those who might need help.
These moments are also a great opportunity to notice changes in behaviour, which could reveal insights that could not be discovered via surveys. You can start writing down a few notes, a sentence or two about things and behaviours you noticed while performing your duties. They’re most useful when your team agrees in advance what to look for, whether that’s how the study rooms are being used or when are the busiest times. Two or three things at a time is more than plenty, so everyone in your team is looking at the same thing.
Short individual conversations
Every chat you have with your users is an opportunity to gather impact evidence. A short conversation at the enquiry desk, near the printer or after a workshop can reveal a lot about how people use your library, what works for them and what doesn’t.
These short conversations can reveal personal experiences and outcomes that you might not have a chance to capture in formal surveys. It’s important to listen and avoid leading people towards a positive answer. This is a chance to find out what they really need. An honest response, including criticism, is often more useful than a forced compliment.
Ad-hoc group conversations
Informal group discussions can help us understand shared experiences. Sure, focus groups can provide great, indepth results, but they also need preparation and set-up and this is not always possible.
Instead, we can ask a group that already meets in the library, such as a reading group, workshop or student support session, to spare five minutes before or after their gathering. One or two questions is enough, for example what they found valuable, what surprised them or what they would change.
People are often happy to help when you ask for a small favour like this. However, it’s always important to respect their time - if they don’t want to participate, accept it and try another group later. And rather than recording the conversation, just note down the main themes and anything that stood out.
Short videos
A short video testimonial is another powerful way to capture someone’s experience in their own words. And libraries often use this approach because users are often the biggest advocates of library services - seeing and hearing from a real person is the strongest case you can make.
Creating a video doesn't need much preparation either, just a phone and people willing to take part. You can also ask users to record and send in their own video.
Remember to get clear, informed consent, and explain where and how you are gonna use the footage before recording (and how they can contact you if they have questions).
Sticky-note walls and digital walls
You can ask a simple question, put it on a wall and invite your users to share their thoughts. It’s cheap, it doesn’t require much preparation, and it feels more participatory. Also, people tend to participate more when they see other people’s contributions.
There are plenty of chances to try this in a library. Valentine’s Day? Ask people to write a love letter to your library. Just launched a new exhibition, book collection or themed display? Ask which book from your collection made an impact on them. Make it fun, document it and share the results with your users afterwards.
There are also digital equivalents of a sticky note wall, in which people can share their comments during online webinars, meetings or study groups.
We’ve mentioned some informal ways of gathering impact evidence that can be introduced in your library. Their value is not in producing a perfect piece of evidence, but in making evidence gathering possible.
So, for managers and team leaders, the task is to give staff time and space to capture these insights and reflect on them. A good way to start is by introducing it into everyday routines you already have.
What’s next
This post is just the beginning of our exploration of more lightweight, accessible approaches to gathering impact evidence. In our future posts, we will look at these approaches in more detail, sharing practical tips and examples from both public and academic libraries.
Keep reading
Researcher feedback as impact evidence - a practical guide for academic libraries
In academic libraries, there are many opportunities every day to capture evidence of your library’s impact. This migh...
How to add your first impact story in ImpactKit
If you read our previous post, Measuring Impact By Listening to Users, you’ll already know that by an impact story we...
How ImpactKit can help you transform feedback into impact evidence
Evidence of impact doesn’t always come in the form of a formal evaluation. How many times have you received feedback ...