An introduction to guerrilla impact evidence gathering

A
Artefacto
· · 7 min read
In our last blog post, we looked at how collecting feedback from researchers can be built into existing library services. The idea is to capture evidence while doing your everyday work, not as a one-off, separate evaluation project.

Researcher feedback can be strong impact evidence, but there are other ways to collect valuable insights from your users. In this post and in the series to follow, we will explore these other approaches, which we are calling guerrilla impact evidence gathering, and look at how you can use them in your library.

Three people sharing ideas in front of the sticky-note wall

But first of all, what do we mean by guerrilla impact evidence gathering?


Put simply, it’s a fast and informal way of capturing feedback and observations while people are engaging with our services. Like other ‘guerrilla’ approaches in other fields, such as guerrilla usability testing, it is done where people are, using simple and low-cost methods, such as short conversations, observations, sticky note walls and more.

These methods don't necessarily require a detailed evaluation plan, lengthy setup or complicated tools. We can start by making the most of the opportunities that already exist in our everyday work. For example, by asking a follow-up question at the end of an enquiry, paying attention to how people use library space or having a quick chat with a group at the end of a workshop. 

Why we should integrate it in everyday work


First of all, we need to acknowledge that library staff are using these informal methods all the time. Frontline staff are already having conversations and making observations every day. But the next step is to record what is already happening. 

People who work in libraries and engage with users every day know they are making a difference in people’s lives. But during these informal conversations, we also have an opportunity to find out about people’s experiences of our services. This is a unique chance to connect with users in a personal way, and to show that we are interested in their experience, not just in the data we can report back to funders.

These approaches are accessible and easy to implement within your team. Even staff who feel a bit daunted by formal evaluation can begin with something small and manageable. Acknowledging that they are already doing these sorts of interventions might be a first step in encouraging curiosity within your team and a chance for collaborative experimentation and learning. 

There is a practical benefit too. Funders and other stakeholders will often ask for tangible evidence. Comments, observations and users’ own words can help illustrate the difference library services are making. If we record these interactions on an everyday basis, we build up a solid and authentic evidence base that we can share with them. 

Guerrilla impact evidence gathering is useful but it has its own limits. It is not a replacement for rigorous, systematic evaluation processes. But these methods can be used to identify possible impacts, illustrate your users’ experiences, generate insights into what works and what doesn’t. Think of it as complementary evidence to rigorous research. These methods can complement more structured evaluation with minimal effort and without requiring changes to your team’s current practices.

Let’s talk about some of the methods you can use. 

Some ways to gather guerrilla impact evidence in your library

Observations

Observation is already a part of everyday library work. When staff are roving or on their floor duty, they check not only whether everything is at it should (printers running, the study space clean and so on) but also make themselves visible for those who might need help. 

These moments are also a great opportunity to notice changes in behaviour, which could reveal insights that could not be discovered via surveys. You can start writing down a few notes, a sentence or two about things and behaviours you noticed while performing your duties. They’re most useful when your team agrees in advance what to look for, whether that’s how the study rooms are being used or when are the busiest times. Two or three things at a time is more than plenty, so everyone in your team is looking at the same thing.

Short individual conversations

Every chat you have with your users is an opportunity to gather impact evidence. A short conversation at the enquiry desk, near the printer or after a workshop can reveal a lot about how people use your library, what works for them and what doesn’t. 

These short conversations can reveal personal experiences and outcomes that you might not have a chance to capture in formal surveys. It’s important to listen and avoid leading people towards a positive answer. This is a chance to find out what they really need. An honest response, including criticism, is often more useful than a forced compliment.

Ad-hoc group conversations

Informal group discussions can help us understand shared experiences. Sure, focus groups can provide great, indepth results, but they also need preparation and set-up and this is not always possible. 

Instead, we can ask a group that already meets in the library, such as a reading group, workshop or student support session, to spare five minutes before or after their gathering. One or two questions is enough, for example what they found valuable, what surprised them or what they would change.

People are often happy to help when you ask for a small favour like this. However, it’s always important to respect their time - if they don’t want to participate, accept it and try another group later. And rather than recording the conversation, just note down the main themes and anything that stood out. 

Short videos

A short video testimonial is another powerful way to capture someone’s experience in their own words. And libraries often use this approach because users are often the biggest advocates of library services - seeing and hearing from a real person is the strongest case you can make.

Creating a video doesn't need much preparation either, just a phone and people willing to take part. You can also ask users to record and send in their own video.

Remember to get clear, informed consent, and explain where and how you are gonna use the footage before recording (and how they can contact you if they have questions).  

Sticky-note walls and digital walls

You can ask a simple question, put it on a wall and invite your users to share their thoughts. It’s cheap, it doesn’t require much preparation, and it feels more participatory. Also, people tend to participate more when they see other people’s contributions.

There are plenty of chances to try this in a library. Valentine’s Day? Ask people to write a love letter to your library. Just launched a new exhibition, book collection or themed display? Ask which book from your collection made an impact on them. Make it fun, document it and share the results with your users afterwards. 

There are also digital equivalents of a sticky note wall, in which people can share their comments during online webinars, meetings or study groups. 
Notes
We’ve mentioned some informal ways of gathering impact evidence that can be introduced in your library. Their value is not in producing a perfect piece of evidence, but in making evidence gathering possible.

So, for managers and team leaders, the task is to give staff time and space to capture these insights and reflect on them. A good way to start is by introducing it into everyday routines you already have.

What’s next

This post is just the beginning of our exploration of more lightweight, accessible approaches to gathering impact evidence. In our future posts, we will look at these approaches in more detail, sharing practical tips and examples from both public and academic libraries.

Keep reading