UK TimesUK Times
  • Home
  • News
  • TV & Showbiz
  • Money
  • Health
  • Science
  • Sports
  • Travel
  • More
    • Web Stories
    • Trending
    • Press Release
What's Hot

A1(M) southbound between J43 and J42 | Southbound | Vehicle Recovery

16 March 2026
Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times

Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times

16 March 2026
Employer opportunity at Fermanagh Cross Border Job Fair

Employer opportunity at Fermanagh Cross Border Job Fair

16 March 2026
Facebook X (Twitter) Instagram
Facebook X (Twitter) Instagram
UK TimesUK Times
Subscribe
  • Home
  • News
  • TV & Showbiz
  • Money
  • Health
  • Science
  • Sports
  • Travel
  • More
    • Web Stories
    • Trending
    • Press Release
UK TimesUK Times
Home » What we’ve learned about building datasets with FOI / mySociety
News

What we’ve learned about building datasets with FOI / mySociety

By uk-times.com16 December 2025No Comments5 Mins Read
Facebook Twitter LinkedIn Telegram Pinterest Tumblr Reddit WhatsApp Email
Share
Facebook Twitter LinkedIn Pinterest Email

At the beginning of the year, we set ourselves an ambitious goal: to help a group of small organisations working with marginalised communities to run Freedom of Information–based campaigns using WhatDoTheyKnow Pro’s batch-request and project features. We recruited groups working in areas as varied as domestic abuse, arts funding, youth health, SEND provision, parental leave, fuel poverty, and migrant justice. 

As the year draws to a close, we’re reflecting on the project and the lessons we’ve learned from it. It’s been a total privilege working closely with these organisations, because it gave us a front-row view of the real challenges of frontline campaigning and community support. 

What became clear early on was that the hardest part of a batch-request project isn’t actually pressing “send”.  Campaigners know their issues intimately, but FOI requires a specific kind of precision: pinning down exactly what data will answer their question, what format it should be in, and which public bodies actually hold it. Moving from “we want to understand this issue” to “we need these five questions answered from these 150 authorities” is a surprisingly big leap. 

Luckily, WhatDoTheyKnow’s knowledgeable  volunteers were able to help our groups go from vague policy areas to precise questions, and to understand what information was already out there. One of our groups didn’t end up submitting a big batch request, as in the course of their preparatory research they found an already-published dataset from an industry body they didn’t know existed. This is still a win — proactive publication by authorities makes everyone’s life easier.

In the cases where we had good questions and had identified the right authorities, we then still had to tackle the practical reality: for small teams already stretched thin, a large FOI project which asks a lot of questions requires capacity to deal with the answers. These can come in a diversity of forms: follow-ups, clarifications, refusals, delays, internal reviews. Our Projects tool helps to make dealing with the range of responses easier, but the scale of the challenge can still require serious commitment of time and resources. Zarino shared his experience of this on our blog back in October.

Just this week we had a moment that illustrates this: one of the groups we were supporting sent a batch FOI request to 133 universities on 5 July. As I write this in December, they are still receiving responses. The most recent one, a refusal, arrived five months after the original request! 

We’ve got two strands of thought here. On one hand, it’s good to be realistic. Although these moments are frustrating, they also teach us to be prepared for slow, unpredictable timelines, and that persistence is part of the craft. On the other hand, we feel strongly that citizens shouldn’t have to be quite so persistent, that pace shouldn’t be quite so slow, nor unpredictable. That’s why we’re advocating for upstream policy improvements, such as in our recent evidence to the Scottish Parliament, and in our upcoming FOI Fest conference.

Although it’s not always been straightforward, this year reinforced why FOI is worth the effort. A particularly strong example came from SCALP and Netpol’s From Scotland to Gaza report, which, with our help, used batch FOI requests to uncover policing practices around protests. Their methodical approach combined data from public bodies with testimonies to make a compelling case that has shaped media coverage and public debate. It’s a reminder that FOI doesn’t just extract information, it empowers communities to speak with confidence.

All of this left us with a clearer sense of what we can do in future to help make big FOI projects work. A few lessons stood out:

  • Start smaller: a 10-authority pilot builds confidence and tests the strength of the question.
  • Co-design the requests: working together on wording and structure reduces uncertainty: the organisations have expertise of their area, while our volunteers have second-to-none understanding of how to write a clear request.
  • Prepare organisations for the long tail: follow-ups, delays, and refusals are, unfortunately, to be expected, not signs of failure of the project. 
  • Volunteers can help with the volume of work: Climate Emergency UK have set the standard for how to train, empower and mobilise the cohorts they need to churn through large quantities of data.
  • See FOI as a strategic, not administrative tool: it’s most useful when tied directly to campaign goals.

We fundamentally believe that every organisation can benefit from FOI; they just need the right scaffolding and resources. If you know what you’re in for, the whole process becomes far less intimidating.

What next? We’re refining our approach, watching what happens with our initial batch of projects, and constantly updating our guides and help pages to support our users in their big and small FOI projects. Every request is a small act of collective muscle-building. We’re excited to keep learning and keep improving the support that makes those acts possible.

Photo by Danist Soh on Unsplash

Share. Facebook Twitter Pinterest LinkedIn Tumblr Telegram Email

Related News

A1(M) southbound between J43 and J42 | Southbound | Vehicle Recovery

16 March 2026
Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times

Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times

16 March 2026

A47 westbound between B1040 and B1167 near Thorney (west) | Westbound | Road Works

16 March 2026
Meningitis Kent outbreak latest: Students queue for antibiotics after two die and 13 cases reported – UK Times

Meningitis Kent outbreak latest: Students queue for antibiotics after two die and 13 cases reported – UK Times

16 March 2026

M606 J3 northbound exit | Northbound | Accident

16 March 2026
Wolff confident Russell and Antonelli rivalry will not repeat toxic Hamilton-Rosberg feud – UK Times

Wolff confident Russell and Antonelli rivalry will not repeat toxic Hamilton-Rosberg feud – UK Times

16 March 2026
Top News

A1(M) southbound between J43 and J42 | Southbound | Vehicle Recovery

16 March 2026
Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times

Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times

16 March 2026
Employer opportunity at Fermanagh Cross Border Job Fair

Employer opportunity at Fermanagh Cross Border Job Fair

16 March 2026

Subscribe to Updates

Get the latest UK news and updates directly to your inbox.

Recent Posts

  • A1(M) southbound between J43 and J42 | Southbound | Vehicle Recovery
  • Dan Ballard included in Northern Ireland squad despite injury scare for pivotal World Cup play-offs – UK Times
  • Employer opportunity at Fermanagh Cross Border Job Fair
  • A47 westbound between B1040 and B1167 near Thorney (west) | Westbound | Road Works
  • Pep Guardiola makes surprising decision ahead of Champions League second leg against Real Madrid as Man City look to pull off unlikely comeback

Recent Comments

No comments to show.
© 2026 UK Times. All Rights Reserved.
  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact Us

Type above and press Enter to search. Press Esc to cancel.

Go to mobile version