Any thoughts on the best way to generate a list of all IATI file URLs? Next, how about on a regular basis?

For a project, I manually generated a regional list by copying them from for example but this took some time and steps.

Comments (5)

Dale Potter
Dale Potter

Brent Phillips - the IATI-Registry-Refresher can do this for you, although again it’s more of a developer tool.

Running the grab_urls.php script will find the data URLs for each publisher, and create one file per publisher in a urls folder. Each file will contain the dataset names and the dataset URL for every dataset published by that organisation.

The above code is considered legacy, and will at some point time be replaced by functionality in iati.fetch part of the IATI Python Library - an experimental start on this has type of thing been made here, although it won’t be able to download dataset URLs at this point.

Please log in or sign up to comment.