Image Test Suite

A freely shareable collection of images for image compression research and benchmarking.

We're building a large, modern collection of images for compression research. We need:

Contribute your images to the test suite

The problem

Image compression research requires a large number of uncompressed (lossless) images for testing and benchmarking. Unfortunately, for most researches the options are to either use a few "traditional" images (such as Lena or the Kodak set) or scrape the Web. Both options are problematic, because either the set is too small and unrepresentative, or the images already have compression artefacts and due to copyright restrictions can't be shared with others to let them verify the results.

The plan

  1. We're collecting a large number of freely licensed, raw quality images. We look for:

    • photos from high-end digital cameras (done),
    • post-processed/edited photos (especially with transparency),
    • icons, logos, buttons,
    • screenshots from various OSes,
    • CGI images and screenshots from games,
    • assets from games and interactive infographics,
    • photos from cellphone cameras,
    • photos taken in low light (noisy),
    • images taking advantage of better-than-sRGB color spaces. (done)
  2. We'll collect statistics about “typical” images on the Web — sizes, types, amount of noise, contrast, edges, etc.

  3. We'll select (or edit) images to be statistically similar to the set of the images found on the Web.

  4. We'll publish the whole set, with image tags/categories.

You can browse images we've collected so far and see the tools we're developing.

Example use-cases

In the long term we hope the test suite could:

Obraining images

If you only want to check out what images are available without downloading the full set, then use the sample archives below. These archives contain temporary, random subsets of images.

You can avoid storing large archive files by streaming the decompression like this:

curl -s https://yardstick.pictures/yardstick-images-2.tar.gz | tar xvz

The complete set

The complete collection contains over 34000 images totalling 120GB, so we don't provide a single archive. Instead, we provide a list of all images and their metadata and make them available for download from their individual URLs. The image URLs are in format:


where xs are lowercase hex digits of SHA-1 of the image file, and ext is image filename extension — both pieces of information are present in images' .json files in the metadata repository.

Get involved

Contribute your images.

Help development of the site and tools.

Contact: Kornel Lesiński, Yoav Weiss, Ann Robson, Guy Podjarny.