Research
Datasets & code.
What the lab has released so far, and a working library of the datasets our members actually use — organised by area, with links to the source.
01 — From the lab
One release so far.
We are not going to overstate this. CAAI has not released large-scale datasets — we are a small lab and most of our output to date has been papers rather than corpora. One dataset is public, and more will follow from the projects currently running.
Synthetic Image Dataset of Five Object Classes Generated Using Stable Diffusion XL
A synthetic image corpus across five object classes, generated with Stable Diffusion XL and released openly for use in classification, augmentation and synthetic-data experiments.
In preparation
- Aligned image–music pairs. Being assembled for the image-to-music project, together with the listening-study protocol used to evaluate it.
- Script-to-panel annotations. Narrative beats and panel layouts from the text-to-comic project, including character-consistency labels.
Neither is public yet. When they are, they will be released with a DOI, a licence and a datasheet describing how they were built and where they should not be used.
02 — Dataset library
The standard corpora, by area.
These are the datasets a new member is most likely to be pointed at in their first month. Licences vary — several require registration or an agreement before download, and a few are restricted to credentialed researchers. Check the terms on each source before you use one in a paper.
Computer Vision
Classification · Detection · SegmentationVision–Language & Multimodal
Our primary areaAudio & Music
Image-to-music · T2A · V2ANatural Language
Benchmarks · Corpora · PretrainingComics & Visual Narrative
Text-to-comic projectFairness & Bias Evaluation
Ethics areaBiomedical & Clinical
AI for social good03 — Where to look
Finding a dataset nobody handed you.
Most research questions do not have a purpose-built corpus waiting for them. These are the indexes worth searching before you conclude one does not exist — and before you spend a term building your own.
Hubs & search
Start here04 — Working stack
What members actually run.
TensorFlow
Used where an existing implementation or pretrained checkpoint calls for it.
tensorflow.org ↗Transformers
Pretrained language, vision and multimodal models with a consistent interface.
huggingface.co ↗Diffusers
Diffusion pipelines for image and audio generation — the basis of our synthetic data work.
huggingface.co ↗scikit-learn
Baselines, classical models and evaluation metrics. Always run the baseline first.
scikit-learn.org ↗Weights & Biases
Experiment tracking, so that a result from three weeks ago can still be reproduced.
wandb.ai ↗Google Colab
Free GPU access for members without local hardware. Where most first experiments run.
colab.research ↗05 — Before you download
Three things that get papers rejected.
Check the terms first.
"Publicly available" is not the same as "free to use however you like". Several datasets above permit academic research only, some require a signed agreement, and a few forbid redistribution of derived data entirely. Read the licence before the first experiment, not before submission.
Cite the dataset paper.
Every dataset here has an accompanying publication, and its authors are counting on that citation the same way you will count on yours. Cite the corpus, the version and the split you used — vague provenance is a reviewer's first complaint.
Know who is in your data.
Web-scraped corpora contain people who never agreed to be there, and their skew becomes your model's behaviour. Report what your data covers and what it misses. This is not a formality here — it is one of our four research areas.
Publish yours properly.
If a project produces a dataset, it gets a DOI, an explicit licence and a datasheet covering collection method, intended use and known limitations. That is the standard the lab holds its own releases to.
Missing something?
Tell us what should be on this list.
If you work with a corpus in your field that belongs here — especially outside vision and English-language NLP — send it to us and we will add it. The list is meant to be useful, not complete.