valid reasons for not wanting the whole database e.g. storage constraints

If you’re training AI models, surely you have a couple TB to spare. It’s not like Wikipedia takes up petabytes or anything.