24 pieces of operational guidance for teams specifying and buying training data, including the questions worth asking us. Written for the person who signs off the specification, not the one who signs the invoice.
How do I buy AI training data directly rather than through a marketplace?
3 min read
How should I budget for an AI data annotation project?
2 min read
How does consent work for AI training data captured in the field?
How does data residency work for AI training data?
How does the EU AI Act affect AI training data suppliers?
What should I ask an AI training data vendor before signing?
Why does my speech recognition model fail on multilingual speakers?
How do I build a panel of domain experts to evaluate my model?
Should model evaluation be done by domain experts or generalists?
Why do I need multilingual evaluation for my AI model?
How do I commission red teaming for my AI model?
What is agentic task data and how do I commission it?
What are expert reasoning traces in AI training data?
How do I get training data for a low-resource language?
How do I verify the provenance of AI training data?
What is the difference between an owned delivery site and a data marketplace?
How is quality controlled in a large annotation project?
How should I run a pilot with an AI data vendor?
Why does EXIF metadata matter in AI image datasets?
What is a good inter-annotator agreement score?
How do I specify RLHF preference data properly?
How do I write a good annotation rubric?
How is LiDAR and robotics training data annotated?
How do I specify a speech data collection project?
带上问题,而不是数量数字。数量取决于规格说明。