The issue with hCaptcha’s strange AI generated prompts highlights two issues with machine learning systems. The first is that the AI systems require an enormous amount of human input to not be terrible. Typically image labeling is outsourced to foreign workers who do it for pennies on the dollar. The other is the issue of data drift. The longer these machine learning systems run, the more input they require. Inevitably, they begin to use data they’ve generated to train themselves. Systems that train on themselves long enough become AI Hapsburgs, churning out requests to identify incomprehensible objects like “Yokos.”