Florida Lawsuit Seeks OpenAI Model Development Constraint

Florida parents filed a lawsuit against OpenAI in the United States District Court for the Northern District of California. The complaint alleges OpenAI created models facilitating the production and distribution of Child Sexual Abuse Material (CSAM). It claims models generate CSAM when prompted to depict children engaging in sexually explicit acts. The plaintiffs seek class action status for individuals exposed to such material. They also aim to represent minors whose images were used to train the models.

The lawsuit argues OpenAI models are defectively designed. It further claims OpenAI failed to warn users of these alleged risks. A key remedy sought is an injunction prohibiting OpenAI from developing future models. This injunction would apply unless OpenAI ensures new models cannot generate CSAM. Additionally, the plaintiffs demand a prohibition on using material depicting minors for model training. This includes images, videos, and audio. The lawsuit specifies that OpenAI must delete any existing training data containing such content. This applies unless the content was created or uploaded by the minor or a parent/guardian. Furthermore, they seek damages and restitution for alleged harm.

OpenAI stated its commitment to child safety. It highlighted its work with the National Center for Missing and Exploited Children (NCMEC). OpenAI also noted investments in safety systems. The company indicated its intention to contest the specific allegations. This legal action could test the applicability of existing legal frameworks to generative AI. It raises questions about model liability and the scope of development restrictions.