Skip to content

Shelly Palmer - Nightshade: Poisoning AI Training Sets

Shelly Palmer has been named LinkedIn’s “Top Voice in Technology,” and writes a popular daily business blog.
shellypalmerwednesday

Greetings from NYC. The AI poisoning tool Nightshade, which protects digital artwork from being used to train generative AI models without permission, racked up more than 250,000 downloads in just five days.

The software operates by tagging images at the pixel level using the open-source machine learning framework Pytorch. These tags are not obvious to human viewers, but they cause AI models to misinterpret the content of the images, which can lead to the generation of incorrect or nonsensical images when these models are prompted to create new content – hence the concept of a "poisoned" image.

The tool was developed as part of the Glaze Project, led by Professor Ben Zhao at the University of Chicago, and is a response to concerns from artists and creators about their work being used by AI without consent or compensation. Nightshade is available for free, which aligns with the project's goal to increase the cost of training on unlicensed data and making licensing images from creators a more attractive option for AI companies.

The project has been funded through university support, traditional foundations, and government grants, and there is no intention of commercializing the project's intellectual property. Artists who are often burdened with subscription fees for creative software have particularly welcomed this approach; free is very "pro artist"!

The enthusiastic response to Nightshade underscores how many human artists feel about having their art used without permission, but this is a complex issue. Ask an artist how they feel about having an art class study their work; in most cases you'll get a different response. That said, Nightshade gives artists a way to protect their work from unpaid AI training until intellectual property regulations catch up… which won't be any time soon.

As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s

[email protected]

ABOUT SHELLY PALMER

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named LinkedIn’s “Top Voice in Technology,” he covers tech and business for Good Day New York, is a regular commentator on CNN and writes a popular daily business blog. He's a bestselling author, and the creator of the popular, free online course, Generative AI for Execs. Follow @shellypalmer or visit shellypalmer.com

push icon
Be the first to read breaking stories. Enable push notifications on your device. Disable anytime.
No thanks