Meta's Llama model has memorized Harry Potter and Aunty Boy (2025) Hindi Short Filmthe Sorcerer's Stoneso well that it can reproduce verbatim excerpts from 42 percent of the book, according to a new study.
Researchers from Stanford, Cornell, and West Virginia University analyzed dozens of books from the now-infamous Books3 dataset, a collection of pirated books used to train Meta's Llama models. Books3 is also at the center of a copyright infringement lawsuit against Meta,Kadrey v. Meta Platforms, Inc.The study's authors say their findings could have major implications for AI companies facing similar lawsuits.
According to the research paper, the Llama 3.1 model "memorizes some books, like Harry Potterand 1984, almost entirely." Specifically, the study found that Llama 3.1 has memorized 42 percent of the first Harry Potter book so well that it can reproduce verbatim excerpts at least 50 percent of the time. Overall, Llama 3.1 could reproduce excerpts from 91 percent of the book, though not as consistently.
"The extent of verbatim memorization of books from the Books3 dataset is more significant than previously described," said the paper. But the researchers also discovered that "memorization varies widely from model to model and from book to book within each model, as well as varying in different parts of individual books." For example, the study estimated that Llama 3.1 only memorized 0.13 percent of Sandman Slimby Richard Kadrey, one of the lead plaintiffs in the class action copyright suit against Meta.
So, while some of the paper's findings seem damning, don't call it a smoking gun for plaintiffs in AI copyright infringement cases.
"These results give everyone in the AI copyright debate something to latch on to," wrote journalist Timothy B. Lee in his Understanding AI newsletter. "Divergent results like these could cast doubt on whether it makes sense to lump J.K. Rowling, Richard Kadrey, and thousands of other authors together in a single mass lawsuit. And that could work in Meta’s favor, since most authors lack the resources to file individual lawsuits."
Why is Llama able to reproduce some books more than others? "I suspect that the difference is because Harry Potter is a much more famous book. It's widely quoted and I'm sure that substantial excerpts from it on third-party websites found their way into the training data on the web," said James Grimmelmann, a professor of digital and information law at Cornell University, who was cited in the paper.
What this also shows, Grimmelmann said, is that "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."
Meta and other AI companies have argued that using copyrighted works to train their models is protected under fair use, a complex legal doctrine. However, the extent of memorization could complicate those arguments.
“Yes, I do think that the likelihood that LLMs are memorizing more than previously thought changes the copyright analysis,” Robert Brauneis, a professor with the George Washington University Law School, said in an email to Mashable. He concluded that the study’s findings could ultimately weaken Meta’s fair use argument.
We asked Meta for comment on the study's findings, and we'll update this article if we receive a response.
Disclosure: Ziff Davis, Mashable’s parent company, in April filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.
Topics Artificial Intelligence Meta
How to Easily Make iPhone Ringtones Using Only iTunes
Michael B. Jordan surprising a group of kids at school is as pure as it gets
Wordle today: Here's the answer, hints for April 27
'7 Days' review: Karan Soni and Geraldine Viswanathan in quarantine love
Best robot vacuum deal: Get the Shark Matrix Plus 2
Most watched movies on your favorite streaming services this week. Batman's in 2.
André 3000 had the loveliest moment with a fan wearing a T
'Wordle' today: Here's the answer, hints for May 3
Bargaining For the Common Good
'Johny Johny Yes Papa' is just one of many terrifying YouTube videos made for kids
NYT Connections Sports Edition hints and answers for April 23: Tips to solve Connections #212
Elon Musk's Twitter could make liberal activists miserable. Here's why.
Yes, people are losing followers on Twitter, but it's 'organic'
Apple's Self Service Repair program is now available in the U.S.
Skywatching is lit in May, says NASA
Taco Bell menu items, ranked
Apple's Self Service Repair program is now available in the U.S.
Celebrities defend 'Cosby Show' star Geoffrey Owens, shamed for day job
Character AI reveals AvatarFX, a new AI video generator
How to unlink Facebook and Instagram
Staff Picks: Heaven, Hearing Trumpets, and Hong SangCharm and How to Come By It by Dubravka UgresicPresenting the Finalists for the 2021 PEN America Literary Awards by The Paris ReviewNYT's The Mini crossword answers for January 11The Year of Grinding Teeth by Madeleine WattsRedux: Idlers of My Kind by The Paris ReviewRedux: Her Ticking Wrist by The Paris ReviewWhy Do We Keep Reading ‘The Great Gatsby’?We Didn’t Have a Chance to Say Goodbye by Sabrina Orah MarkStaff Picks: Heaven, Hearing Trumpets, and Hong SangBest Black Friday mattress deal: Save up to 50% on NectarIn the Green Rooms by Tove DitlevsenInside the Order Is Always Something Wild by Elizabeth AlexanderThe Art of an Even KeelStaff Picks: Bathing Suits, Bright Winters, and Broken Hearts by The Paris ReviewCooking with Andrea Camilleri by Valerie StiversSlack's new 'Catch Up' feature knows you're overwhelmed and overworkedBeatlemania in Yugoslavia by Slavenka DrakulićPresenting the Finalists for the 2021 PEN America Literary Awards by The Paris ReviewLetter from the Editor by The Paris Review Whiting Awards 2016: Catherine Lacey, Fiction Malthusian Flotsam and Unspeakable Jetsam, and Other News by Dan Piepenbring Whither the Fog Machine? and Other News by Dan Piepenbring How to Survive Perfume Shopping on the Upper East Side Whiting Awards 2016: Safiya Sinclair, Poetry “The Throwback Special” Is “2016’s First Great Book” But Is It Reading? On James Patterson’s BookShots “A Major Poet of Quiet”: Ben Lerner on Keith Waldrop When Life Feels Like a Heavy On the Road: The Loneliness of the Long Little Match Girl: Taking Abuse on the Internet The Depressive’s Guide to Getting Out of Bed Samantha Hahn’s Beautiful Illustrations for Rachel Cusk’s “Outline” Who Wrote ”Lolita” First? “Polite New Yorker”: The Gray’s Papaya Button Writers Are Always Spies and Voyeurs, Too The Affections of the Cheese Guy Louder than Bombs: An Interview with Joachim Trier and Jesse Eisenberg This Is Your Last Chance to Be Hugged By a Cartoon Character Who Was Judith Leyster? The Overlooked Women Artists of the Golden Age
1.4575s , 8225.828125 kb
Copyright © 2025 Powered by 【Aunty Boy (2025) Hindi Short Film】,Pursuit Information Network