Published On Apr 8, 2024
How it is possible to steal part of LLMs protected behind an API? 🥷 We explain both papers that made a breakthrough on this, one from Carlini et al. (Google), and the other one from Finlayson et al. (USC), see references below.
SPONSOR: AssemblyAI 👉 https://www.assemblyai.com/research/u...
AI Coffee Break Merch! 🛍️ https://aicoffeebreak.creator-spring....
📄 Carlini, Nicholas, Daniel Paleka, Krishnamurthy Dj Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee et al. "Stealing Part of a Production Language Model." https://arxiv.org/abs/2403.06634
📄 Finlayson, Matthew, Swabha Swayamdipta, and Xiang Ren. "Logits of API-Protected LLMs Leak Proprietary Information." https://arxiv.org/abs/2403.09539
Thanks to our Patrons who support us in Tier 2, 3, 4: 🙏
Dres. Trost GbR, Siltax, Vignesh Valliappan, Michael, Sunny Dhiana, Andy Ma
Outline:
00:00 Stealing LLMs from behind API’s!?
01:54 AssemblyAI (Sponsor)
02:59 Two papers, same thing
04:03 Core observation
07:05 Recover Hidden Dimensionality
08:54 gpt-3.5-turbo
10:30 Full Layer Extraction
10:58 Extract all logits
14:35 Defenses
15:40 Cost of attack
16:22 Further impact
17:40 API response stochasticity
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to help with our Coffee Bean production! ☕
Patreon: / aicoffeebreak
Ko-fi: https://ko-fi.com/aicoffeebreak
Join this channel to get access to perks:
/ @aicoffeebreak
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔗 Links:
AICoffeeBreakQuiz: / aicoffeebreak
Twitter: / aicoffeebreak
Reddit: / aicoffeebreak
YouTube: / aicoffeebreak
#AICoffeeBreak #MsCoffeeBean #MachineLearning #AI #research
Video editing: Nils Trost