LLM weight theft: detecting a compromised inference server that hides bits in token selection
A compromised server can exfiltrate a model’s weights by encoding them within plausible responses. A statistical method accumulates clues across requests whilst minimising the risk of false positives.