James Mickens discusses linguistic illegibility's impact on LLM security mechanisms
Why it matters — The concept of linguistic illegibility raises concerns about the reliability of security mechanisms in large language models (LLMs). If security relies on a model's linguistic outputs, it may not be sound due to the potential disconnect between a model's internal computations and its externalized language. This suggests a need for alternative security measures that do not depend solely on linguistic monitoring.