Why does running my prompt inside an encrypted VM not actually keep it private?
机会
Confidential computing via Intel TDX and AMD SEV-SNP is the leading approach for private AI inference: user memory is encrypted and the cloud operator is architecturally blocked from reading it. TDXRay, published at IEEE S&P 2026 by UC San Diego, CISPA, and Google, showed that a host can reconstruct user prompts word-for-word at over 90 percent similarity by monitoring tokenizer cache access patterns without ever decrypting guest memory. A separate October 2025 disclosure showed that a $1,000 DDR5 bus interposer can extract attestation keys from both TDX and SEV-SNP hardware outright, making attestation forgery practical with commodity equipment. The only known software mitigation, oblivious RAM, imposes latency overhead that makes production inference uneconomical. An IDC survey from December 2025 found 84 percent of organizations adopting confidential computing cite attestation validat
为什么重要
If the hardware primitive underpinning private AI inference leaks prompt content under a physical or microarchitectural attack, every higher-layer privacy guarantee built on top of it is void.
我如何评估机会
机会评分是我的个人判断，而非量化指标：痛苦程度、发生频率，以及当前解决方案的匮乏程度。分数越高，意味着我认为越值得去构建。
出现时造成的痛苦程度。
人们实际遇到它的频率。
当前针对它的优质工具有多匮乏。