Asymmetric Quantization: Near-Lossless Retrieval with 97% Storage Reduction

4 comments

• Ameo 1 hour ago
  I can't wait until we get to 100% storage/cost/compute reduction for LLMs. Every thought you could have thought pre-conceived in high-fidelity super-resolution. Every action you could have taken predicted and simulated in advance courtesy of Openthropic and the USA Sovereign Wealth Fund.
  [-]
  • peheje 1 minute ago
    Reminds me of 'Learning to be me' by Greg Egan
  • throwaw12 1 minute ago
    100% reduction is impossible for something which should work, because -100% means it is now 0
• johnathan101 1 hour ago
  97% is impressive, but I'm curious what the latency tradeoff looks like in production. Storage is only half the story for retrieval systems.
  [-]
• mv_d5339e31 50 minutes ago
  [dead]
• TradingReality 1 day ago
  [flagged]