Sunday, August 11, 2024

Datacenters powered by solar farms

 What do you think about this business idea?
  • Find cheap unused land with high sun exposure (e.g. desert areas)
  • Build there solar farms and datacenters (for AI/LLM inference; using either ASICs for high energy efficiency or GPUs)
  • Use solar to power these datacenters (essentially free energy)
  • Charge per token, or potentially future auction bidding (pay more for higher intelligence access)
  • Latency of distant locations may not be an issue... intelligence processing usually takes time anyway + Starlink can handle it
  • My opinion: demand for intelligence (AI/LLM inference, compute) will grow in coming years, as will energy demand. Possibly more demand than supply.
  • Some actors will pay a premium for intelligence as their use case/business justifies it.
  • Cutting-edge LLMs (e.g. GPT-10..) might stay closed, available only via developers. These models will be sought after as they'll outperform others - for some use cases, it's worth the price (privacy loss, dependency, etc.)

2 comments:

  1. I love this idea - do you want to do it? Also, we could use open source LLMs like Llama or DeepSeek

    ReplyDelete
    Replies
    1. Thanks! I would use DeepSeek at this moment, but in general I would be agnostic, and always use what's best (things will be changing rapidly...)

      Delete