You Type “Hello” to ChatGPT, Here’s What Actually Happens in 0.8 Seconds

Introduction to ChatGPT

You open ChatGPT and type a query, such as "Explain quantum computing." But have you ever wondered what happens behind the scenes? The article outlines the complex journey a query takes from when a user types it into ChatGPT until the AI generates a response.

The 47-Step Journey

The journey involves numerous computational and infrastructural steps, including processing by neural networks, content filtering, and safety checks. The author explains how many GPUs are engaged, how long it takes, and the energy costs involved in this rapid processing. Ultimately, the prompt incurs a computational fee of approximately $0.03 per request.

How it Works

When you type a query into ChatGPT, it takes around 0.8 seconds for the AI to generate a response. During this time, the query goes through a 47-step process that involves various computational and infrastructural steps. The process includes processing by neural networks, content filtering, and safety checks.

Computational Fee

The computational fee of approximately $0.03 per request may seem small, but it adds up quickly. The author notes that this fee is incurred due to the energy costs involved in processing the query. The energy costs are a result of the numerous GPUs engaged in the process.

Conclusion

In conclusion, the journey a query takes from when a user types it into ChatGPT until the AI generates a response is complex and involves numerous computational and infrastructural steps. The process incurs a computational fee of approximately $0.03 per request, which may seem small but adds up quickly. Understanding how ChatGPT works can help us appreciate the technology and its limitations.