For a chatbot

A new prompt goes in. The trained model generates an answer.

Why care?

Answering still uses computing resources after training is finished.