LLMs can't reason: They're a statistical model that can only copy.

In many cases though, the copy that the LLM generates is either "good enough" or a great thing to start with.