AI has to experience the scenario many times before it can learn what works and what does not.
BTW, it's equally true for humans. You don't become an experienced driver overnight. Additionally, some of your competence as a driver comes initially from the experience of others (e.g. driving lessons or new-driver coaching etc.).
It's hard to accept, but eventually we won't be so different from AI.