I am really impressed and delighted how simple this library is.

I agree that waiting for response can be an issue. I don't think this is meant to be for such purposes, but for tools that would process and create artifacts based on inputs.

I love Mistral and local LLMs, so this would probably the thing I would like to add.