[BUG] Images not displaying with GradioUI even when passed as the final answer

[jsmidt]

The code in gradio_ui.py code suggests that if a png filename is passed as the final answer it will display the image.

elif isinstance(final_answer, AgentImage):
    yield gr.ChatMessage(
        role="assistant",
        content={"path": final_answer.to_string(), "mime_type": "image/png"},
    )

I passed this prompt: "Plot sin(x) from 0 to 1. Then save the plot as my_plot.png. Then give my_plot.png for the final answer so that the image displays." I used a code agent with GradioUI code:

from smolagents import CodeAgent, GradioUI, HfApiModel, LiteLLMModel

AUTHORIZED_IMPORTS = [
    "numpy",
    "matplotlib",
    "seaborn",
]

agent = CodeAgent(tools=[], model=HfApiModel(), max_steps=20, verbosity_level=2,additional_authorized_imports=AUTHORIZED_IMPORTS)

GradioUI(agent).launch()

See the screenshot below. The agent submitted my_plot.png as the final answer. But as the screenshot shows it did not display the png. Thanks.

[keetrap]

@jsmidt
Try using:
AUTHORIZED_IMPORTS = [
"numpy",
"matplotlib",
"PIL",
"io"
]
"Plot a sine wave from 0 to 2pi and return it as Image"

[jsmidt]

That worked! Looks like it was just a matter of having those extra authorized imports. Thank you for this. Looks like not a bug, unless displaying plots is expected to be supported by default, in which case perhaps these imports should be authorized by default.