Unfortunately, it is not currently possible to set a default signature for a shared mailbox in Outlook on Windows. This feature is not planned for the future as of the time of writing. However, you can manually add a signature to emails sent from a shared mailbox by using the Send email message through Outlook action and populating the signature in the Body field.
References: