Some of the biggest names in banking have started using large language models to organize their institutional knowledge, but use cases like chatbots remain experimental.