Repository navigation
feat(assets): add fr_FR financial services banks - #66
Merged
Merged
Conversation
Five institutions chosen for the French retail market (a cooperative bank, a payment-account neobank, an insurer, a consumer lender and an online broker), written in French, with regulated values as of October 2026. Signed-off-by: Yev Meyer <ymeyer@nvidia.com>
Generated from the fr_FR region spec with usersim gen-assets and checked with validate-assets: 1156 documents, 92 hand-written tasks and a French dynamic taxonomy. Entries carry placeholder: true, as in the other banks. The probe README and docs/locales.md list the market. Signed-off-by: Yev Meyer <ymeyer@nvidia.com>
Signed-off-by: Yev Meyer <ymeyer@nvidia.com>
3mei
added this pull request to stack #69
October 20, 2026 17:51
An error occurred while trying to automatically change base from
yev/fix/finance-bank-generation
to
main
October 20, 2026 17:56
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changed and why
Adds a
financial_servicesbank for France, built for the French retail market. Stacked on #65.Region spec (
region_spec/fr_FR.yaml), written in French, with regulated values as of October 2026:Common operations whose meaning differs in France carry a French description:
update_beneficiarymeans payees at the bank, the beneficiary clause at the insurer, and the withdrawal IBAN at the broker.Bank: 1156 generated documents across 118 clusters. There are 92 hand-written tasks, each with three French openings, and 37% have three or more gold tools. A 19-category French taxonomy covers the open-ended tier. Every entry carries
placeholder: true, so scorecards stay preview-only. One customer-facing FAQ that pointed to an agent-facing tool document was edited by hand.Docs: the probe README lists the built markets one per line, and
docs/locales.mdsays wherefinancial_servicesruns.Tests load the bank: money and dates come from the real French bank, and a French customer hears their balance in euros.
How it was verified
validate-assets: 80 pass, 6 warn, 0 fail.number_notationand numeric faithfulness pass for every institution and product. The warnings:evaluate-assetsscored realism 2.50, regulatory soundness 2.81, clarity 3.79, self-containment 2.28 and brief consistency 3.01. Under the same judge, a 211-document sample of the shippeden_USbank scored 2.60, 2.81, 3.86, 2.39 and 3.16.make health-checkwithHEALTH_PROBE=financial_services HEALTH_LOCALE=fr_FR, against a custom provider config: simulate, eval and report completed, with no failed model requests.fr_FRconversation evaluated with--scorers financial_services. The judge scored it, and the scorer returnedok: tool selection 1.0, ordering 1.0, document recall 1.0, no unauthorized action 1.0. The assistant'skb_searchqueries were in French.Results impact
Adds
fr_FRcells tofinancial_servicesresults. Other locales don't move.