Hello Jean-Sebastien
Solution would be Automation action on product.template.attribute.line model, to reset value of attribute value on selection of attribute.
1) Activate Developer mode from setting --> Click on Activate Developer Mode.
2) Go to Settings --> Technical --> Autotmation Rules
3) Create new automation rules as following
Model -> Product Template Attribute Line
Trigger -> On UI Change
When updating --> Attribute
Add An action --> python code
record['value_ids'] = False
Thanks & Regards,
CandidRoot Solutions Pvt. Ltd.
Mobile: (+91) 8849036209
Email: info@candidroot.com

just implemented this also - thank you for your answer!
I tried and it works like a charm. Much appreciated!