I had no idea how to remove an Accessory until I started clicking randomly
Maybe add an X on hover or replace the check on hover with an X