The XML file contains encoded key and salt data. It also includes other metadata like KDF iterations, etc. Narrowing down the problem domain for the attacker leads to faster password cracking. While that is true using a strong password should render this attack useless.