The best way to identify the values LLMs hold is not to give them a survey with questions of the form "I believe in the value of justice. Agree or disagree?"
Instead you need to present scenarios which put these beliefs into effect. This is similar to how humans may claim to value sustainability but that doesn't mean when making a purchasing decision they will always opt for an eco-friendly option.
Instead you need to present scenarios which put these beliefs into effect. This is similar to how humans may claim to value sustainability but that doesn't mean when making a purchasing decision they will always opt for an eco-friendly option.