mahjongmen1998·vor 3 Jahren·discusshandling queries and documents differently leads to an increase in overall retrieval.
mahjongmen1998·vor 3 Jahren·discusse5-mistral is essentially a distillation from gpt-4 to a smaller model. You can see here https://github.com/microsoft/unilm/blob/16da2f193b9c1dab0a69...they actually have custom prompts for each dataset being tested.Question would be, if you haven't seen the task before, what is a good prompt to prepend for your task?IMO e5-mistral is overfit to MTEB