low severityCohere Rerank API, LangChain CohereRerank

Rerank scores appear inconsistent, e.g., do not sum to 1 across documents or vary unexpectedly across queries, leading to unreliable thresholding or ranking fusion.

Root cause

Likely misunderstanding: Cohere Rerank outputs independent relevance scores normalized to [0,1] per document-query pair, but query-dependent and not summing to 1 across documents, leading to perceived inconsistency when assuming probabilistic softmax normalization.

coherereranknormalizationscoresrelevance_score

Citations