low severityCohere Rerank API, LangChain CohereRerank
Rerank scores appear inconsistent, e.g., do not sum to 1 across documents or vary unexpectedly across queries, leading to unreliable thresholding or ranking fusion.
Root cause
Likely misunderstanding: Cohere Rerank outputs independent relevance scores normalized to [0,1] per document-query pair, but query-dependent and not summing to 1 across documents, leading to perceived inconsistency when assuming probabilistic softmax normalization.
coherereranknormalizationscoresrelevance_score