LocalLLaMA

2800 readers

17 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

[email protected]

Sentence transformers v4 (lemm.ee)

submitted 6 days ago by [email protected] to c/[email protected]

3 comments fedilink hide all child comments

Link to bluesky https://bsky.app/profile/tomaarsen.com/post/3llc2jvwah22f

Some more details https://huggingface.co/blog/train-reranker

top 3 comments

sorted by: hot top controversial new old

[–] [email protected] 12 points 6 days ago (1 children)

For those (like me 10 minutes ago) who wonder what are reranker models...

Reranker models are models which can evaluate the semantic similarity of two pieces of text. They can be used to improve RAG systems which use embeddings to look for relevant documents. The reranker model can then be used to select the best candidates.

This improves the result, because reranker models look at the two pieces of content simultaneously and can be fine tuned to the domain in question. They shouldn't be used for the initial retrieval because the evaluation time is O(n²) as each combination of input and document pair needs to be evaluated as a pair.

[–] [email protected] 5 points 6 days ago (1 children)

I want to clarify something. Reranker is a general term that can refer to any model used for reranking. It is independent of implementation.

What you refer to

because reranker models look at the two pieces of content simultaneously and can be fine tuned to the domain in question. They shouldn't be used for the initial retrieval because the evaluation time is O(n²) as each combination of input

Is a specific implementation known as CrossEncoder that is common for reranking models but not retrieval ones for the reasons you described. But you can also use any other architecture

[–] [email protected] 2 points 5 days ago

Thanks, I think this is a good clarification, I had not encountered rerankers outside this specific implementation.