Sentence Similarity
Safetensors
sentence-transformers
PyLate
modernbert
ColBERT
late-interaction
text-embeddings-inference
Instructions to use canho/lateon-ar-ours6k-ckpt30 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use canho/lateon-ar-ours6k-ckpt30 with sentence-transformers:
from pylate import models queries = [ "Which planet is known as the Red Planet?", "What is the largest planet in our solar system?", ] documents = [ ["Mars is the Red Planet.", "Venus is Earth's twin."], ["Jupiter is the largest planet.", "Saturn has rings."], ] model = models.ColBERT(model_name_or_path="canho/lateon-ar-ours6k-ckpt30") queries_emb = model.encode(queries, is_query=True) docs_emb = model.encode(documents, is_query=False) - Notebooks
- Google Colab
- Kaggle
canho/lateon-ar-ours6k-ckpt30
lightonai/LateOn fine-tuned with PyLate losses.Contrastive, checkpoint at step 30 of 126 (epoch 0.71).
- Training data: HF
canho/ours-6ktrain split (5,469 pairs; query + 1 positive + 9 hard negatives, title. abstract). - Recipe: LightOn's LateOn fine-tuning script (
scripts/finetune/english_late_interaction.py), same as the step-1 wave-1 run (canho/lateon-ar-step1-wave1-ckpt*): 8 GPUs, global batch 128 (split_batches, 16 per GPU, in-batch negatives per GPU), 7 of the 9 negatives sampled per step, temperature 0.02, lr 3e-6 (linear, no warmup), 3 epochs, bf16, checkpoint every 10 steps. - Query
[Q]+ query, 64 tokens; document[D]+ text, 300 tokens. No instruction.
from pylate import models
m = models.ColBERT("canho/lateon-ar-ours6k-ckpt30")
q = m.encode(["..."], is_query=True); d = m.encode(["..."], is_query=False)
- Downloads last month
- 9
Model tree for canho/lateon-ar-ours6k-ckpt30
Base model
lightonai/LateOn