Model or dataset
metarank/metarank avatar
metarank/metarank

Metarank: A Learn-to-Rank Reranking Service You Run Alongside Your Search Engine

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

2,462 stars111 forksScalaApache-2.0

At a glance

What is it?
Metarank is an Apache-2.0 Scala service that reranks search results and recommendation lists using behavioural signals, and it ships a standalone mode that trains a LambdaMART model from an events file in one command. It is aimed at teams that already have a search backend and want personalization without building a feature pipeline from scratch.
Who is it for?
Adopt Metarank if you already run Elasticsearch, OpenSearch or another retrieval layer and you have click or purchase events you are not yet using in ranking. Do not adopt it if you have no event stream and no way to send per-request ranking calls, because the service has nothing to learn from and nothing to rerank.
Can I use it commercially?
Yes. Apache-2.0 is a permissive licence: you can use, modify and sell software built on it, as long as you keep its copyright and licence notices.
Is it still maintained?
Yes. The repository last received commits 46 days ago.
What is it written in?
Mainly Scala, according to GitHub's language statistics.

Answers come from the project's GitHub data, last synced on November 19, 2026, and from our analysis. They are not legal advice.

From daily snapshots

Star history

  • metarank/metarank2,462 ★ · +22
Star history
Repository2026-09-112026-11-19
metarank/metarank2.4k2.5k

22 Stars in the last 69 days, measured from the daily GitHub snapshot. Compare with other projects

Editorial analysis

The Gap Metarank Fills Between a Search Engine and a Ranking Model

A search engine returns documents ordered by a relevance function that was fixed at index time. Your click logs contain a different ordering, one that reflects what visitors actually chose. Closing that gap normally means building a feature pipeline, an offline training loop, and a low-latency scoring endpoint. Metarank packages those three pieces into one service. The README describes it as an open-source ranking service that helps you build personalized semantic or neural search and recommendations, and the feature list names the three workloads it targets: semantic search, recommendations, and Learning-to-Rank on top of an existing search engine. The audience is therefore specific. You are expected to already have retrieval. Metarank reranks what your Elasticsearch or OpenSearch instance returns rather than replacing it. The README states that Metarank can compute dozens of typical ranking signals out of the box, listing CTR, referer, User-Agent and time as examples, so the intended user is a team that wants ranking quality improvements without writing ad-hoc feature code for every signal. If you have no event data at all, the project has nothing to learn from.

Event Ingestion, Feature Extractors and LambdaMART Reranking

The mechanism is a three-stage pipeline. First, visitor signals arrive from a data source. The README points to a data sources page and says there are integrations with many streaming processing systems to ingest visitor signals, though the README itself does not enumerate them. Second, feature extractors turn those raw events into ranking features. The docs list extractors for user session profiles and for text, the latter supporting LLMs in bi-encoder and cross-encoder mode. Third, a model scores candidate items. The main features list names LambdaMART for secondary reranking, matrix factorization with ALS for similar-item recommendations, and a trending recommendations mode. AutoML covers automatic feature generation and model re-training. The state model matters for deployment: Metarank is described as a stateless cloud-native service with state managed by Redis, which is what allows it to scale horizontally and, per the README, process thousands of RPS. The README also claims reranking latency of 10-20ms for large result sets and links to a benchmarks page. Those numbers come from the project's own documentation, not from independent measurement, and the benchmark conditions are not reproduced in the README.

Running Metarank in Standalone Mode: The Three Commands

The README gives a complete worked example using the ranklens dataset that backs the public demo. Step one downloads the events file: curl -O -L https://github.com/metarank/metarank/raw/master/src/test/resources/ranklens/events/events.jsonl.gz. Step two downloads the config: curl -O -L https://raw.githubusercontent.com/metarank/metarank/master/src/test/resources/ranklens/config.yml. The README notes this config uses an in-memory store, so no external dependencies are needed for the demo. Step three starts the service in standalone mode, which the README describes as combining training and running the API into one command: docker run -i -t -p 8080:8080 -v $(pwd):/opt/metarank metarank/metarank:latest standalone --config /opt/metarank/config.yml --data /opt/metarank/events.jsonl.gz. Two flags carry the work: --config points at the YAML describing feature extractors and models, and --data points at the events file. The README says you will see output while Metarank starts and grinds through the data, then the API is available on port 8080. The published configuration reference also covers serving multiple models, which is how the A/B testing feature is configured. Beyond these flags, the README does not document the full config schema, so the config.yml in the repository is the practical reference.

Where Metarank Is the Wrong Tool

Two constraints stand out. The first is the state store. Redis is the documented state backend, and in-memory storage is presented as a demo convenience rather than a production option. If your environment cannot run Redis, or if you cannot accept a network hop to a separate state store inside your ranking path, the deployment shape does not fit, and the 10-20ms figure in the README is a project claim made under conditions the README does not describe. The second constraint is data. A Learn-to-Rank model needs labelled interactions, and the README's own blog list includes a post about solving a search cold-start problem with aggregated CTR, which is an acknowledgement that sparse interaction data is a real obstacle rather than an edge case. If your traffic is low or your events are not captured, Metarank has nothing to train on. There is also a maturity signal in the README itself: the semantic search guide, the collaborative filtering guide, and the semantic neural search feature entry are all marked TODO in the text. The capabilities are listed, but the walkthroughs for them are not present in the README as given. Treat the LambdaMART reranking path as the documented one and the semantic search path as less proven.

Metarank Against a Hosted Search Relevance Service

The obvious comparison is a hosted search relevance product, the kind where you upload judgements or click data and the vendor trains and serves the model for you. The difference is where the model and the state live. With a hosted service you give up control of the training loop and the feature definitions, and you typically pay per query or per seat. With Metarank the LambdaMART model, the feature extractors and the event pipeline are all in your infrastructure, the licence is Apache-2.0, and Redis holds the session state. That means you can inspect why a document was scored the way it was, and you can change a feature extractor without waiting on a vendor roadmap. The cost is operational: you run the service, you run Redis, you own the upgrade path, and you are the one debugging a config that fails to parse. Metarank also assumes you keep your existing retrieval engine, so it is an addition to your stack rather than a replacement for it. A team without the capacity to operate another stateful dependency should weigh that honestly against the hosted option.

Licence, Releases and What an Upgrade Actually Costs

Metarank is Apache-2.0, which permits commercial use, modification and redistribution under the terms of that licence. This is not legal advice; read the licence text and your own counsel's guidance before relying on it. On release cadence, the version history shows 0.7.11 in June 2025, then 0.8.0 in August 2026 and 0.8.1 in September 2026. That is a long quiet stretch followed by two releases in quick succession, and the project is still on a 0.x version, so minor releases can carry breaking changes to the config schema. The upgrade cost is therefore concentrated in config.yml rather than in application code, since your integration surface is the HTTP API and the event schema. Pin the Docker tag rather than tracking metarank/metarank:latest as the README example does, and re-run standalone against a copy of your own events before promoting a new version. The repository also ships the ranklens dataset and config under src/test/resources/ranklens, which gives you a fixed input to diff behaviour between versions.

Who Should Adopt Metarank and What to Check First

The fit is a team with an existing search or recommendations surface, a stream of click or purchase events, and the ability to insert an HTTP call between retrieval and rendering. That team gets the most from the pre-built feature extractors and the standalone training command, because the alternative is writing the same pipeline by hand. The misfit is a team with no event capture, no Redis, or a latency budget too tight to add a network hop. Before adopting, verify your event schema against the supported event types, confirm Redis is acceptable in your ranking path, and check the feature extractor list against the signals you actually want to rank on. The README's own TODO markers on the semantic search and collaborative filtering guides are the clearest signal about which paths are well travelled: LambdaMART reranking is the one with a complete worked example in the README, so start there and treat the neural search path as something to validate against the docs before you commit engineering time to it.

Editorial conclusion

Adopt Metarank if you already run Elasticsearch, OpenSearch or another retrieval layer and you have click or purchase events you are not yet using in ranking. Do not adopt it if you have no event stream and no way to send per-request ranking calls, because the service has nothing to learn from and nothing to rerank. Before committing, verify three things against your own data: that your events can be mapped onto the supported event schema, that Redis is acceptable as the state store for your latency budget, and that the feature extractors listed in the docs actually cover the signals you care about, since anything outside that list means writing custom code the project does not provide.

Frequently asked questions

What is Metarank?

An open-source ranking service, written in Scala, for building personalized search and recommendations on top of an existing engine. It computes ranking signals such as click-through rate, referer, User-Agent and time without custom code, and serves models that rerank result sets. The project is Apache-2.0 licensed and its releases are numbered, with 0.8.1 published on 2026-09-07.

How does Metarank handle A/B testing?

Through multiple model serving, which the feature list links into the configuration overview. Nothing in the text describes an experiment framework, traffic assignment or significance calculation, so the mechanism is serving several configured models and splitting requests between them.

Where does Metarank keep state, and what does the quickstart use instead?

The service is described as stateless with state managed by Redis, which is what allows horizontal scaling. The quickstart configuration instead uses an in-memory store so that no other dependencies are needed, and runs training and the API together through a single standalone command in one container.

What performance does Metarank claim for reranking?

Reranking latency within 10 to 20 milliseconds even for large result sets, and throughput of thousands of requests per second when scaled horizontally. Both figures are attributed to a benchmarks page on the documentation site, and no measurement or configuration for them is part of this repository.

Which ranking models does Metarank serve by name?

Secondary reranking with LambdaMART for personalization, trending and similar-items with matrix factorization using alternating least squares for recommendations, and automatic feature generation with model re-training under AutoML. The demo request in the readme posts to a rank path named after a different tree boosting library than the one the feature list names.

Official sources

  1. License: Apache-2.0
  2. metarank/metarank on GitHub
  3. Project website
  4. README
  5. Releases
Add this badge to your README

If you maintain this project, the badge below links readers to this analysis and shows its maintenance status from the daily GitHub snapshot. Paste the markdown into your README; add ?metric=license or ?metric=stars to the image URL for a different field.

Add this badge to your README

markdown
[![Hysen Labs](https://hysenlabs.com/badge/metarank-metarank.svg)](https://hysenlabs.com/projects/metarank-metarank)

Star history chart for your README

markdown
[![Star history](https://hysenlabs.com/chart/metarank-metarank.svg)](https://hysenlabs.com/projects/metarank-metarank)

Was this useful?