Tools

Line deduplicator and sorter

Remove duplicate lines and sort, with natural numeric ordering.

Runs in your browserText74
Free

Input

0 BFree up to 100.0 KB

Result

The result will appear here.

Your runs

Only runs that cost points are saved.

Sign in to keep a history of your runs.

Takes a pasted list — log lines, IDs, hostnames, a column from a spreadsheet — and removes duplicates, sorts it, or does both. Sorting is natural: v2 comes before v10, which alphabetical ordering gets backwards and which matters for every list of versions, hostnames or numbered files.

How it works

  • Deduplication keeps the first occurrence, so the original order survives when you are not sorting.
  • Sorting uses a numeric-aware collator, so embedded numbers order by value.
  • Whitespace trimming and case sensitivity are both yours to control.

Where your data goes

Nowhere. This tool runs entirely in your browser: the text you paste is processed by the page and is never transmitted to a server or written to a log.

When a run costs points, a one-line summary is saved to your own history so you can find it again. The summary records the shape of the run — sizes, counts, the values you looked up — never the content you pasted.

What it costs

Free up to 100.0 KB per run without an account. Past that, a run costs 1 points and is saved to your history.

Points come from signing up, checking in daily, commenting and completing your profile.

See how points work

Common questions

Why are two lines that look identical not deduplicated?
Usually invisible difference: trailing whitespace, a CRLF line ending, or a non-breaking space pasted from a web page. Turn on trimming, which handles the first two.
What does natural sorting change?
It compares embedded numbers by value rather than character by character. Alphabetically, item10 sorts before item2; naturally, it sorts after.
Is there a size limit?
Large lists work — everything runs in the page — but a browser tab will slow noticeably past a few hundred thousand lines. At that size, sort and uniq on the command line are the right tools.

The open-source behind it

This tool is a self-contained implementation. sindresorhus/uniq (MIT) does the same job as a library — if you need this behaviour inside your own program, start there rather than calling a web page.

sindresorhus/uniq

Also known as

  • remove duplicate lines
  • sort lines online
  • text deduplicate
  • line sorter
  • unique lines