Remove repeated lines from a list, or keep only the unique ones, only the duplicates, the first or the last.
Every line appears once, in the position where it first showed up.
0 lines in
One item per line. An email list, a set of URLs, a column pasted out of a spreadsheet, a log file: anything where each line is one record.
First of each is the usual answer. Only duplicates is the one people forget about, and it is how you find out what actually got repeated instead of just cleaning it away.
The kept and removed numbers under the result tell you how many duplicates there were, which is often the answer you were really looking for.
No. Lines come back in the order you gave them. If you also want them sorted, run the result through our line sorter afterwards.
First of each keeps one copy of every line, including the repeated ones. Only unique keeps just the lines that appeared exactly once and drops repeats entirely. If a line appeared three times, the first mode keeps one copy and the second keeps none.
Usually a trailing space or a different case. Turn on the trim option and turn off case sensitivity and they will match. Invisible characters like a non breaking space pasted from a web page are the other common cause.
Yes. Comparison uses Turkish casing rules, so İ lowercases to i and I lowercases to ı, which is what a Turkish list expects and what a naive comparison gets wrong.
It compares whole lines, so it works if the entire row is the duplicate. To deduplicate by a single column, convert to JSON with our CSV to JSON tool and work from there.
Only what your browser's memory allows, and that is generous. Lists of tens of thousands of lines process instantly because it is all local work with no upload.
No. Everything runs in this tab. Nothing is sent to a server, which matters when the list is customer emails or internal identifiers.
Choose only duplicates. You get one copy of every line that appeared more than once, which is the report rather than the cleanup.
Sort lines alphabetically, by length, by number, in reverse or at random, with proper Turkish letter order.
Open ToolReplace text across a whole document at once, with whole word, case sensitive and regular expression options.
Open ToolCompare two texts or code snippets line by line and see exactly what was added, removed and left alone.
Open Tool