Remove Duplicate Lines
- Lines in
- 0
- Lines out
- 0
- Duplicates removed
- 0
Everything runs in your browser. Your data never leaves your device.
What this tool does
Paste a list and the tool removes every repeated line, keeping the first copy of each and the original order. It is handy for cleaning email lists, keyword lists, product codes, log files, lists of names or anything else with one item per line. It works equally well for English and Arabic text.
How to use it
- Paste your list into the first box, one item per line.
- Choose the options you need.
- Copy the cleaned list from the result box. The counters show how many lines you started with, how many remain and how many duplicates were removed.
Options explained
- Case sensitive (on by default): “Apple” and “apple” are different lines. Turn it off to treat them as duplicates; the first spelling is kept.
- Trim spaces around each line: ignores spaces at the start and end of lines, and also removes them from the result.
- Remove empty lines: deletes blank lines. Without this option the first blank line is kept and extra blank lines count as duplicates.
Example: the list “red, blue, red, green, blue” (one item per line) becomes “red, blue, green”, and the counters show 5 lines in, 3 lines out and 2 duplicates removed.
Tips
If you also want the cleaned list in alphabetical order, run it through the sort lines tool afterwards. Matching is exact apart from the options above, so names that differ in spelling or Arabic diacritics are treated as different lines. Your data is processed locally and is never uploaded.
Frequently asked questions
Which copy of a duplicate line is kept?
The first occurrence is kept and later copies are removed, so your list stays in its original order.
Are "Apple" and "apple" duplicates?
Not by default, because the tool is case sensitive. Untick "Case sensitive" to treat them as the same line.
Why are lines with extra spaces not removed?
A line with a trailing space is technically different text. Tick "Trim spaces around each line" to ignore leading and trailing spaces when comparing.
Is there a limit on how many lines I can paste?
There is no fixed limit. Lists of tens of thousands of lines work fine on a modern phone or computer, since everything is processed in your browser.