Remove duplicate lines
Clean up class lists, vocabulary lists, references and keywords by deleting lines that appear more than once.
Duplicate remover
Put one item on each line.
How to remove duplicate lines
- Paste your list into Your lines, one item per line. Text copied from a spreadsheet column works well.
- Choose your options. The defaults ignore stray spaces and leave blank lines alone.
- Choose Remove duplicates. The cleaned list appears under Result, and a message tells you how many lines were removed.
- Choose Copy result to paste it back into your document or spreadsheet.
The first time a line appears it is kept, and later repeats are removed. The order of your list does not change. Letters with accents match however they were typed, so “café” typed on two different keyboards still counts as a duplicate.
Worked example
Biology
Chemistry
biology
Physics
Chemistry
MathsWith the default options, the second “Chemistry” (which has a trailing space) is removed, but “biology” stays because its case is different. 1 line removed:
Biology
Chemistry
biology
Physics
MathsWith Ignore upper and lower case also ticked, 2 lines are removed:
Biology
Chemistry
Physics
MathsQuestions and answers
- Can I sort the list as well?
- This tool keeps your original order on purpose. Sort the result in your spreadsheet or word processor if you need it in alphabetical order.
- Does it compare whole lines or words?
- Whole lines. Two lines must match completely, after the options you chose are applied, to count as duplicates.
- How long can my list be?
- Lists with hundreds of thousands of lines work in a modern browser. The work happens on your device, so very large lists are slower on older phones.