Duplicate Line Remover
Clean up a list: remove repeated lines, sort, trim and drop blanks in one click.
- Free
- No sign-up
- Runs in your browser
0 lines
0 lines
Works on your device — your list is never uploaded. Drop a .txt or .csv file to load it.
How removing duplicate lines works
The tool reads your text one line at a time and keeps a note of every line it has seen. When a line comes up again, it’s a duplicate and is dropped, so only the first copy stays — in its original place. With “Last” selected, the last copy is kept instead. Before comparing, each line can be trimmed (spaces at the start and end ignored) and lower-cased, so “Red Shoes ” and “red shoes” count as the same item. The list never leaves your browser, and 100,000 lines take a fraction of a second.
For example, the list “red shoes, Blue Shirt, red shoes, green hat, blue shirt, red shoes” has 6 lines. With the default settings the result is 4 lines — red shoes, Blue Shirt, green hat, blue shirt — because “Blue Shirt” and “blue shirt” differ in case. Turn on Ignore case and it drops to 3 lines, and “red shoes” is listed as the most repeated item with 3 copies.
How do I find only the duplicate lines?
Choose “Only duplicates” to list each line that appears more than once (one copy each) — handy for spotting repeated email addresses or order numbers. “Only unique lines” does the opposite and shows lines that appear exactly once, so anything repeated is removed completely.
Sorting: A → Z vs natural order
A → Z sorts letter by letter, so “size 10” comes before “size 2”. Natural order (1, 2, 10) reads numbers by their value, giving size 1, size 2, size 10 — usually what you want for file names, invoice numbers and versions. Shortest first sorts by line length, and Reverse flips whatever order you picked.
Frequently asked questions
- Is my list uploaded anywhere?
- No. Everything runs in your browser; nothing is sent to a server or saved.
- How many lines can it handle?
- Lists of 100,000 lines or more work smoothly. You can paste the list or drop a .txt or .csv file of up to 50 MB.
- Does it change the lines it keeps?
- No. The kept lines are copied exactly as they were, including their spaces and capital letters. Trimming and ignoring case only affect how lines are compared.
- Can I remove duplicates from a column in Excel or Google Sheets?
- Yes. Copy the column, paste it here, and copy the result back. Each cell becomes one line, so duplicate cells are removed while the order stays the same.