About the Remove Duplicate Lines
Merge two exports and the same row turns up twice. This tool walks the list once, keeps the first occurrence of every line and drops the rest, so the original order survives instead of being alphabetised. The status reports how many lines went, which is a quick check that the two files really did overlap the way you assumed.
What counts as a duplicate is yours to set. With "Ignore leading/trailing spaces" on, ana@example.com and the same address followed by a space collapse together, which matters because a trailing space is exactly what a spreadsheet export leaves behind. Turn on "Ignore case" and differently capitalised versions join them. Internal spacing is never ignored, so New York with two spaces stays separate from the single-spaced version; run Remove Extra Spaces first when that is likely.
Windows line endings are handled, so a file saved with CRLF deduplicates the same as one saved with LF. Nothing leaves the browser, which matters when the list is customer addresses. To order the result and deduplicate in one pass, tick the unique option in Sort Lines; for distinct words rather than whole lines, Unique Words does that job.
How to use
- Paste the list.
- Choose whether to ignore case and surrounding spaces.
- Copy the deduplicated list.
Common questions
- Does it keep the order?
- Yes. The first occurrence of each line stays in place; later duplicates are removed. Use Sort Lines if you also want it ordered.
- Are near-duplicates with different spacing removed?
- If "Ignore leading/trailing spaces" is on, yes. Internal spacing differences still count as different lines.
- How many were removed?
- The status line shows the count.