Remove duplicate lines
Clean up a list or text by removing duplicate lines, while keeping the original order and the first occurrence of each line.
How it works
Handy for cleaning up a list of emails collected from several files, a list of URLs to crawl, or a data export containing repeated lines. Each line of the text is compared (after trimming leading/trailing spaces) against lines already seen; if it has already been encountered, it's ignored, otherwise it's kept in its original order.
Does the comparison take case into account?
Yes, the comparison is case-sensitive: "Hello" and "hello" are considered two different lines and both will be kept.
Do leading or trailing spaces affect the result?
No, leading and trailing spaces are ignored when comparing duplicates, but the original text of the kept line (including its spaces) is preserved in the result.
100% local processing: cleanup runs entirely in your browser via WebAssembly, your text never leaves your device.