SITE UNDER CONSTRUCTION. Everything here is provided AS IS, WITHOUT WARRANTIES, to the extent the law allows. It is information, not professional advice. Use at your own risk. Terms and liability limits →

eThorns ES
← TextES

Tool 4.6

Remove duplicate lines, sort and clean lists

Remove duplicate lines from any list, sort A–Z or Z–A (natural order too), trim spaces and delete empty lines. Runs in your browser; nothing is sent.

Runs on your deviceRuns entirely in your browser: nothing you type or upload leaves your device.

How to use it

  1. Paste your list with one item per line.
  2. Choose the options: remove duplicates, ignore case, trim spaces, remove empty lines and sort order.
  3. Copy the cleaned list. The counts show how many lines were removed.

Cleaning lists copied from Excel, CSV files or chats

Duplicates get into lists easily: a contact list built from several spreadsheets, a CSV export from a sales or billing system, emails collected from a form, codes pasted from a WhatsApp chat. Before you send a mass email, import customers or count sign-ups, you want each item once.

Paste the list with one item per line. You can copy a column or several columns straight from Excel or Google Sheets, or open a CSV file in a text editor and copy its lines.

Example: a CSV export with repeated customers

A system exports customers with ; between columns, the usual separator when Excel is set up for a country that writes decimals with a comma, like Colombia. You paste six lines: the header nombre;correo;ciudad, then Sofía's row twice, Luis's row twice (the second one with an invisible space at the end), and Sofía again with her email as SOFIA@tienda-ejemplo.co.

With the default options, the summary reads 6 lines → 4 lines · 2 duplicates removed · 0 empty lines removed. Trim spaces made Luis's rows equal. Sofía's row with the capital letters stays, because it isn't identical. Tick Ignore case and it's removed too, leaving 3 lines: the first version of each row is the one kept.

Why some repeats survive

Lines are compared whole. Two rows with the same email but a different city are not duplicates, and neither are José and Jose: an accent makes them different. If you need unique values of one column, like the email, paste only that column.

Sorting moves every line, including the header of a CSV: in A → Z, nombre;correo;ciudad ends up below the rows that start with A or L. Remove the header first, sort, and put it back. The sort follows the alphabet of the page's language, so on the Spanish page, ñ goes after n and accented letters sort with their plain letter.

FAQ

Which copy of a duplicate is kept?

The first one. Later repeats are removed, and the original order is kept unless you choose to sort.

What is natural order?

It sorts numbers by value, so item2 comes before item10, instead of the strict character order that would put item10 first.

Does it change the lines it keeps?

Only Trim spaces does, and it's on by default: it removes spaces and tabs at the start and end of each line. Everything else is kept as written. Ignore case only affects the comparison, so the line that stays keeps its capitals exactly as they were in the first copy.

Can I remove duplicates by one column only?

Not here: the tool compares whole lines. Paste only the column you care about, such as the emails, to get its unique values. To keep whole rows but judge them by one column, Excel's Data, Remove Duplicates lets you choose the columns.

Why weren't two lines that look the same removed?

Something invisible is different: a double space in the middle, a tab instead of a space, an accent, or a letter in capitals. Trim spaces only cleans the start and end of each line. Tick Ignore case for capitals, and fix the rest in the text before you paste it.

  • 4.1QR code generatorMake free static QR codes for links, Wi-Fi, WhatsApp, contacts, email and SMS.
  • 4.2Word counterCount words, characters (with and without spaces), sentences and paragraphs as you type.
  • 4.3Listen to textHear any text, or a TXT, PDF or Word file, read aloud by your device's own voices.
  • 4.4Case converterConvert text to UPPERCASE, lowercase, Title Case, Sentence case, camelCase, PascalCase, snake_case, kebab-case or CONSTANT_CASE, in your browser.
  • 4.5Compare textsPaste two versions of a text and see every added and removed line highlighted, with the changed words marked.
  • 4.7Lorem ipsumGenerate lorem ipsum placeholder text by paragraphs, sentences or words, in classic Latin or a Spanish-looking style with accents and ñ.
  • 4.8QR code readerRead a QR code from a photo, screenshot or camera and see what it contains, including who a payment QR pays.

╌╌ END ╌╌