(1) Remove duplicates from CockroachDB [1.0]

[johnantonn]

Starting points:

• https://stackoverflow.com/questions/45681442/how-to-remove-duplicate-rows-in-cockroachdb
• https://stackoverflow.com/questions/18932/how-can-i-remove-duplicate-rows
• https://stackoverflow.com/questions/18418122/delete-duplicates-from-large-dataset-100mio-rows

Useful SQL commands:

• https://www.cockroachlabs.com/docs/v20.2/bulk-delete-data
• https://stackoverflow.com/questions/1826120/sql-count-and-distinct

[johnantonn]

The solution with temporary tables cannot be implemented because it has been implemented at a later version of CockroachDB. We'd have to upgrade to v20.1:

• https://www.cockroachlabs.com/docs/stable/temporary-tables.html

Of course another issue would be the large size of the tables that would have to be stored in ram during the below steps:

1. copy of the unique rows from the original table to a new temp table
2. the truncation of the old table and
3. the replacement with the new temp table

[johnantonn]