Remove Duplicate Rows - Gridscript Pipeline

Import the raw dataset into the data pipeline to enable structured data ingestion and prepare records for downstream data cleaning and transformation.

Import

data

Upload File

Deduplicate the imported dataset by removing duplicate records based on the primary key, ensuring high data quality, consistency, and analytics-ready output.

Transform

Source field

Output field

data_deduplicated

Start rowEnd row

Deduplicate rows

Keep first

Transform rows without code: combine operations to copy, convert, aggregate, elaborate and format data, then write the output to your target field.

Export the deduplicated dataset to Excel (XLSX) format to support spreadsheet-based reporting, business intelligence, and stakeholder analysis.

Code

Javascript

Export the cleaned and deduplicated dataset to CSV format for lightweight data sharing, system interoperability, and analytics pipeline integration.

Code

Javascript

Export the finalized deduplicated dataset to JSON format to provide a machine-readable output optimized for APIs, automation, and modern data workflows.

Code

Javascript

Profiler

Total Time: 0.00 ms

Stages: 5

Success: 0

Errors: 0

Context

Timeline

Stage 1

0.00 ms

Stage 2

0.00 ms

Stage 3

0.00 ms

Stage 4

0.00 ms

Stage 5

0.00 ms