How to deal with them ?
Well, there are many ways bur most of the times they involve a lot of steps.
Here, I am going to give you an approach which involves just one Filter Rows Transformation 👊 . For this use below expression in transformation after replacing columns according to your data -
If(
Rank(Rowid(),"asc",[Primary Key])=1
,TRUE
,FALSE
)
Here, if you want to identify unique rows based on more than one columns - Just add them like this :
If(
Rank(Rowid(),"asc",[Primary Key],[Data])=1
,TRUE
,FALSE
)
Want to see what happens ? Have a look -
