Hello Enea, thank you this is exactly what I was looking for. I used people picker instead of a string column and it works. One more thing I needed help with is how to get the names of the people if we want to add their names in the email body so we can say 'Dear [name]' (Of course I am eliminating duplicates using your method, but it got tricky because my people picker can have multiple people in it).
Hi, are you planning to use all the names of your multi people picker column in the Dear [name] section? If yes you would have to append the names in a string variable before and manipulate that string in a compose action so that it looks as you need it. Then you can place it in your email. This is of course also to avoid creating an apply2each
This doesn't "eliminate duplicates" it just ignores duplicates... There is a difference. Eliminate duplicates would make them not exist any longer, not just ignore the duplicates that exist....
Its eliminating them from the array of the compose action. What were you looking for? I could do a video for your use case if this one was not helpful…
@@Enea I am working with dataverse and have run through a big process of importing data from emails into a dataverse table. I am now finding out that some of the emails were duplicates (Of more than 6K) I am trying to eliminate duplicate lines in datavers with flow everything I am seeing is on this stupid merge function. I need to delete the duplicate lines. I might want to "Merge" depending on how that works or "delete" the older duplicates. I am not sure what is best but it seems like this is harder to do than it seems like it should be.
Sounds like a tough challenge to recreate for a video to be honest. How to you identify the duplicates? Cant you use that as an id, put the ids in an array and use the union function?
@@Enea I have a field called Email_id it's the email ID the outlook connector gets from the email. The problem with doing this union is then I don't have a list of only the duplicate items to delete. I have a list of all of the items and which ones need to be deleted? It's alright I will post in the forum and see if anyone has a solution.
Hello Enea, Great video on how to remove duplicates. I am trying to remove all instances of duplicates from an excel table from a certain column. For example: example1 example2 example3 example2 And I want to create a flow that will output: example1 example3 how am I able to achieve this?
The website you recomended shows that the ODATA Filter Query reads the following data format: 'dd/MM/YYYY hh:mm'. Is that correct? As standard, the UTC uses the format 'YYYY/MM/dd hh:mm'
hello, do you know how to arrange a flow were you have a master document folder and a shared document folder and if a file is deleted from the master document folder that it is also deleted from the shared document folder.
Hi, check this video out, its not 100% your use case but it is pretty much the same solution. Sync Item Attachments between two SharePoint Lists ruclips.net/video/n4UvqcCCQRo/видео.html
Hi, I'm working on creating a unified view for Contacts, Accounts, and Leads in our CRM system. I've utilized Power Platforms to create custom forms within the environment, with DataVerse serving as our storage solution. To accommodate different businesses, I've set up three separate tenants, and there's one tenant for the central view. For data integration, I've established a dataflow to import contacts into the central view from the three tenants, but I'm encountering issues with duplicates. I'd like guidance on how to effectively merge these imported/newly created records and also display on the customer record that it includes properties from Tenant A and/or Tenant B.
Could you please do a video to explain how to use power automate online to delete duplicate excel rows based on a column value for excel file stored in sharepoint?
@@Enea For example, i use a Forms to Excel sheet for team members to enter their weekly tasks. But if anyone submits more than once in that same week, the previous entry (duplicate based on each person's Name) should be automatically deleted based on date of entry. Is that possible?
Could you please do a video to explain how to identify duplicates in a library full of pictures/videos, comparing at least one other parameters aside from the file name, and eliminate the duplicates? Thanks
Can you explain a little bit more? In libraries you cannot have two docs with the same Name. Do you mean having the same doc, with different names but same metadata?
@@Enea I mean I've got a library containing subfolders which contain pictures mainly. Copies of the same pictures are contained in multiple subfolders either with the same name or with a different name. So ideally I would like to be able to get a list of those and eliminate the duplicates. Aside from pictures, I've got the same issue also with other files that have been copied a number of times accross my SP folders, but I would like to clean the pictures first as they are the heaviest. Thanks for your interest !
I don’t think that is possible since you have to direct Power Automate to a folder. Or at least it is not easy to do. You would have to list the folders in an array, dynamically change the path based on the folder and save the picture names or something similar that distinguishes the duplicates in another variable. Then go and delete the duplicates.
You could possibly run a flow triggered on dynamics create item and have it check if it is already there. If yes then delete the new creation. But it sound dangerous, cant you enforce unique values in dynamics?
Hello Enea, thank you this is exactly what I was looking for. I used people picker instead of a string column and it works. One more thing I needed help with is how to get the names of the people if we want to add their names in the email body so we can say 'Dear [name]' (Of course I am eliminating duplicates using your method, but it got tricky because my people picker can have multiple people in it).
Hi, are you planning to use all the names of your multi people picker column in the Dear [name] section? If yes you would have to append the names in a string variable before and manipulate that string in a compose action so that it looks as you need it. Then you can place it in your email. This is of course also to avoid creating an apply2each
@@Enea Yes, I was able to figure it out. Thanks again.
Incredible method. I applied it here in my work. Thanks!
This was very useful. Thank you.
This doesn't "eliminate duplicates" it just ignores duplicates... There is a difference. Eliminate duplicates would make them not exist any longer, not just ignore the duplicates that exist....
Its eliminating them from the array of the compose action. What were you looking for? I could do a video for your use case if this one was not helpful…
@@Enea I am working with dataverse and have run through a big process of importing data from emails into a dataverse table. I am now finding out that some of the emails were duplicates (Of more than 6K) I am trying to eliminate duplicate lines in datavers with flow everything I am seeing is on this stupid merge function. I need to delete the duplicate lines. I might want to "Merge" depending on how that works or "delete" the older duplicates. I am not sure what is best but it seems like this is harder to do than it seems like it should be.
Sounds like a tough challenge to recreate for a video to be honest. How to you identify the duplicates? Cant you use that as an id, put the ids in an array and use the union function?
@@Enea I have a field called Email_id it's the email ID the outlook connector gets from the email. The problem with doing this union is then I don't have a list of only the duplicate items to delete. I have a list of all of the items and which ones need to be deleted? It's alright I will post in the forum and see if anyone has a solution.
But if an email is a duplicate, it doesn’t matter which one you delete right?
Hello Enea,
Great video on how to remove duplicates. I am trying to remove all instances of duplicates from an excel table from a certain column.
For example:
example1
example2
example3
example2
And I want to create a flow that will output:
example1
example3
how am I able to achieve this?
당신은 나에 구세주 입니다. 너무 간결하게 설명 잘 해주셔서 감사합니다. 고마윰을 꼳 표현 하고 싶었어요
The website you recomended shows that the ODATA Filter Query reads the following data format: 'dd/MM/YYYY hh:mm'.
Is that correct?
As standard, the UTC uses the format 'YYYY/MM/dd hh:mm'
On my site it works this way, is it throuwing any errors on your side?
Great video! Can you share the details of the parse Jason?
hello, do you know how to arrange a flow were you have a master document folder and a shared document folder and if a file is deleted from the master document folder that it is also deleted from the shared document folder.
Hi, check this video out, its not 100% your use case but it is pretty much the same solution. Sync Item Attachments between two SharePoint Lists
ruclips.net/video/n4UvqcCCQRo/видео.html
Hi,
I'm working on creating a unified view for Contacts, Accounts, and Leads in our CRM system.
I've utilized Power Platforms to create custom forms within the environment, with DataVerse serving as our storage solution. To accommodate different businesses, I've set up three separate tenants, and there's one tenant for the central view.
For data integration, I've established a dataflow to import contacts into the central view from the three tenants, but I'm encountering issues with duplicates.
I'd like guidance on how to effectively merge these imported/newly created records and also display on the customer record that it includes properties from Tenant A and/or Tenant B.
This has nothing to do with the video topic. You need to find a Power Platform consultant
Simple and efficient! Love it!
The video helped me a lot, thank you! :)
I have done the same as you and I get the same results as you in power automate but It wont enforce it in the list? any tips?
Could you please do a video to explain how to use power automate online to delete duplicate excel rows based on a column value for excel file stored in sharepoint?
Can you please give me an example? Delete duplicate rows doesn’t need a specific value, it just eliminates duplicates
@@Enea For example, i use a Forms to Excel sheet for team members to enter their weekly tasks. But if anyone submits more than once in that same week, the previous entry (duplicate based on each person's Name) should be automatically deleted based on date of entry. Is that possible?
I see, that is a good idea for a video. I will try to do it next weekend :)
Video is out: ruclips.net/video/t8UyTuEtP1M/видео.html
I recreated the scenario you have but with SharePoint instead of Excel. Hope it helps :)
What if your agent column is the agents name not the email
Should be the same logic, try it out
Could you please do a video to explain how to identify duplicates in a library full of pictures/videos, comparing at least one other parameters aside from the file name, and eliminate the duplicates? Thanks
Can you explain a little bit more? In libraries you cannot have two docs with the same Name. Do you mean having the same doc, with different names but same metadata?
@@Enea I mean I've got a library containing subfolders which contain pictures mainly. Copies of the same pictures are contained in multiple subfolders either with the same name or with a different name. So ideally I would like to be able to get a list of those and eliminate the duplicates.
Aside from pictures, I've got the same issue also with other files that have been copied a number of times accross my SP folders, but I would like to clean the pictures first as they are the heaviest.
Thanks for your interest !
I don’t think that is possible since you have to direct Power Automate to a folder. Or at least it is not easy to do. You would have to list the folders in an array, dynamically change the path based on the folder and save the picture names or something similar that distinguishes the duplicates in another variable. Then go and delete the duplicates.
Is it possible to detect duplicate fields in dynamics (dataverse) and send an email alert?
You could possibly run a flow triggered on dynamics create item and have it check if it is already there. If yes then delete the new creation. But it sound dangerous, cant you enforce unique values in dynamics?