The Unique Module will remove duplicate items. If your feed(s) has duplicate content, you can use the Unique Module in Yahoo Pipes to eliminate it and only show it once.
http://www.bing.com/search?q=sliders+recipe+bacon+mayo&go=&form=QBRE&filt=all&qs=n&format=rss
In this example, lets look for recipes for “sliders”(mini hamburgers) that contain the ingredients: bacon and mayo. We can grab an RSS feed of search results for “sliders recipe bacon mayo” from the Yahoo! And Bing search engines.
But as you can see, we have some duplicate results in the Yahoo Pipes debugger:
We don’t want duplicate recipes in our feed, so we can use the Unique Module to filter out duplicate results. If we connect our source to the Unique Module, we can select a feed attribute (link, title, description etc.) from the dropdown menu. In this case we want to filter unique items based on the title.
And viola, our duplicate result is gone.
Recent Comments