Dedupe.io was shut down Jan 31, 2023.
The Dedupe.io team has decided to dedicate our focus to our consulting practice at DataMade and work on projects more aligned with our mission to support our clients in working toward democracy, justice, and equity.
We are continuing our consulting practice around the open source dedupe library and would be happy to consult with you on setting up a solution based on it. Contact us to get started >
In this submission, which reflects only my personal opinions, I set out the crucial importance of citizen and stakeholder engagement to increase the effectiveness and legitimacy of regulations, and to strengthen democracy and trust in policymakers when both are under severe challenge. I examine some difficultiesattached to public commenting in rulemaking, and how they can be overcome using new tools and technology. Finally, I showcase how jurisdictions around the world are turning to crowdlaw, the use of online public engagement in order to improve the qualityof the law-and rulemaking process, and provide examples that the United States could draw on as it seeks to deepen the foundations of its democracy in uncertain times.
Solution 2: Use Deduplication Software to Address Identical Comments
The large volume of submissions often results from duplicative “postcard” comments. Datamining technology to deduplicate public comments has existed for well over a decade. Deduplicating records in a database is a common process. Dedupe.iois an example of a software service which helps researchers and data scientists to identify and delete similar records in their database.