Remove duplicate documents/videos/images via popular algorithms such as SimHash, SpotSig, Shingling, etc.
-
Updated
Aug 28, 2023 - Python
#
shingling
Here are 12 public repositories matching this topic...
Implementation of algorithms for big data using python, numpy, pandas.
python bloom-filter lsh streams frequent-itemset-mining pcy frequent-itemsets stream-mining shingling big-data-processing lsh-algorithm min-hasing similar-items a-priori multistage-pcy multihash-pcy
-
Updated
Apr 27, 2020 - Python
A Java program to check Plagiarisms between multiple documents using the method of Shingling, MinHashing and Locality Sensitive Hashing.
-
Updated
Jul 31, 2020 - Java
Code for Shingling
-
Updated
Jun 12, 2024 - Python
Finding Similar Items: Textually Similar Documents
-
Updated
Nov 14, 2018 - TypeScript
Duplicate Detection on Hoaxy Dataset
-
Updated
Dec 4, 2018 - Jupyter Notebook
Implementing Locality Sensitive Hashing for DNA Sequences.
-
Updated
Nov 29, 2020 - Python
-
Updated
Dec 11, 2025 - Python
Finding Similar Items: Textually Similar Documents
-
Updated
Sep 14, 2022 - Jupyter Notebook
information-retrieval similarity cosine-similarity bands shingles latent-semantic-analysis latent-semantic-indexing shingling
-
Updated
Dec 26, 2019 - Python
Data Mining Algorithms
-
Updated
Dec 5, 2018 - Roff
Add this topic to your repo
To associate your repository with the shingling topic, visit your repo's landing page and select "manage topics."