Deroute

所属分类:搜索引擎
开发工具:C++
文件大小:66KB
下载次数:0
上传日期:2023-06-05 02:19:24
上 传 者sh-1993
说明:  一个完全去中心化的P2P搜索引擎,可以通过浏览器扩展轻松访问。
(A fully decentralized, P2P search engine that is easily accessible through a browser extension.)

文件列表:
.npmignore (11, 2023-06-05)
Extension (0, 2023-06-05)
Extension\background.js (791, 2023-06-05)
Extension\manifest.json (442, 2023-06-05)
Extension\package-lock.json (3533, 2023-06-05)
Extension\package.json (50, 2023-06-05)
Extension\popup (0, 2023-06-05)
Extension\popup\popup.css (26, 2023-06-05)
Extension\popup\popup.html (365, 2023-06-05)
Extension\popup\popup.js (2309, 2023-06-05)
Extension\swarm.js (1383, 2023-06-05)
LICENSE (1073, 2023-06-05)
Native (0, 2023-06-05)
Native\Holepunch (0, 2023-06-05)
Native\Holepunch\controller.mjs (1747, 2023-06-05)
Native\Holepunch\example.mjs (863, 2023-06-05)
Native\Holepunch\package-lock.json (108931, 2023-06-05)
Native\Holepunch\package.json (490, 2023-06-05)
Native\Holepunch\src (0, 2023-06-05)
Native\Holepunch\src\peer-controller.mjs (1411, 2023-06-05)
Native\Holepunch\src\peer.mjs (3764, 2023-06-05)
Native\Holepunch\src\queue.mjs (442, 2023-06-05)
Native\Holepunch\test.js (799, 2023-06-05)
Native\search (0, 2023-06-05)
Native\search\CMakeLists.txt (3375, 2023-06-05)
Native\search\build.py (583, 2023-06-05)
Native\search\src (0, 2023-06-05)
Native\search\src\compress.cpp (2579, 2023-06-05)
Native\search\src\compress.h (268, 2023-06-05)
Native\search\src\controller.py (5657, 2023-06-05)
Native\search\src\deroute.cpp (1930, 2023-06-05)
Native\search\src\deroute.h (1812, 2023-06-05)
Native\search\src\dictionary.cpp (2071, 2023-06-05)
Native\search\src\dictionary.h (1669, 2023-06-05)
Native\search\src\embed.cpp (6081, 2023-06-05)
Native\search\src\embed.h (1975, 2023-06-05)
Native\search\src\local_hash.cpp (1395, 2023-06-05)
Native\search\src\parse_website.py (2166, 2023-06-05)
... ...

# Deroute Deroute is an open source, fully decentralized, P2P search engine that is easily accessible through a browser extension. Upon execution, users will be able to search over the entire active P2P network and discover the web in a way entirely different then traditional search engines. Explore the [wiki](https://github.com/olin-feist/Deroute/wiki) for more in depth information about the implementation of Deroute. ## Table Of Contents * [Distributed Networking](#Distributed) * [Local Search Engine](#search) * [Browser Extension](#Browser) ## Distributed Networking The distributed networking provides communication functionalities between the [Browser Extension](#Browser) and [Local Search Engine](#search). When a search request is received from the [Browser Extension](#Browser), it sent to the [Local Search Engine](#search) and the connected swarm of peers. Each peer that receives the search request will propagate it to their peers and process it, returning any relevant website urls back to the original searcher. ### Usage: ``` cd .\Native\Holepunch\ npm install node controller.mjs [-d] ``` ## Local Search Engine The local search engine is responsible for the searching and storage of websites on a single user's machine. Using natural language processing and similarity search it will find results accurately and efficiently. Built using [FastText](https://github.com/facebookresearch/fastText/) and [FAISS](https://github.com/facebookresearch/faiss) the search engine is designed to be small and fast while still being able to yield relevant results. The search engine is primarily written in C++ with a high level controller written in Python. The external interface for the search engine works via a local http WSGI server.\ \ The model used in the distribution to create document and query embeddings is a reduced form of the model [cc.en.300](https://fasttext.cc/docs/en/crawl-vectors.html) from E. Grave, P. Bojanowski, P. Gupta, A. Joulin, T. Mikolov, Learning Word Vectors for 157 Languages. The model was trained on [Common Crawl](https://commoncrawl.org/) and [Wikipedia](https://www.wikipedia.org/) using the CBOW model. ## Browser Extension ### Usage: ``` cd .\Extension\ npm install ``` - In Google Chrome, go to Extensions>Manage Extensions. - Make sure Developer Mode is on. - Click "Load Unpacked", then navigate to and select the `.\Extension\` folder.

近期下载者

相关文件


收藏者