pwwMap2015-11-24

所属分类:数据库编程
开发工具:Visual C++
文件大小:564KB
下载次数:8
上传日期:2015-11-24 14:34:51
上 传 者pww71
说明:  中国唯一的小型数据库,高效,低内存的大数据处理工具。
(China s only small High efficiency, low memory big data processing tool.)

文件列表:
pwwHash (4096, 2015-11-24)
pwwHash\build.txt (204, 2015-03-13)
pwwHash\config.txt (96, 2014-07-10)
pwwHash\Debug (4096, 2015-11-22)
pwwHash\Debug\pwwHashMapDLL.dll (83968, 2015-11-23)
pwwHash\Debug\pwwHashMapDLL.lib (21990, 2015-11-23)
pwwHash\Debug\pwwHashMapDLL64.dll (104960, 2015-11-23)
pwwHash\Debug\pwwHashMapDLL64.lib (22142, 2015-11-23)
pwwHash\linux error.txt (214, 2014-05-08)
pwwHash\Manual.txt (494, 2015-05-05)
pwwHash\pwwHash (4096, 2015-11-24)
pwwHash\pwwHash2008.sln (887, 2015-11-17)
pwwHash\pwwHash2008.suo (248320, 2015-11-24)
pwwHash\pwwHash2012.sln (888, 2015-11-21)
pwwHash\pwwHash2012.v11.suo (20480, 2015-11-22)
pwwHash\pwwhashforlinux (4096, 2015-11-23)
pwwHash\pwwhashforlinux\dlltest (141304, 2015-11-23)
pwwHash\pwwhashforlinux\libPwwHashMap.so (92568, 2015-11-23)
pwwHash\pwwhashforlinux\linuxForRun.txt (230, 2015-02-28)
pwwHash\pwwhashforlinux\make.sh (215, 2014-05-25)
pwwHash\pwwhashforlinux\Makefile (1020, 2014-05-25)
pwwHash\pwwhashforlinux\pwwhash (4096, 2015-11-24)
pwwHash\pwwhashforlinux\pwwhash\main.cpp (8933, 2015-11-24)
pwwHash\pwwHashLib (4096, 2015-11-23)
pwwHash\pwwHashLib\PwwHash.h (7642, 2015-11-20)
pwwHash\pwwHashLib\PwwHashMem.h (1921, 2015-11-15)
pwwHash\pwwHashLib\PwwHashMem.inl (2828, 2015-11-23)
pwwHash\pwwHashLib\PwwMap.h (3433, 2015-11-15)
pwwHash\pwwHashLib\PwwMap.inl (10332, 2015-11-21)
pwwHash\pwwHashLib\PwwStrMap.h (2662, 2015-10-28)
pwwHash\pwwHashLib\PwwStrMap.inl (8971, 2015-11-20)
pwwHash\pwwHash\charTreeTest.txt (0, 2015-11-24)
pwwHash\pwwHash\Common.h (555, 2001-08-26)
pwwHash\pwwHash\HiResTimer.cpp (902, 2010-03-11)
pwwHash\pwwHash\HiResTimer.h (398, 2001-08-27)
pwwHash\pwwHash\pwwHash.vcproj (5246, 2015-11-22)
pwwHash\pwwHash\pwwHash.vcproj.BFVU20O6YOSUDJJ.Administrator.user (1427, 2014-03-14)
pwwHash\pwwHash\pwwHash.vcproj.HG-A4E4487F4E40.Administrator.user (1427, 2014-04-02)
pwwHash\pwwHash\pwwHash.vcproj.XP-20130909DUTF.Administrator.user (1427, 2015-11-24)
pwwHash\pwwHash\pwwHash.vcxproj (5980, 2015-11-22)
... ...

Title: The core of the big data solutions -- Map. Author: pengwenwei address: No.17-18 of XiangGangbatang Community, Xiangtan City of Hunan Province, ***. Language: c++ Platform: Windows, linux Technology: Perfect hash algorithm Level: Advanced Description: A high performance map algorithm Section MFC c++ map stl SubSection c++ algorithm License: (GPLv3) Map is widely used in c++ programs. Its performance is critical to programs' performance. Especially in big data and the scenarios which can't realize data distribution and parallel processing. I have been working on big data analysis for many years in telecommunition and information security industry. The data analysis is so complicated that they can't work without map. Especially in information security industry, the data is much more complicated than others. For example, ip table, mac table, telephone numbers table, dns table etc. Currently, the STL map and Google's hash map are the most popular maps. But they have some disadvantages. The STL map is based on binary chop, which causes a bad performance. Google Hash map has the best performance at present, but it has probability of collision. For big data analysis, the collision probability is unacceptable. Now I would like to publish pwwMap. It includes three different maps for different scenarios: 1. Memory Map(memMap): It has a good access speed. But its size is limited by memory size. 2. Harddisk Map(diskMap): It utilizes hard disk to store data. So it could accept much more data than memory map. 3. Hashmap(hashMap): It has the best performance and a great lookup speed, but it doesn't have 'insert' and 'delete' functionality. MemMap and diskMap could be converted to hashMap by function memMap2HashMap and diskMap2HashMap. According to the test result, my algorithms' collision probability is zero. About performance, memMap has a comparable performance with google, and hashMap's performance is 100 times better than Google's hashmap. In summary, pwwhash are perfect hash algorithms with zero collision probability. You can refer to following artical to find the key index and compress algorithm theory: http://blog.csdn.net/chixinmuzi/article/details/1727195 Source code and documents: https://sourceforge.net/projects/pwwhashmap/files/?source=navbar I would like to transfer my technique with my immigration to the United States as the condition. Please do not contact me with email, qq or telephone. We can have a face to face talk. My email is pww71@sina.com and password is 8622507. after delivery. Please make sure your email is received. Otherwise it's the national security agency to restrict me to receive your mail, you can only talk with me. My address is as follows: No.17-18 of XiangGangbatang Community, Xiangtan City of Hunan Province, ***.

近期下载者

相关文件


收藏者