Hak5
Save 10% at GoDaddy.com with coupon code HAK

Community Rainbow Tables

From Hak5

Jump to: navigation, search

Hak5-rainbowtables.JPG sealofapproval.gif

Contents

Community Rainbow Tables Project

About

The purpose of this project is to generate very large Rainbow Tables that are currently not widely accessible online. With community support, one doesn't have to wait a year for their large table to finish generating.

rainbowsm.PNG

News

Well They're Finished !!!!!

Torrent here: http://www.mialta.com/rainbows/Hak5%20NTLM%20Rainbows%20Full%20Set.torrent (This Link Works !!)

Thanks to sf292 for the great effort with the final sets.

Don't forget if you have part of the sets copy them in to seed straight away. Please seed for as long as you can !!!

Mialta

Lets Get Things Happening

Things appear to have stagnated here so lets get things happening.

In a few days after I have generated 2 missing tables I will post a link to a torrent containing all tables from :

ntlm_mixalpha-numeric-all-space#1-7_0_10000x40000000_#000.rt 

            To

ntlm_mixalpha-numeric-all-space#1-7_10_10000x40000000_#021.rt

If you previously uploaded a table to the "Powweb" ftp and still have it please visit this page http://www.mialta.com/rainbows to see if it needs to be re-uploaded.

Hopefully we can get the next 10 tables completed and in a torrent soon, when we have the lot generated we can then create a single torrent and those that have downloaded a part torrent can change to the full torrent and become seeds for the data already downloaded.

Thanks

Mialta

Powweb FTP Going Offline

The Powweb FTP server will be unavailable in June 2008 and forever afterwards. More details here: Talk:Community_Rainbow_Tables/Assignment_List

New FTP Server

There is a new FTP server to supplement the old one while the network gets relocated. More information is available here: Assignment List - Upload Your File

Services Offline

  • CRT Services will be offline until 2/25/07 due to technical issues. Also, the IRC is now irc.rainbowtables.org #rainbowtables, but is still accessible via irc.hak5.org. Please bear with these changes until things settle down with the IRC community and organizational problems.

Assignment List Interface Wanted

Community members who are fluent in PHP or another serverside language are encouraged to submit an interface system which will more easily control the Assignment List than the wiki system. The system must have:

  • Membership system to keep identities sane
  • Easy administrative panel :: check which ones are valid, invalid, etc.
  • Submission timeout system :: If not in by x weeks, consider it lost and reset
  • Easy to upgrade to newer table sets, changing the number of groups/tables per group/generation string

If you're interested, contact Silivrenion on IRC or email hak5rainbowtables at gmail dot com.

I am currently developing an interface for the project. --Forgott3n 17:50, 17 December 2006 (PST)

Props

Upon meeting phase one project objectives mad proppage on the current Hak5 episode in development will ensue and all volunteers/members will get special shoutouts. Ensure that your name is entered under the Members heading to receive proper credit. --Darren 23:40, 13 September 2006 (PDT)

Donations

Donations are welcome to the project. Funding for the project goes directly to the purchase of new hardware and bandwidth increases for the project, as well as hosting.

  • Please note that donations to the Community Rainbow Tables Project are separate from the Hak5 team. Hak5 does not receive these donations, the Community Rainbow Tables Coordinators do.

If you are interested in donating to the Community Rainbow Tables project, please visit the link below. (This is to keep Hak5's site separate from Community Rainbow Tables donations.)

Prerequisites

Windows Users:

WinRTGen(recommended)

RainbowCrack(alternative)

Pre-patched Version

Note: The pre-patched versions are alpha, and may or may not work. Please voice your success or failure with it on our IRC channel.

Unpatched Version

Linux Users:

Patched Source

Unpatched Source

Generating our tabletypes requires a special charset.txt file, available here:

Something to consider when generating the table is that you are making heat. Excess heat is bad for computers. Make sure that your computer has adequate cooling before trying to run processes for extended periods of time. Monitor your temps!! There should be programs out there to actively hold a process's cpu usage for you, so you don't push temperatures over the edge. For the common user, this shouldn't be a problem, but be aware of cooling requirements.

You will need to be able to transfer the files you generate to one of the project drives that are available. Status updates for the project drive FTP servers are available in the IRC channel.

For linux builds, you need the openssl-dev librarys. For debian and debian-based distros, use sudo apt-get install libssl-dev. For other distros, consult your package manager documentation. On Gentoo, you can install everything you need with an 'emerge rainbowcrack'. You may need to add 'app-crypt/rainbowcrack ~ARCH' to your /etc/portage/package.keywords file.

On PPC builds for OSX, a patch and binaries are available.

Checking out a Table

When you pick a table to start generating, you will edit that line in the Rainbow Table Assignment List section according to the instructions there. This will allow others to know which tables are being worked on, so they can start generating new, fresh tables. Do not worry about date and time stamps, since the wiki edit system caches this information for you.

Generating the Table

Generation of the table is possible by typing the command seen on a line in the Rainbow Table Assignment List. For example, to generate the first table, one would type in "rtgen ntlm mixalpha-numeric-all-space 1 7 0 10000 40000000 #00" at the command prompt with rtgen.

Generating this tabletype requires a special charset.txt file, available here: http://www.freewebs.com/rainbowtables/charset.txt

Sorting the Table

All tables are automatically sorted after being uploaded. WinRTGen automatically sorts for you when you complete the table, also.

Calculating How Long

Oxid.it has a great tool. It is a gui for generating your tables. It has a built in calculator and could make generating the tables much easier. Go here and get it.

Here is a comparison:

  • AMD 64 4000+ (Windows XP) will generate 100k/40mil chains in 12m 25s.
  • AMD 64 3800+ (Windows XP) will generate 100k/40mil chains in 13m 37s.
  • AMD 64 3700+ (Windows XP) will generate 100k/40mil chains in 12m 52s.
  • AMD 64 3500+ (Windows Vista) will generate 100k/40mil chains in 13m 20s.
  • AMD 64 3000+ (Ubuntu 64-bit) will generate 100k/40mil chains in 18m 37s.
  • AMD 64 2800+ (Windows XP) will generate 100k/40mil chains in 16m 33s.
  • Intel Core 2 Duo (2GHz)(Fedora 64-bit) will generate 100k/40mil chains in 7m 42s each process per core.
  • Intel Core 2 Duo (2GHz)(Windows XP) will generate 100k/40mil chains in 11m 37s.
  • Intel Core Duo (2GHz) (Ubuntu) will generate 100k/40mil chains in 14m 49s.
  • P4 2.8GHz (Gentoo Linux) will generate 100k/40mil chains in 16m.
  • P4 2.4Ghz (Windows 2000) will generate 100k/40mil chains in 13m 13s.
  • Intel celeron 733mhz (debian linux) will generate 100k/40mil chains in 27m 3s
  • Celeron 566Mhz (Windows XP) will generate 100k/40mil chains in 63m.

Once you have your baseline, do this math to determine a good estimate on the time needed to generate 1 table:

  • ((Minutes * 60) + seconds) * 400 / 60 / 60 / 24

That simple equation will determine how many days needed to generate one table.

Alternately, you can use the script at http://www.bsodtv.org/tmp/rainbow.php, and input the time in minutes and seconds that your PC takes to generate one set of chains. This will calculate for you the total time (approximately) it will take.

On a dual core system, the above benchmarks represents each core. So the Core Duo can really do 200k in that time, working on two tables.

About the Oxid winrtgen tool

Additional note: winrtgen apparently presorts the data as well. Only problem observed is winrtgen is not optimized for multiple processors such as the Intel(R) Pentium(R) D CPU 2.66GHz.

Please also note that the following information is an example of the LM algorithm set. Real chain lengths and values are available in the Assignment List at http://list.rainbowtables.org

48078967.png

This first image show the add table entry point. Basically the point here it to get everything as close to the line as possible ie I am doing rtgen lm all 1 7 6 9000 40000000 #00

  • step 1. set the same sets there
  • step 2. Index should be 0 - 7 (I am using 6 for myself)
  • step 3. Chain len should be 9000
  • step 4. N* tables should be 25
  • step 5. then click ok.

68781049.png

  • step 6. Delete tables that have already been generated by others.

Example if you are using indes 6 as I am, you need to delete lm_all#1-7_6_9000x40000000_oxid#000.rt So that you can actually generate only one table at a time, you also need to delete the others except for the one that you are wanting to generate, such as 2 -23 IF you are going to do table 02 of index 6.

Once you have that done, you can now click on ok.

You should now be generating a table. :)

Pausing Generation

You can temporarily stop generation of a table by hitting Ctrl+C in the Dos window. You can resume it by executing the same command you did to start generation. To make starting easy for yourself, you may choose to create a small batch file that will run your current generation settings when its doubleclicked.

If you would like an easier way to start your table. create a bat file with the following:

cd C:\(Path to rtgen) yourtable

Be sure to include the rtgen in the file. and save it as whatever.bat

Double click the bat file and it will automatically start working again. Be sure to change the table number to whatever you signed up for.

Submitting Your Status

When your table is done generating, you will edit that line in this wiki page according to the instructions in the Rainbow Table Assignment List section. The current locations to upload the file to are below. If you cannot upload it then, provide details on when you can.

Options for Compression Before Uploading

Uploads are accepted, and encouraged, in an archival or compressed format. See the chart below for the average size reductions you can expect with various formats available.

[Archive Efficiency]

Obviously, .7z wins hands down in compression of Rainbow Tables. You may .7z your rainbow tables before uploading with the program 7-Zip, available here:

Once 7-zip is installed, right click your rainbow table, go to 7zip, add to archive, and change the compression to 'Ultra' and start compressing. Leave all other settings at default.

List of Project Storage Drives

Please see Assignment List - Upload Your File for an updated list of project drives.

IRC Cracker (CrackBot)

  • More information about CrackBot can be found at the wiki article: Crackbot

Torrent Download

The RainbowTables project has finished generating the 120GB LM All tableset, and they are now available for public download via torrent. Direct questions can be made on the RainbowTables chatroom, irc.hak5.org #RainbowTables

The torrent download is available here:

http://www.groenekoeien.com/hak5_rtables_lm_all_1-7_ver2.torrent

  • WARNING*

Please be advised that this torrent is slow due to inadequate seeding. Please be patient with your torrent participation!


File Information:

LM All Rainbow Tables

Brought to you by the community members of Hak5 and RainbowTables. Without them, these tables wouldn't exist. For more information on how to use these files, please visit http://www.antsight.com/zsl/rainbowcrack/

Technical Details

  • Charset: all(ABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!@#$%^&*()-_+=~`[]{}|\:;"'<>,.?/)
  • Plaintext Length Range: 1-7
  • Key Space: 68^1 + 68^2 + 68^3 + 68^4 + 68^5 + 68^6 + 68^7 = 6823331935124
  • Disk Usage: 120GB
  • Success Rate: 1 - (1 - calc_success_probability(6823331935124, 9000, 8000000000/8)) ^ 8 = 0.9990
  • Mean/Max cryptanalysis time: 197.0106s/915.2542s*
  • Max Disk Access Time: 3802.2s*
  • Typical 666MHz CPU

RainbowTables By Mail Service

For more information about this service, please visit Community Rainbow Tables - RainbowTables by Mail

Questions and Comments

Please send your questions and comments to hak5rainbowtables at gmail dot com, and please put some identification in the subject line that its about Community Rainbow Tables.

IRC Chat

Our Channel

You can chat with us on the same server as hak.5!!

Cross-Project Collaboration

Hak5 Community Rainbow Tables invites contributions and collaboration between the different Rainbow Tables/Crack projects out there. In order to bridge the gap between projects, a channel has been created on irc.plain-text.info to share information about projects, technologies, and other things. Access to the channel is on an ask-an-admin basis. If you wish to join, follow these steps:

  • Important! Follow the rules of the #rainbowcrack and #rainbowchat channels!

If there's any questions, feel free to ask an admin at the plain-text irc, or Silivrenion at irc.hak5.org

Frequently Asked Questions

  • Q: When I enter the string from the Rainbow Table Assignment List, I get a list of options for rtgen. Help!
  • A: Either you entered it incorrectly, or you are running version 1.1 of rcrack or lower. Check your typing to make sure there's no errors. If you are running version 1.1 or lower, don't enter 'lm' as an option to rtgen.
  • Q: What is the syntax for rtgen to specify which table to generate?
  • A: rtgen lm all 1 7 <tableno> 9000 40000000 #<fileno> . There are 25 files in each table number, and 7 table numbers for now. Basically, its the same syntax as the Assignment List below, with the exception that if you are using version 1.1 of rtgen or below, you may omit 'lm' from the command syntax.
  • Q: I'm running the latest linux build of rtgen and the command ./rtgen lm all 1 7 <tableno> 9000 40000000 #<fileno> just prints out all of the command line options. What's wrong?
  • A: The # character needs to be escaped. Run ./rtgen lm all 1 7 <tableno> 9000 40000000 \#<fileno>
  • Q: Does the Charset include the space character?
  • A: No it does not according to the technical details. The charset would be all-space to include the space character.
  • Q: Where can I get a more useful LM rainbow table set that includes the space character?
  • A: http://rainbowtables.shmoo.com/
  • Q: I found these tables that claims they are the same char set as the hak.5 rainbow tables project, however they are MUCH smaller? whats up?
  • A: Info From Silivrenion: Appearently with the way the rainbow tables work, larger tablesets are faster. So, say 40GB tables vs 120GB tables, the 120GB tables would be faster, yet take up 3 times the room. The smaller tables will require more CPU power to get the same data as the larger tables: the larger tables already have the extra instructions programmed in for faster responses.

Contributor and Member Lists

Members of the community that are taking part in this project can be found in the Contributors Category. If you want to contribute as well, make a page named "<your nickname here>". Then, input this text in the source: 

[[Category:Community Rainbow Tables Contributors]]

Additionally, GallaUK has created a nice template that adds a cool looking box to your profile, and does the category code for you. Simply enter this in your profile and try it out: 

{{User Rainbow Tables}}

Rainbow Table Assignment List

We are currently working on a table that will cover all characters. This table will be 119GB large, and take up 200 individual *.rt files. Here's the list of files. If you wish to check out an assignment, please edit the wiki as described in the Instructions, and give the command to rtgen as indicated. For example, to generate the first table, one would type in "rtgen lm all 1 7 0 9000 40000000 #00" at the command prompt(must use \ before # in linux). PLEASE follow the guidelines above on how to check out an assignment properly and submit your results before proceeding with generation! Deleting others entries that don't belong to you is inappropriate, too, and won't be tolerated!

  • The assignment list is located Here

Mad Props/Thanks

Also, many thanks are owed to the tens of people who donate their CPU time to the project.

A special thank you is given to the moderators of the channel, without your help, there would be chaos.

Thanks goes to those with FTP logins. Your activity in the project has granted you the abilities to help others with failed uploads and problems. We couldn't live without you.

Many thanks goes to the following people for contributing to the project in hardware or funding. Your help is greatly appreciated!

Thanks to other private contributors for contributing hardware used during this project.

Last, but certainly not least, wicked mad props goes to Darren and Wess for their support in organizing some of the technicalities of the project, and for giving us the opportunity to create this wicked awesome project as a community. Thanks!!

See also

Retrieved from "http://wiki.hak5.org/wiki/Community_Rainbow_Tables"