Data Duplication Village

[TheCotMan]

I do not run this event. Nothing I write for it is authoritative.

The Data Duplication Event has been an event where large amounts of data are accumulated by Dark Tangent for sharing with the community. It has included videos, text files, and more. The normal method for getting copies was to bring the number, size and type of hard disk suggested to the Data Duplication Village, and then ask for copies, and then get notice on when they might be finished, and then pick up your disks later.

There have been exceptions. Some drives perform terribly and harm performance. For more details, see comments from the official authorities on this event, and then ignore everything I just typed. :-)

-Cot

[The Dark Tangent]

The DDV will be back for DEF CON 25, and I am working on the contents of the drives. As last year there will be two different drive sets, one of rainbow tables and one of hacking conference (A mirror of infocon.org) and any free space will be filled with other hacking related videos.

As we get closer I'll be posting more detailed information.

As always please provide links and pointers to content you want included.

Dark Tangent

[DaKahuna]

The DDV will be back for DEF CON 25, and I am working on the contents of the drives. As last year there will be two different drive sets, one of rainbow tables and one of hacking conference (A mirror of infocon.org) and any free space will be filled with other hacking related videos.

What Rainbow tables will be included? Looking for anything NTLMv2 8 characters (lower, upper, numbers and special) and longer.

[KnightOwl]

As the Dark Tangent mentioned, we will be back for DEF CON 25. We're working out the details of drop-off hours, etc and will post them as soon as they are ready. Last year, we pushed about 2PB of data out the door and we're gearing up for the same this year.

Stay tuned.

KO

[yen_z]

HD specification?
execuse me,
How many HD i need to buy?and the storage capacities per HD

[fourz3n]

HD specification?
execuse me,
How many HD i need to buy?and the storage capacities per HD

Given a lack of official notice I think it's fine to engage in speculation.

At DC23 the Data Duplication Village moved from using 4TB drives to 6TB drives, and @DEFCON announced more than a month out. It would be reasonable to assume 6TB again this year, as too short of a notice on a change like that will make it difficult to plan for.

Here are the last two threads, where you can find some comments that will give you anxiety about what kind of drive to buy:

https://forum.defcon.org/forum/defco...cation-village

https://forum.defcon.org/forum/defco...-at-def-con-24

[KnightOwl]

...It would be reasonable to assume 6TB again this year...

That's a good assumption, fourz3n. There were three drives last year, Infocon, Rainbowtables, and more Rainbowtables - @6TB each. It's possible that the Infocon drive will shrink to 4TB (all the files were recompressed and that would make duping faster) but we don't have that confirmed yet. For now, it's safer to plan for 3x6TB drives.

A formal announcement will be made as soon as we have that locked down.

KO

[KnightOwl]

We've been scheduled to occupy the Naples room on the Promenade level this year (map here: https://www.defcon.org/html/defcon-25/dc-25-venue.html). Detailed planning has begun in earnest!

KO

[kip]

I'm assuming that we can bring in drives that are larger than expected (such as 8 or 10TB) and be fine on the data duplicators. Is this the case?

Are there minimum disk rpm speeds that you would prefer (IE no slower then 7200)?

[The Dark Tangent]

Data Duplication Village Drive Infoz

Drive 1 - Archive of https://infocon.org/ hacker and infosec conference
Current archive size: 2.8TB soI will fill some of the space with other content
BRING A 6TB DRIVE

Drive 2 - Rainbow Table #1-2
Current size: 5.5TB
BRING A 6TB DRIVE

Drive 3 - Rainbow Table #2-2
Current size: 6TB
BRING A 6TB DRIVE

[KnightOwl]

Data Duplication Village Drive Infoz
...

Thanks, DT.

Based on this, we be looking for people to bring a clean 6TB SATA3 drive for each drive you want to take home.
For a full copy of everything, you'll need three (3) clean 6TB SATA3 drives. 7200rpm or better please. Do your research and get the best bang for your buck but take reliability into account! Check out current drive failure rate reports and such. Backblaze has some small sample info for example.

Remember - last year we cleared all of Vegas of all of their 6TB drives so plan ahead!

Here's the current schedule for DDV:
Thursday, July 27th 16:00 - 19:00 (drop off only)
Friday, July 28th 10:00 - 17:00
Saturday, July 29th 10:00 - 17:00
Sunday, July 30th 10:00 - 11:00 (last chance pickup only)

Space permitting, last drop off will be Saturday at 3:00pm.
Pick your drives full of data anytime 14-24 hours after your drop off. We're working on a method to post info about drive completion as they occur. More detail will be at https://dcddv.org
Last chance pickup is Sunday from 10:00 to 11:00.
Any drives not picked up by Sunday at 11:00am are considered donations to the DDV and may be used for DC26 target practice.

KO

[TheCotMan]

<actor=shill>
A question from past reports.

There were issues with "Seagate Enterprise 6TB" (ST Enterprise 6TB) and WD "Red" (Western Digital Red) drives in the past:
https://forum.defcon.org/forum/defco...cation-village

(See the post, and then the nested reply just 2 posts down where more details are added.)

Are there any 6TB drives that people should avoid bringing if they want to participate at DEF CON 25?
</actor>

[KnightOwl]

...
There were issues with "Seagate Enterprise 6TB" (ST Enterprise 6TB) and WD "Red" (Western Digital Red) drives in the past:
...

The smaller duplicators are much more forgiving about the drive specifics. We also improved our intake and drive copy prep process last year so we were able to "dup all the drives" (now I'm channeling Dual Core) that we received - even the few Seagate and WD Reds that came in.

As mentioned above, everyone can be smart and do some micro research to avoid drives with historically high failure rates. We'll also be capturing the number of each brand/type we get this year so we can report some of that data for use next year.

Thanks for asking!

KO

[oxcurlew]

How are the rainbow tables split between #1-2 and #2-2? My copy of some of the files unfortunately suffered from some bit rot and depending on the split I might not need to bring two drives.

Alternately, if someone knows where I could download just these files I'd be very appreciative (and then won't be taking up a drive duplicator slot):

md5_loweralpha-numeric-symbol32-space#1-8_1_60000x67108864_distrrtgen[p][i]_222.rti2
md5_mixalpha-numeric-space#1-8_0_60000x67108864_distrrtgen[p][i]_036.rti2
md5_mixalpha-numeric-space#1-8_0_60000x67108864_distrrtgen[p][i]_037.rti2
ntlm_mixalpha-numeric#1-9_16_755000x67108864_distrrtgen[p][i]_046.rti2
ntlm_mixalpha-numeric#1-9_32_755000x67108864_distrrtgen[p][i]_212.rti2
ntlm_mixalpha-numeric#1-9_32_755000x67108864_distrrtgen[p][i]_315.rti2
ntlm_mixalpha-numeric#1-9_32_755000x67108864_distrrtgen[p][i]_432.rti2
ntlm_mixalpha-numeric#1-9_48_755000x67108864_distrrtgen[p][i]_138.rti2
ntlm_mixalpha-numeric-all-space#1-8_8_300000x67108864_distrrtgen[p][i]_299.rti2
ntlm_mixalpha-numeric-all-space#1-8_8_300000x67108864_distrrtgen[p][i]_300.rti2

[The Dark Tangent]

oxcurlew The tables are split as follows:

Tables 1-2 has the GSM A51 and MD5 tables with about 404 gigs free on a 6TB drive

Tables 2-2 has lanman, mysqlsha1, ntlm, and some word lists with about 136 gigs free on a 6TB

Hope that helps!