DEF CON Forum Site Header Art
DEF CON Forum Site Header Art

Announcement

Collapse
No announcement yet.

Data Duplication Village at DEF CON 29

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • Data Duplication Village at DEF CON 29

    Click image for larger version  Name:	DDVLogo-2019.png Views:	161 Size:	32.5 KB ID:	236582

    Check the schedule and/or dcddv.org for the most up-to-date information.

    It's true, the Data Duplication Village is back for DC 29! We have all the bits and bytes available from infocon.org packed up into nice, neat packages. If you're looking for something to fill up all your unused storage, may I recommend a nice hash table or two with a side of all of the DefCon talks? This is a "free-to-you" service where we're providing you direct access to terabytes of useful data to help build those skills.

    HOW IT WORKS
    DEF CON will provide a core set of drive duplicators as well as data content options. We accept 6, 8, and 10TB drives on a first come, first served basis and duplicate 'till we can no longer see straight. Bring in your blank SATA3 drives - check them in early - to get the data you want. Come back in about 24 hours to pick up your data-packed drive. Space allowing, we'll accept drives all the way through until Saturday morning - but remember, it's FIFO!
    • It will be a first come, first served to duplicate 'till we drop.
    • Bring labeled 6TB SATA blank drives, and submit them in the queue for the data you want.
    • Come back in 14-24 hours to pick up your data-packed drive.
    • Space allowing, the last drop-offs will be no later than Saturday afternoon and the last drives will run overnight with the final pickup time at 11:30am.

    WHAT IS AVAILABLE - Three drives:
    1. 6TB drive 1-3: Updated archive of infocon.org plus other "direct from DT" content, built on last years collection and always adding more for your data consuming appetite.
    2. 6TB drive 2-3: freerainbowtables.com GSM A51 and MD5 hash tables (Tables 1-2) with about 404 gigs free
    3. 6TB drive 3-3: more rainbowtables, lanman, mysqlsha1, ntlm, and some word lists (Tables 2-2) with about 136 gigs free

    The DC 29 content will be posted at dcddv.org once finalized

    WHAT YOU NEED
    * 6TB SATA3 512e format 7200rpm drive - one for each source you want

    If you want a full copy of everything you will need three drives.
    You can bring back last year's drive(s) to be wiped / updated (you should remove any 2018 stickers).

    WHEN TO BE THERE
    Data Duplication Village Hours:

    - Thursday, August 5 16:00 - 19:00 (drop off only)
    - Friday, August 6 10:00 - 17:00
    - Saturday, August 7 10:00 - 17:00
    - Sunday, August 8 10:00 - 11:00 (last chance pickup only)

    - Space permitting, last drop off is Saturday at 3:00pm.
    - Last chance pickup is Sunday from 10:00 to 11:00.

    We're working on a method to post completed ticket ranges to https://dcddv.org and https://twitter.com/DDV_DC

    SIDE NOTES
    • Be aware that we cleared all the Vegas area stores of every single 6TB drive last year we did this so plan ahead and get them now!
    • Duplicating a 6TB (About 5.46 usable) drive at an average of 120 Megabytes a second comes out to just under 14 hours per drive.
    • With all about 16 duplicators going, we can duplicate about 95 drives concurrently.
    • We're expect to push about 11GB per second out to the drives for 72 hours straight.
    • We did 335 drives for DC24 and we're hoping to do even more at DC25!
    • We are expecting more total duplicator capacity than last year!

    THAT'S ALL?
    But wait - there's more! At DC27, we made our our stretch goal a reality to provide a pick-and-pull datastore in the DDV. We expect to do it bigger and better this year!

    Dark Tangent and KnightOwl l post the up-to-date details in the DC Forum thread and you are encouraged to ask any questions you have there as con approaches.
    Click image for larger version  Name:	DDV-Village.png Views:	161 Size:	4.80 MB ID:	236583

    Click image for larger version  Name:	DDV-Duper.jpg Views:	158 Size:	105.4 KB ID:	236584

    Click image for larger version  Name:	DDV-Drives.JPG Views:	161 Size:	2.01 MB ID:	236585

    Starts
    April 8, 2021
    Ends
    April 8, 2021
    Last edited by The Dark Tangent; May 17, 2021, 07:06. Reason: Added Discord channel
    PGP Key: https://defcon.org/html/links/dtangent.html

  • #2
    Ok, I am going to ask the n00b question (because I can). If I am in search of ALL the data, do I need to bring three empty 6TB drives? I just want to make sure before I show up with insufficient disk space (story of my life).

    Comment


    • #3
      Originally posted by Cyph3r View Post
      Ok, I am going to ask the n00b question (because I can). If I am in search of ALL the data, do I need to bring three empty 6TB drives? I just want to make sure before I show up with insufficient disk space (story of my life).
      From what is described, there would be 3 separate 6TB disks. (Plans can change, and I don't run this event.)
      (This assumes there will be an in-person event for 2021; as of April 14, 2021, no decision has been announced about this for DEF CON in 2021.)
      (Advice provided here is no confirmation of any decision.)

      One old piece of information to consider when selecting drives to bring:
      https://forum.defcon.org/node/220674...786#post221786 (2015, 6 years ago from 2021):
      "I heard from the Data Village folks running the machines that the WD RED drives had the most compatibility problems with the (older) tower dupers but worked fine in the newer desktop 1:5 dupers."
      So, assuming WD RED drives are still available for sale, it may be good to choose some other 6TB drives.

      More advice: upgrade the firmware on your drives before you bring them.

      Comment


      • #4
        Thank you very much for the information. That is what I was thinking but just wanted to make sure.

        Cheers!

        Comment


        • #5
          Originally posted by number6 View Post

          From what is described, there would be 3 separate 6TB disks. (Plans can change, and I don't run this event.)
          (This assumes there will be an in-person event for 2021; as of April 14, 2021, no decision has been announced about this for DEF CON in 2021.)
          (Advice provided here is no confirmation of any decision.)

          One old piece of information to consider when selecting drives to bring:
          https://forum.defcon.org/node/220674...786#post221786 (2015, 6 years ago from 2021):
          "I heard from the Data Village folks running the machines that the WD RED drives had the most compatibility problems with the (older) tower dupers but worked fine in the newer desktop 1:5 dupers."
          So, assuming WD RED drives are still available for sale, it may be good to choose some other 6TB drives.

          More advice: upgrade the firmware on your drives before you bring them.
          One other question. Does it matter on whether or not it is an internal drive or an external drive? I see the pics with internal drives. Should I plan on bringing internal rather than external?

          Comment


          • #6
            Yes, SATA III, preferably 7200 RPM
            PGP Key: https://defcon.org/html/links/dtangent.html

            Comment


            • #7
              umm and a Form Factor of 3.5

              Comment


              • The Dark Tangent
                The Dark Tangent commented
                Editing a comment
                Correct!
                Let me see if I can dig up previous years announcements on the forums.

              • The Dark Tangent
                The Dark Tangent commented
                Editing a comment
                i just updated the top post with more details, I hope that answers all your questions.

            • #8
              thanks DT got my SATA drives will travel!!

              Comment


              • #9
                One last question...maybe. Other than the proper drives and updated firmware, do I need any other items? For example, will I need a SATA cable to connect to the drive or will that be a part of the duplicators?

                Comment


                • The Dark Tangent
                  The Dark Tangent commented
                  Editing a comment
                  Nope the drives swap into the duplicators, no cables needed.

              • #10
                Yeah, I have another question. I have the aforementioned WD RED drives. Do I need to format them or just bring them straight out of the box?

                Comment


                • number6
                  number6 commented
                  Editing a comment
                  It depends on what you mean by format. There is a concept of a legacy "low level format" and then there is a concept of changing the disk format from 512 byte sectors to 4k sectors, then there is the concept of formatting a "RAID Volume" (sometimes called initialization), and then we have the concept of formatting a disk with a filesystem.

                  From the to-post:
                  Originally posted by Dark Tangent View Post
                  ...
                  WHAT YOU NEED
                  * 6TB SATA3 512e format 7200rpm drive - one for each source you want
                  Many modern 6TB and larger drives support 512/512e and 4k sector format. (512 bytes per disk sector vs 4096 bytes per disk sector.)
                  Present advice is this:
                  * Unbox, and upgrade (HDD) Hard Disk Drives to latest firmware available.
                  * Make sure the disks are set to use 512e and NOT 4k sector format. (If not 512/512e, then change to 512/512e.)
                  * Maybe complete some vendor provided HDD tests to confirm the disks are good after any changes.
                  * Bring the disks with you and complete the process to drop them off and pick them up from the DDV (Data Duplication Village.)
                  * Avoid bringing used disks. If you only have used disks, make sure to scrub the disks of any RAID information stored on them and maybe zero-them out, then complete a full disk check. The process to zero out RAID data from a disk varies RAID controller vendor and disk vendor. If nobody has ever used your disks as part of a RAID array, then this shouldn't be needed.

                  Comments:
                  * Software designed to allow you to change the HDD sector size (512 vs 4k) usually include a kind of quick-format of the disk to support it.
                  * Not all disks support both 512/512e and 4k: some disks are only 512, and some disks will only be 4k.
                  * Changing the sector size of HDD usually results in total loss of data on the HDD.
                  * You do not need to format a filesystem (FAT-16, FAT32, NTFS, ZFS, EXT2, EXT3, ResierFS, etc.) as the "source" disks have a filesystem format already, and that format will be written to the "destination" disks receiving a copy from the source.

                  HTH
                  Last edited by number6; July 18, 2021, 20:16.

              • #11
                Number6, thank you so much!! I appreciate the information. This is exactly what I was looking for. I will admit, my knowledge of HDD's has deteriorated considerably since I do not handle them as much as I used to. It has been a few decades since I have done such items (think back to when 256GB internal drives were cutting edge and not SSD). I have learned something new today. Awesome!!!

                Comment


                • number6
                  number6 commented
                  Editing a comment
                  This is kind of how dial-up BBS worked way back when... when questions came up, people that knew something about it could reply. People could help each other. Often good questions helped everyone learn something new. Everyone has knowledge about different topics, and a way to pay back shared knowledge is to share knowledge and contribute ideas to discussions. (Granted, it was never any kind of Utopia, as people resorted to Ad Hominem attacks, argued about opinions/preferences which are almost never changed through argument, and there was lots of bad information too.)
                  Happy to help. Good luck!

              • #12
                Ahhh...the BBS days....that brings back good memories (and bad).

                Comment


                • #13
                  I'm building the master drives now, and once done I'll update what is on them with some more info.

                  Remember, no Fry's Electronics to purchase disks in Vegas, bring your disks.
                  PGP Key: https://defcon.org/html/links/dtangent.html

                  Comment


                  • #14
                    And we're live! The DDV is now taking in drives for duplication! Drop 'em off and get 'em done!

                    Comment

                    Working...
                    X