Data Duplication Village

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • number6
    404 Image not found
    • Apr 2019
    • 2172

    #1

    Data Duplication Village

    .
    Click image for larger version  Name:	ddv.webp Views:	402 Size:	4.4 KB ID:	248951







    .
    Data Duplication Village

    The Data Duplication Village has all the updated bits and bytes available from infocon.org packed up into nice, neat packages. If you're looking for a copy of all the things, we've got what you need to fill up all your storage including a few nice hash tables and all of the DefCon talks. Add to that just about every other security con talk known to hacker-kind! Our village provides a "free-to-you" service of direct access to terabytes of useful data to help build those hacking skills and talk with other storage enthusiasts.

    Check the schedule and/or dcddv.org for the most up-to-date information.

    HOW IT WORKS
    The DDV provides a core set of drive duplicators and data content options. We accept 8TB and larger drives on a first come, first served basis and duplicate 'till we can no longer see straight. Bring in your blank SATA3 drives - check them in early - to get the data you want. Come back in about 24 hours to pick up your data-packed drive. Space allowing, we'll accept drives all the way through until Saturday morning - but remember, it's FIFO - get those drives in early!

    WHAT YOU GET
    We're working on more content right up until the last minute so keep checking on dcddv.org for the latest. This year, we're adding new data to duplicate! Humans will be able to choose from the following data sources for duplication:

    A) Infocon.org Archive - 6TB archive of all the past hacking convention videos that DT could find, built on last years collection and always adding more for your data consuming appetite.
    B) Rainbow tables 1 of 3 - 6TB from freerainbowtables.com, the Lanman, MSQLSHA1, and NTLM hash tables plus freerainbowtables.com tools
    C) Rainbow tables 2 of 3 - 6TB from freerainbowtables.com, the A5/1 GSM, and MD5 tables plus freerainbowtables.com tools
    D) Vx Underground Archive - 8TB archive of the latest papers, samples, and code from Vx Underground
    E) Rainbow tables 3 of 3 - 8TB of New NTLM-9 hash tables and a copy of the Infocon.org mirrors

    Website: https://dcddv.org
    Discussion Forum: https://forum.defcon.org/node/248949
    .
    .
    Last edited by number6; July 31, 2024, 20:43.
  • number6
    404 Image not found
    • Apr 2019
    • 2172

    #2
    Content altered, Saturday, June 15, 2024 by direction from organizers or department heads.
    Last edited by number6; June 15, 2024, 19:55.

    Comment

    • number6
      404 Image not found
      • Apr 2019
      • 2172

      #3
      Content altered again, June 16, 2024.

      Comment


      • KnightOwl
        KnightOwl commented
        Editing a comment
        Actually - yet another update to the content. The VXUG drive also requires an 8TB drive. Please make a note of this.
    • PaperHandedApe
      Member
      • Jul 2024
      • 2

      #4
      Can more than one dataset be duplicated to a drive? E.g., can I grab a rainbow table, and the VXUG dataset on one drive provided it is large enough?

      Comment


      • KnightOwl
        KnightOwl commented
        Editing a comment
        Only 1 source per physical drive. The duplicators replace the partition table and use the first partition as the destination for the data from the source.
    • number6
      404 Image not found
      • Apr 2019
      • 2172

      #5
      Originally posted by PaperHandedApe
      Can more than one dataset be duplicated to a drive? E.g., can I grab a rainbow table, and the VXUG dataset on one drive provided it is large enough?
      I do not work DDV (Data Duplication Village) so nothing I write is authoritative.

      History is that whole disks are imaged to be as fast as possible.
      History is that this is not a file-based copy which is often much slower.
      Even if you have a larger disk, with each re-image (assuming ti worked) a new disk image being written would just overwrite whatever was on your larger hard disk, from start of disk until image was writen.

      If you had your own computer and a way to connect hard drives to it, and someone else got copies of all of the disks, and they trust you, you could probably connect your very large drive to your computer and each of the imaged drives, then copy all of the files from each to the very large disk, but who will trust you with their drives and who wants to sit around for hours waiting for a many TB of data to be copied as files?

      The DDV people are unlikely to give you their "reference disks" as that could allow the data on them to be tampered with, risking other people not getting what they expected.
      Other attendees that don't know you might also disagree with lending you their disks for risk their contents might be altered.

      The best way for this to work, and have the best chance of success if getting as many of the requested sized drives to the DDV and getting images copied to each by the people that work then DDV.

      It is possible someone that works the DDV may reply. If they provide any information that contradicts mine, go with what they claim.

      Good luok!
      Last edited by number6; July 1, 2024, 14:16.

      Comment

      • PaperHandedApe
        Member
        • Jul 2024
        • 2

        #6
        Fantastic, thank you for the detailed reply.

        Comment

        • KnightOwl
          Goon
          • Jul 2016
          • 30

          #7
          number6 - Thanks for the reply. You're correct. The copy is a block/partition level copy that will replace the contents of the disk with the source partition.

          PaperHandedApe - If you're looking for specific files, the sources are coming from Infocon.org. Have at it!

          -KO

          Comment

          • Runfl@
            Member
            • Jul 2024
            • 2

            #8
            First timer here so please be gentle,

            Do I need to bring seperate drives for all the content or will the 8TB collection be the 'all in one' option?

            Just trying to plan ahead so need to know how many drives to bring lol.

            Comment

            • number6
              404 Image not found
              • Apr 2019
              • 2172

              #9
              Originally posted by Runfl@
              First timer here so please be gentle,

              Do I need to bring seperate drives for all the content or will the 8TB collection be the 'all in one' option?

              Just trying to plan ahead so need to know how many drives to bring lol.
              Again, I am not an organizer for this event. Nothing I write is authoritative for the Data Duplication Village.

              in this post https://forum.defcon.org/node/248950...013#post250013 I provided an answer about using a very large disk to contain all of the 8TB disk images.
              The implication is each collection/set is stored on and requires a different disk; not one disk.

              Last year, each collection was on a different disk. This year the claim is 8TB disk, with the implication of one 8TB disk per collection would be required.

              From the top post:

              Originally posted by number6
              ...
              HOW IT WORKS
              The DDV provides a core set of drive duplicators and data content options. We accept 8TB and larger drives on a first come, first served basis and duplicate 'till we can no longer see straight. Bring in your blank SATA3 drives - check them in early - to get the data you want. Come back in about 24 hours to pick up your data-packed drive. Space allowing, we'll accept drives all the way through until Saturday morning - but remember, it's FIFO - get those drives in early!

              WHAT YOU GET
              We're working on more content right up until the last minute so keep checking on dcddv.org for the latest. This year, we're adding new data to duplicate! Humans will be able to choose from the following data sources for duplication:

              A) Infocon.org Archive - 6TB archive of all the past hacking convention videos that DT could find, built on last years collection and always adding more for your data consuming appetite.
              B) Rainbow tables 1 of 3 - 6TB from freerainbowtables.com, the Lanman, MSQLSHA1, and NTLM hash tables plus freerainbowtables.com tools
              C) Rainbow tables 2 of 3 - 6TB from freerainbowtables.com, the A5/1 GSM, and MD5 tables plus freerainbowtables.com tools
              D) Vx Underground Archive - 6TB archive of the latest papers, samples, and code from Vx Underground
              E) Rainbow tables 3 of 3 - 8TB of New NTLM-9 hash tables and a copy of the Infocon.org mirrors

              Website: https://dcddv.org
              Discussion Forum: https://forum.defcon.org/node/248949
              The implication is that there are 5 "sets" to choose from [A, B, C, D, E] as listed above.
              It is possible the sizes of "A", "B" and "C" may change in size with more stuff added up to 8TB.

              It is likely that the above claims of 6TB for "A", "B", "C", "D" may be TB in the form of "1TB = 2^40 bytes = 1099511627776 bytes" while hard drive and storage makers generally compute TB in the form "1TB = 10^12 bytes = 1000000000000 bytes" which could mean a HHD claiming 6TB might not have enough space to store 6*1099511627776 bytes.
              This means it is probably a bad idea to assume a 6TB drive will work. Stick with the advice provided: one good, blank, 8TB SATA3 drive (or larger) per collection/set. (Text from announcement in THIS YEAR says, "We accept 8TB and larger drives" and does not mention drive sizes of 6TB.)

              Historically, you would bring a number of disks matching their posted requirements for the year (a) "8TB and larger drives" , (b) "blank SATA3 drives" , (c) "check them in early"
              Historically, if you only brought 1 disk, then you would specify which collection you wanted on that disk (this year, examples to choose from: "A", "B", "C", "D", "E".) If you brought 2 disks, you would specify which 2 collections you wanted copied to those 2 disks (one collection/set per disk.) If you brought as many disks as there were collections, you could specify one copy of each collection on each of the disks.

              It is possible someone that works the DDV may reply. If they provide any information that contradicts mine, go with what they claim.
              Last edited by number6; July 4, 2024, 11:49.

              Comment

              • Runfl@
                Member
                • Jul 2024
                • 2

                #10
                Thanks number6.

                I'll bring a couple of drives 🍻

                Comment

                • number6
                  404 Image not found
                  • Apr 2019
                  • 2172

                  #11
                  Originally posted by Runfl@
                  Thanks number6.

                  I'll bring a couple of drives 🍻
                  If a couple means 2 and they are at least 8TB size or larger blank SATA3 drives, then assuming it works like previous years, on check-in of drives, you will need to specify which 2 collections/sets want copied when you drop them off. Announcement says to drop them off early at the DDV

                  Previous years the organizers had support for checking ticket status on a DEF CON Discord server channel. I do not know the process and plans for this year.

                  Comment

                  • maxcurrent
                    Member
                    • Jul 2024
                    • 1

                    #12
                    What is the difference between Drive A (2024 Archive of Infocon.org) and Drive E (NTLM-9 has tables and copy of infocon.org mirrors). Is drive E the same as drive A plus the NTLM-9 hashes? Or does drive E have different stuff from infocon.org?

                    Comment


                    • number6
                      number6 commented
                      Editing a comment
                      I am not an organizer for the DDV, so you will have to wait for someone that is making the reference disks or working the Data Duplication Village to answer.
                      I can write that as of "now" the Rainbow Tables NTLM-9 references disks are 8TB as is the VX Underground reference disk. This could change between now and DEF CON 32, but probably won't.
                      8TB disks are to be expected because in the top post there is this quote: "We accept 8TB and larger drives"
                      Last edited by number6; July 14, 2024, 20:02.

                    • KnightOwl
                      KnightOwl commented
                      Editing a comment
                      maxcurrent - the infocon.org mirrors are a small portion of infocon.org. We opted to move it to the NTML disk to keep the Infocon disk at 6TB. That data is also available online (infocon.org/mirrors)
                  • number6
                    404 Image not found
                    • Apr 2019
                    • 2172

                    #13
                    Originally posted by number6
                    .
                    Click image for larger version Name:	ddv.webp Views:	402 Size:	4.4 KB ID:	248951








                    .
                    Data Duplication Village

                    The Data Duplication Village has all the updated bits and bytes available from infocon.org packed up into nice, neat packages. If you're looking for a copy of all the things, we've got what you need to fill up all your storage including a few nice hash tables and all of the DefCon talks. Add to that just about every other security con talk known to hacker-kind! Our village provides a "free-to-you" service of direct access to terabytes of useful data to help build those hacking skills and talk with other storage enthusiasts.

                    Check the schedule and/or dcddv.org for the most up-to-date information.

                    HOW IT WORKS
                    The DDV provides a core set of drive duplicators and data content options. We accept 8TB and larger drives on a first come, first served basis and duplicate 'till we can no longer see straight. Bring in your blank SATA3 drives - check them in early - to get the data you want. Come back in about 24 hours to pick up your data-packed drive. Space allowing, we'll accept drives all the way through until Saturday morning - but remember, it's FIFO - get those drives in early!

                    WHAT YOU GET
                    We're working on more content right up until the last minute so keep checking on dcddv.org for the latest. This year, we're adding new data to duplicate! Humans will be able to choose from the following data sources for duplication:

                    A) Infocon.org Archive - 6TB archive of all the past hacking convention videos that DT could find, built on last years collection and always adding more for your data consuming appetite.
                    B) Rainbow tables 1 of 3 - 6TB from freerainbowtables.com, the Lanman, MSQLSHA1, and NTLM hash tables plus freerainbowtables.com tools
                    C) Rainbow tables 2 of 3 - 6TB from freerainbowtables.com, the A5/1 GSM, and MD5 tables plus freerainbowtables.com tools
                    D) Vx Underground Archive - 8TB archive of the latest papers, samples, and code from Vx Underground
                    E) Rainbow tables 3 of 3 - 8TB of New NTLM-9 hash tables and a copy of the Infocon.org mirrors

                    Website: https://dcddv.org
                    Discussion Forum: https://forum.defcon.org/node/248949
                    .
                    .
                    ALERT! Content in top post has been changed. Not all disk copies required 8TB disks. See top post for details on which data sources need 6TB vs 8TB for 2024 and DEF CON 32.
                    Last edited by number6; July 31, 2024, 20:46.

                    Comment


                    • KnightOwl
                      KnightOwl commented
                      Editing a comment
                      Thank you for the update!
                  • whoisroot
                    Member
                    • Aug 2024
                    • 1

                    #14
                    Hi!

                    Does anyone knows if the NTLM-9 (drive E) also contains the 8 characters rainbowtable? And if so, is the 8 char covering the whole keyspace?

                    I couldn't find this information anywhere :/

                    Thanks!

                    Comment


                    • KnightOwl
                      KnightOwl commented
                      Editing a comment
                      Although I don't know off-hand if the 8 character tables are included in the dataset, but it looks like NTLM-9 tables (drive E) are using the ascii-32-95 character set:
                      !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~

                      -KO
                  Working...