|
|
Post by AnthroHeart on May 23, 2021 12:40:47 GMT
When creating the NESTFILES.ZIP, these are two filesizes I have gotten:
1000X1000 = 1,000 Files x 1,000 Intentions per File = 194kB.
1000X10000 = 1,000 Files x 10,000 Intentions per File = 457kB.
Reden, can you provide some of your file sizes for different options?
When my server is provisioned, after I get bugs worked out, I'll work on creating larger ones.
|
|
|
|
Post by reden on May 23, 2021 13:26:36 GMT
Some of the filesizes:
100k (thousand) files, 10000 Repeats=300 something MB uncompressed, 48-50 MB compressed, 1.7-2 MB ultra compressed (which, because of laziness, is compressing the compressed file with tar with the xz option, so it's compressed once, repacked once and then compressed again).
10k files, 1M (million) Repeats=150-151 GB uncompressed (that's what 7zip reported), 300 or so MB compressed.
100k files, 1M Repeats=Still being made, using the Nesting Utility's auto compression, so no uncompressed size will be available.
10k files, 100 Repeats=Forgot its size, but it must not be that much.
Random big files=Some of them were up to 1 GB uncompressed.
|
|
|
|
Post by AnthroHeart on May 23, 2021 16:42:10 GMT
Cool, when you figure the auto compression all out, let me know.
I am doing well in the next version, just some more bugs to do
and I'm taking a break.
|
|
|
|
Post by reden on May 24, 2021 2:27:03 GMT
Here is one of my Nesting Files. It is 10k files with 1 million Repeats each. I double compressed it with xz. I am not sure if it still works or if you need to extract the zip first. Edit: I believe that it is 1^4 million zeros. |
|
|
|
Post by AnthroHeart on May 24, 2021 2:48:53 GMT
Here is one of my Nesting Files. It is 10k files with 1 million Repeats each. I double compressed it with xz. I am not sure if it still works or if you need to extract the zip first. Edit: I believe that it is 1^4 million zeros. I don't know, but just looking at the link and not even downloading it feels some pretty strong power. So not really sure. If we can do that, then maybe it could keep being compressed in a loop until it no longer gets smaller. But not sure. You can get MD5 of a file to see if it has changed. |
|
|
|
Post by reden on May 24, 2021 2:58:25 GMT
Here is one of my Nesting Files. It is 10k files with 1 million Repeats each. I double compressed it with xz. I am not sure if it still works or if you need to extract the zip first. Edit: I believe that it is 1^4 million zeros. I don't know, but just looking at the link and not even downloading it feels some pretty strong power. So not really sure. If we can do that, then maybe it could keep being compressed in a loop until it no longer gets smaller. But not sure. You can get MD5 of a file to see if it has changed. Many files stop getting compressed after just one pass. It is not the case with text. One tar'ing to order the file (.xz files do exist but many utilities, people etc. expect tar.xz) and one xz slashed the sizes down incredibly massively. So efficient. |
|
|
|
Post by AnthroHeart on May 24, 2021 3:14:43 GMT
What if instead of NEST-30.TXT we had like N30.TXT?
Would that save space over the 1000's?
|
|
|
|
Post by reden on May 24, 2021 3:27:15 GMT
What if instead of NEST-30.TXT we had like N30.TXT? Would that save space over the 1000's? Yes. And removing the skipped line too For instance do this: "N30.TXT N30.TXT" And so on. Try it to see if it works fully. |
|
|
|
Post by AnthroHeart on May 24, 2021 3:31:08 GMT
What if instead of NEST-30.TXT we had like N30.TXT? Would that save space over the 1000's? Yes. And removing the skipped line too For instance do this: "N30.TXT N30.TXT" And so on. Try it to see if it works fully. I'm not sure I get what you mean by skipped line. |
|
|
|
Post by reden on May 24, 2021 3:45:20 GMT
Yes. And removing the skipped line too For instance do this: "N30.TXT N30.TXT" And so on. Try it to see if it works fully. I'm not sure I get what you mean by skipped line. Some of my older NEST files were like "NEST-55544.TXT NEST-55544.TXT NEST-55544.TXT" And so on. But I see that newer ones don't have this skipped line. And that's good, because one enter/return key is actually one more character. |
|
|
|
Post by reden on May 25, 2021 18:24:08 GMT
Here's another of my Nesting Files. 10k files with 1M Repeats except on NEST-0.TXT which has 10M. It now references hash.txt. Edit: It now references the proper hash. |
|
|
|
Post by hambumger1 on May 25, 2021 19:44:26 GMT
Do you think that instead of replacing the previous Zip files with the new one in the Holo-Link to strengthen it, it would make it even more powerful if we put both of the Zip files in there?
|
|
|
|
Post by reden on May 25, 2021 20:14:24 GMT
Do you think that instead of replacing the previous Zip files with the new one in the Holo-Link to strengthen it, it would make it even more powerful if we put both of the Zip files in there? Perhaps. |
|
|
|
Post by reden on May 25, 2021 20:18:57 GMT
AnthroHeart can you tell me if those super compressed files feel as strong to you as the zips? Because if so then I can remove the tar part and leave them as zip.xz's.
|
|
|
|
Post by AnthroHeart on May 25, 2021 20:28:23 GMT
AnthroHeart can you tell me if those super compressed files feel as strong to you as the zips? Because if so then I can remove the tar part and leave them as zip.xz's. Ok, tell me clearly which TWO you want me to compare, and I will give you my input. |
|
