Resuming quest to open a massive text file

[Aeolwind]

Originally Posted by feanan [You must be logged in to view images. Log in or Register.]

glogg

http://glogg.bonnefon.org/

Promising.

[norova]

Haven't had to open anything larger than 1GB with this, but try SublimeText

[Ephi]

Originally Posted by norova [You must be logged in to view images. Log in or Register.]

Haven't had to open anything larger than 1GB with this, but try SublimeText

Sublime will choke on a large file (loads it all into memory). [You must be logged in to view images. Log in or Register.]

I usually just use less, but then again I'm assuming unix commands don't count.

[Sadre Spinegnawer]

I do hope you realize some of us are masturbating to this thread. Just sayin.

[Aeolwind]

Originally Posted by Sadre Spinegnawer [You must be logged in to view images. Log in or Register.]

I do hope you realize some of us are masturbating to this thread. Just sayin.

3rd bout of trying to open this thing. No one is jonesing for climax more than me I don't think. It will need to be sanitized obviously to protect the innocent.

Unix commands scare me on this file. They corrupted a copy.

[August]

The problem with trying to load a file such as this is that most programs are going to load the entirety of the file into memory. How much memory do you have? IF its not significantly over 4GB, you're hosed.

You could also just stop trying to find the solution and create one yourself:

void ReadAndWrite()
{
System.IO.StreamReader InFile= new System.IO.StreamReader("c:\\myeqlog.txt");



for(int n=0; n<1000; n++)
{
System.IO.StreamWriter OutFile= new System.IO.StreamWriter(@"C:\MyEQLog"+n);
Count = 0;
while((line = file.ReadLine()) != null && Count <1000)
{
Outfile.WriteLine (line);
Count ++;
}
OutFile.Close();
}
InFile.Close();
}

This is purely from general memory. Basically, open a stream on the file. Read in 1000 lines, output a thousand lines, increment your logname - rinse and repeat. This will let you choose how large of file chunks you want ( by changing count). You probably also need to generate a new file name somewhat diffrerently - i'm not sure the way i did it would compile and I'm lazy.

-Tomtee

[webrunner5]

What about some compression zip file scheme? Backed up of course.

[nilbog]

http://www.gdgsoft.com/files/gsplits.exe download and install, when prompted, choose to integrate into shell
step 1. make a copy of the file you're working on. create a new folder for testing (i.e. desktop /txttest) paste copy of original there
step 2. load the copy using the menu to the left on gsplit. Original File option
step 3. destination folder. i used the same one i put the copy in
step 4. type and size. size 20.00 in MB
step 5. filenames, you can use your own naming. want .txt. under piece name mask: disk{num}.txt
step 6. split file!

Would try this

[August]

Originally Posted by nilbog [You must be logged in to view images. Log in or Register.]

http://www.gdgsoft.com/files/gsplits.exe download and install, when prompted, choose to integrate into shell
step 1. make a copy of the file you're working on. create a new folder for testing (i.e. desktop /txttest) paste copy of original there
step 2. load the copy using the menu to the left on gsplit. Original File option
step 3. destination folder. i used the same one i put the copy in
step 4. type and size. size 20.00 in MB
step 5. filenames, you can use your own naming. want .txt. under piece name mask: disk{num}.txt
step 6. split file!

Would try this

Definitely try this. More than likely a program that does something similar (and much more sophisticated) than the sample above.

[Lyra]

Originally Posted by Aeolwind [You must be logged in to view images. Log in or Register.]

It will need to be sanitized obviously to protect the innocent.

This thread made me uncomfortable. What server were you on?