Resuming quest to open a massive text file

[Unfadable]

Originally Posted by sawin [You must be logged in to view images. Log in or Register.]

I also have been looking for a program to open very large files. I have considered using http://www.ultraedit.com/

There is a trial and it boasts the capacity to edit files over 4GB. I wish I could recommend it, but as I haven't yet tried it I'm unsure how well it would work for you.

Use this at work and works well. I think the largest file I've opened with it was a 2.5gig csv file.

[Adachi]

Under Unix you can use the split command.

split -l 1000000 file.txt

This would split the file every 1,000,000 lines into files named 'xaa', 'xab', 'xac', etc..

And if you need to rejoin the files after editing them, simply use 'cat'

cat xaa xab xac > newfile.txt

But if you just want to view the file, I'm pretty sure 'less' would work.

Oh, and vim > *
[You must be logged in to view images. Log in or Register.]

[Hackscendence]

Line breaks are still line breaks when the file is converted to CSV.

Copy file, paste somewhere, change extension to CSV, Use This, set max number of lines per file to whatever you'd prefer, convert resulting file extensions back to txt.

[webrunner5]

I think if he breaks the files up this thing is never going to work. Like has been said one stupid corrupt sector and yarcarbluee. [You must be logged in to view images. Log in or Register.] This needs to be transfered complete.

[SirAlvarex]

I concur with everyone suggesting "less." It works by buffering segments of the file and does not edit it. I use it to view multi-gb files all the time.

Although split does seem like a nice command.

In less you can search through the file with "/" and a regex. Although on a 4GB file that might not be most idea lol. Just use grep for that.

[Aeolwind]

[Wed Jul 31 21:56:37 2002] Gazgaz tells the guild, 'Me slowed uz The Idol of Rallos Zek'
[Wed Jul 31 21:56:37 2002] Raelven tells the guild, 'weakened'
[Wed Jul 31 21:56:37 2002] Karitta tells the guild, '#8 Comple healing ------> Sarsippius #8'
[Wed Jul 31 21:56:37 2002] Hoozyur tells the guild, 'get The Idol of Rallos Zek a wheelchair, his ass is CRIPPLED'
[Wed Jul 31 21:56:37 2002] Tuan tells the guild, '[1] --CH-- Sarsippius'
[Wed Jul 31 21:56:37 2002] Teer tells the guild, '#2 CH <<< Sarsippius >>> #2~~~~~~~~ #2 ~~~~~~~~~ #2'
[Wed Jul 31 21:56:37 2002] Tomatos tells the guild, 'Elixier on Sharlene for Assist Heal, Wating for Big Heal !!'
[Wed Jul 31 21:56:40 2002] Welcome to EverQuest!
[Wed Jul 31 21:56:40 2002] You have entered Nektulos Forest.
[Wed Jul 31 21:56:41 2002] GUILD MOTD: Dabiggun - CT, Creator and HP PWNED!!!! AoW NOW!
[Wed Jul 31 21:56:41 2002] Autojoining channels...

Just at taste

[liveitup1216]

Originally Posted by Aeolwind [You must be logged in to view images. Log in or Register.]

[Wed Jul 31 21:56:37 2002] Gazgaz tells the guild, 'Me slowed uz The Idol of Rallos Zek'
[Wed Jul 31 21:56:37 2002] Raelven tells the guild, 'weakened'
[Wed Jul 31 21:56:37 2002] Karitta tells the guild, '#8 Comple healing ------> Sarsippius #8'
[Wed Jul 31 21:56:37 2002] Hoozyur tells the guild, 'get The Idol of Rallos Zek a wheelchair, his ass is CRIPPLED'
[Wed Jul 31 21:56:37 2002] Tuan tells the guild, '[1] --CH-- Sarsippius'
[Wed Jul 31 21:56:37 2002] Teer tells the guild, '#2 CH <<< Sarsippius >>> #2~~~~~~~~ #2 ~~~~~~~~~ #2'
[Wed Jul 31 21:56:37 2002] Tomatos tells the guild, 'Elixier on Sharlene for Assist Heal, Wating for Big Heal !!'
[Wed Jul 31 21:56:40 2002] Welcome to EverQuest!
[Wed Jul 31 21:56:40 2002] You have entered Nektulos Forest.
[Wed Jul 31 21:56:41 2002] GUILD MOTD: Dabiggun - CT, Creator and HP PWNED!!!! AoW NOW!
[Wed Jul 31 21:56:41 2002] Autojoining channels...

Just at taste

Is it harder to go through those logs with or without a massive erection.

[Thulack]

So who gets the reward for the right program? [You must be logged in to view images. Log in or Register.] Grats on getting it to work.

[getsome]

I hope you had your filters off.

[azxten]

Put your file on a linux system.

split -l 10000 filename

This will split your file every 10000 lines into files xaa, xab, etc. I can give you a more sophisticated command if you'd like that names the files according to the timestamps at the start or whatever.

Use the operating system where everything is a file if you're working with files.