#1
|
||||
|
Resuming quest to open a massive text file
It has been about 3 years since I last tried, I'm hoping a new program has popped up. I have a 4ish gb log file from EQ that I would like to open. Suggestions? Notepad++ chokes.
__________________
I have walked my way since the beginning of time. Sometimes I give, sometimes I take & it is mine to know which and when.
Quote:
| |||
|
#2
|
|||
|
What are you looking to do once you have it open?
I sometimes have to open logs that are a gig at work and used to use Dreamweaver to do so since I had it open anyways. It works but is slow as hell. Most likely, though, there is some upper bound to the amount of data that can be loaded. Getting good with the unix commands like grep, tail, etc, will be a big help for you in this right most likely. Regular expressions ftw!
__________________
Bush <Toxic>
Jeremy <TMO> - Patron Saint of Blue | ||
|
#3
|
|||
|
Could also break it up with a scripting language to smaller pieces.
| ||
|
#4
|
|||
|
I use Textpad for all of my text and small coding needs, but I've never had to open a file that big so I don't know how it would react. Your best bet, as other posters have said, is writing a program to break it up into smaller pieces or to just straightaway do whatever it is you need to do with it.
__________________
Member of <Divinity>
Estuk Flamebringer - 60 Gnomish Wizard | Kaam Armnibbler - 55 Ogre Shaman | Aftadae Roaminfingers - 54 Halfling Rogue Aftadai Beardhammer - 50 Dwarven Cleric | Aftae Greenbottom - 49 Halfling Druid Need a port or a rez? Hit me up on IRC! | ||
|
#5
|
|||
|
Unix less command?
How big you talkin'? You could write something small that pipes in X-Y indexed characters at a time to another text pad? | ||
|
#6
|
|||||
|
Quote:
Textpad chokes and dies. I'd tried breaking it down before, but it corrupted a copy in the process. Tried Dreamweaver as well and it tanked. Filesplitter exploded. Going to try Chainsaw.
__________________
I have walked my way since the beginning of time. Sometimes I give, sometimes I take & it is mine to know which and when.
Quote:
| ||||
|
#7
|
||||
|
Quote:
__________________
Lootenant Dan <Hierophant>
| |||
|
#8
|
|||
|
Scribd? Google docs? Might take forever to upload but if its online it might be easy to view.
| ||
|
#9
|
|||
|
I've opened files as large as 1.5gb with textpad. These same files crashed notepad, wordpad, notepad++, editplus. Have you tried gedit? Beyond that, I would consider trunchating the file.
It may sound strange, but have you considered reading the file into matlab? My large data files were CSV, but could you try reading it into a 1xsuperlong array in matlab? Could then manipulate the array into smaller arrays and output smaller text files.
__________________
| ||
|
#10
|
|||
|
| ||
|
|
|