visualizing big text file

General Discussion Other

telmo.bac..

in General Discussion • Other • 9 months ago

Hi, im new with processing, i would like to make an app that visualize a text file.

My txt file is very big , ithas a lot of data (text).
I need to dynamically generate different kind of visualizationg based on that txt file.

I was wondering which is the best approach for this ( when i have big .txt file) . Is it a good approach to visualizate my data reading directly from the txt file or should be a better to use a database?

Is there any benefit of using database in terms of speed and efficiency? or should not be difference?

thanks

Telmo

Replies(3)

amnon.owed

Re: visualizing big text file

9 months ago

You don't mention how big.

You can use loadStrings to load a text file. Just try it. Make sure to load the file in setup().

The benefit of using a text file is that it's really easy and no other preperations are necessary.

telmo.bac..

Re: visualizing big text file

9 months ago

Hi amnon, do you want to know the number of characters? o how big is the file?

the text file is 5 mb.

PhiLho

Re: visualizing big text file

9 months ago

It is relatively big, but for a modern Java application, it isn't that big: you can easily slurp it in one gulp.
Even with standard memory settings, you can use loadStrings() to read it.
Example with a 15 MB database dump:

String[] lines = loadStrings("DB-20121226.sql");
println(lines.length);
int size = 0;
for (String line : lines)
{
size += line.length();
}
println(size);

Displays 71458 and 15410898...

Top Reply