Log data on a csv file, is it possible?

Programming Questions

secondsky

Log data on a csv file, is it possible?

in Programming Questions • 2 years ago

Hi all, I have a processing sketch who visualize some data in real time, sent from arduino on the serial port.

How can I, at the same time, log it all on a csv file?

Thank you!

Replies(10)

PhiLho

Re: Log data on a csv file, is it possible?

2 years ago

You probably need to use PrintWriter and createWriter.

akseidel

Re: Log data on a csv file, is it possible?

2 years ago

That happens to be what I am working on except that aspects of the data are saved to file at set intervals. This is the WriteData class for what it is worth.

// The FileRecorder writes/appends the interval data to the recorder tab delineated text file.

class FileRecorder{

String _filePathName;

String[] _textLine = new String[1];

void setFilePathName(String theFName){

_filePathName = theFName;

println("File record name is " + _filePathName);

}

void writeHeadLineTAB(){

_textLine[0] = "Date" + TAB + "Time" + TAB ;

_textLine[0] = _textLine[0] +"Sensor#" + TAB + "CurrentTemp" + TAB + "Height" + TAB ;

_textLine[0] = _textLine[0] + "IntervalMaxTemp" + TAB + "IntervalMinTemp" + TAB ;

_textLine[0] = _textLine[0] + "SessionMaxTemp" + TAB +"TimeSMax" + TAB + "DateSMax" + TAB ;

_textLine[0] = _textLine[0] + "SessionMinTemp" + TAB +"TimeSMin" + TAB + "DateSMin" + TAB ;

_textLine[0] = _textLine[0] + "SensorAddr" ;

if (_filePathName != null){

saveStrings(savePath(_filePathName), _textLine);

println("Wrote headline to " + savePath(_filePathName));

println(_textLine[0]);

}

void writeIntervalLines(){

PrintWriter pw = null;

for (int i = qtySensr-1; i > -1; i = i-1)

{

fill(0,255,0); // flash color when writing file

text("Record filename is " + savePath(theRecordFileName), edge,40);

String dataLine = Sensors[i].intervalRprt();

dataLine = dataLine.replaceAll(" ","\t");

println(dataLine);

if (savePath(_filePathName) != null){

try

{

pw = new PrintWriter(new BufferedWriter(new FileWriter(savePath(_filePathName), true))); // true means: "append"

pw.println(dataLine);

}

catch (IOException e){

// Report problem or handle it

e.printStackTrace();

}

finally{

if (pw != null){

pw.close();

}

fill(0,0,0);

}

tlerdrden

Re: Re: Log data on a csv file, is it possible?

1 year ago

HEY!!
I am really interested with your code because it could be very useful for my project.

I am getting some data from some Sensors and I would save it into a file...and maybe display it also.

Have you got any example?

Thank youu!

PhiLho

Re: Log data on a csv file, is it possible?

1 year ago

Well, perhaps you can read the whole thread...

mr_hacker..

Re: Log data on a csv file, is it possible?

1 year ago

hello. hi. i'm newbie in processing. i hope somebody can tell me. how the above program function.i'm in same condition with secondsky. currently i'm using arduino. using a sensor. to display a reading. then save the reading in csv format inside SD memory card. that's the part of arduino software. then, i used processing. to view the graph of the reading. save it in pdf form. the final part. to combine it together. the current issue when i run graph on processing, i cannot run the serial monitor of the arduino. vice versa. when i run serial monitor of arduino, i cannot run processing graph. i already have a look program above. but, i can't understand it very well. i realy hope somebody can tell me how the above program function. with all, regards. thank you.

PhiLho

Re: Log data on a csv file, is it possible?

1 year ago

Looking closer, the above code isn't very efficient as it opens and close the file on each written line in a loop...
In its essence, the appending to a file can be done with:

PrintWriter pw = null;
try
{
pw = new PrintWriter(new BufferedWriter(new FileWriter(filePath, true))); // true means: "append"
for (int i = 0; i < data.length; i++)
{
pw.println(data[i]);
}
}
catch (IOException e)
{
// Report problem or handle it
e.printStackTrace();
}
finally
{
if (pw != null)
{
pw.close();
}
}

mr_hacker..

Re: Log data on a csv file, is it possible?

1 year ago

this source code is not complete right? just a part of it. may i have a full one? so that i can try run it. so that i know how it works. thank you.

PhiLho

Re: Log data on a csv file, is it possible?

1 year ago

If you want, but you won't see much more code...

void setup()
{
String filePath = "H:/Temp/Test.csv"; // Obviously, change the path to adapt to your system
// First batch of data
String[] data1 =
{
"a,b,c",
"x,y,z"
};
appendToFile(filePath, data1);
// Second batch of data, to be appended after the first one
String[] data2 =
{
"1,2,3",
"11,22,33"
};
appendToFile(filePath, data2);
}
void appendToFile(String filePath, String[] data)
{
PrintWriter pw = null;
try
{
pw = new PrintWriter(new BufferedWriter(new FileWriter(filePath, true))); // true means: "append"
for (int i = 0; i < data.length; i++)
{
pw.println(data[i]);
}
}
catch (IOException e)
{
// Report problem or handle it
e.printStackTrace();
}
finally
{
if (pw != null)
{
pw.close();
}
}
}

mr_hacker..

Re: Log data on a csv file, is it possible?

1 year ago

thank you. thank you so much.

talamantez

Re: Log data on a csv file, is it possible?

1 year ago

This thread helped me build a logger. It is very concise. It is in the Arduino forum, but the code works in Processing too http://arduino.cc/forum/index.php/topic,39896.0.html .

Top Reply