Thanks for the answers so far.

What I've found out is that I can do a workaround by outputting the message via the processing console instead of the Arduino serial monitor.

Also as a workaround I've made up some "number codes" in the arduino code that signal specific events. These numbers (9090 or 1010) will never show up naturally in the timer, so I used those to signal processing the start of the game, or if the playerd responded to early. Also added some code to play sounds. I don't know if this is the most elegant or efficient way. What do you think?

Arduino:

/* REACTION TIME (with 2 leds) v1.0
 *  Luis Andrés Gonzalez
 * Reaction time original version from http://www.instructables.com/id/Arduino-Reaction-Time-Tester/?ALLSTEPS
 * Send data to processing via the Serial Port original from By Elaine Laguerta http://url/of/online/tutorial.cc
*/
int switchPin = 6;  // pin where the button will be connected
int ledPin1 = 2 ;   // LED that signals starting of the game
int ledPin2 = 8 ;   // LED that lights to test the reaction time

// declare some variables:
boolean lastButton = LOW;
boolean currentButton = LOW;
boolean Started = false;
boolean timer = false;
long startTime;
long endTime;
int randomTime;
long beginTime;
float elapsedTime;


void setup()
{
  // Setup button and LEDs:
  pinMode(switchPin, INPUT);
  pinMode(ledPin1, OUTPUT);
  pinMode(ledPin2, OUTPUT);

  // Begin serial communication
  Serial.begin(9600);
}
boolean debounce(boolean last)
{
  boolean current = digitalRead(switchPin);
  if(last != current)
  {
    delay(5);
    current = digitalRead(switchPin);
  }
  return current;
}


void loop()
{
  // see if button pressed
  currentButton = debounce(lastButton);
  if(lastButton == LOW && currentButton == HIGH)
  {
    if(Started==false){
      Started=true;
      randomTime = random(4,10);
      randomTime = randomTime*1000;
      Blink();
      Serial.println("9090"); // signal code for start sound
      beginTime=millis(); 
      
    }
    else{
      if((millis()-beginTime)>=randomTime){
          Stop();
          Started=false; 
          timer=false;         
      }
      
      else{
        Started=false;
        timer=false;
        Serial.println("1010"); // signal code for early response
        for(int i=0; i<3; i++){
          Blink();
        }
      }
    }
  }
     
  lastButton = currentButton;
  
  if(Started == true && (millis()-beginTime)>=randomTime && timer==false){
    //Serial.println("Start");
    timer=true;
    Start();
  }
}
  





void Start(){
  startTime = millis();
  digitalWrite(ledPin1, HIGH);
}

void Blink(){
  digitalWrite(ledPin2, HIGH);
  delay(100);
  digitalWrite(ledPin2, LOW);
  delay(100);
}

void Stop(){
  endTime = millis();
  elapsedTime = (endTime - startTime)+5;
  elapsedTime = elapsedTime/1000;
  //Serial.print("Time Seconds: ");
  Serial.println(elapsedTime);
  digitalWrite(ledPin1, LOW);
   
}

Processing:

/** 
 REACTION TIME GAME v 1.0
 Adapted by code made by Elaine Laguerta  
 by Luis Andrés Gonzalez, January 2016
 
 Reads reaction time from Arduino over the serial port and save it to .csv file on your computer.
 The .csv file will be saved in the same folder as your Processing sketch.
 This sketch assumes that values read in seconds by Arduino are separated by a newline character.
 Special code numbers are specified to signal the game start, success and failure of accomplishing the task. 
 Each reading will have it's own row and timestamp in the resulting csv file. This sketch will write a new file each day.   
 
 The hardware:
 * A pushbutton connected to Arduino input pins
 * Arduino connected to computer via USB cord
 
 The software:
 *Arduino IDE
 *Processing (download the Processing software here: https://www.processing.org/download/
 *The corresponding arduino code
 
 */

import processing.serial.*;
import ddf.minim.*;
import ddf.minim.ugens.*;

Minim minim;
AudioOutput out;

Serial myPort; //creates a software serial port on which you will listen to Arduino
Table table; //table where we will read in and store values. You can name it something more creative!

int numReadings = 1; //keeps track of how many readings you'd like to take before writing the file. 
int readingCounter = 0; //counts each reading to compare to numReadings. 

// Serial code numbers for specific events
int startCode = 9090; // code for game start
int earlyCode = 1010; // code for early button press

String fileName;

void setup() {
  String portName = Serial.list()[1]; 
  //CAUTION: your Arduino port number is probably different! Mine happened to be 1. Use a "handshake" sketch to figure out and test which port number your Arduino is talking on. A "handshake" establishes that Arduino and Processing are listening/talking on the same port.
  //Here's a link to a basic handshake tutorial: https://processing.org/tutorials/overview/

  // SOUND setup:
  minim = new Minim(this);
  out = minim.getLineOut();
  out.setTempo( 80 );
  out.pauseNotes();
  // end SOUND setup.

  myPort = new Serial(this, portName, 9600); //set up your port to listen to the serial port

  table = new Table(); 
  table.addColumn("id"); //This column stores a unique identifier for each record. We will just count up from 0 - so your first reading will be ID 0, your second will be ID 1, etc. 

  //the following adds columns for time. You can also add milliseconds. See the Time/Date functions for Processing: https://www.processing.org/reference/ 
  table.addColumn("year");
  table.addColumn("month");
  table.addColumn("day");
  table.addColumn("hour");
  table.addColumn("minute");
  table.addColumn("second");

  //the following are dummy columns for each data value. Add as many columns as you have data values. Customize the names as needed. Make sure they are in the same order as the order that Arduino is sending them!
  table.addColumn("sensor1");
}

void serialEvent(Serial myPort) {

  String val = myPort.readStringUntil('\n'); //The newline separator separates each Arduino loop. We will parse the data by each newline separator. 

  if (val!= null) { //We have a reading! Record it.
    val = trim(val); //gets rid of any whitespace or Unicode nonbreakable space

    if (float(val) == startCode) {
      out.playNote( 0.0, 0.4, "C3" );
      out.playNote( 0.2, 0.2, "C4" );
      out.resumeNotes();
    } else if (float(val) == earlyCode) {
      println("You pressed the button too early!");
      out.playNote( 0, 2, "A1");
      out.resumeNotes();
    } else {
      print("Your reaction time was: ");
      println(val); 
      out.playNote( 0, 0.2, "C4");
      out.playNote( 0.2, 0.2, "C4");
      out.playNote( 0.4, 0.2, "C4");
      out.resumeNotes();
    } 

    float sensorVal = float(val); //parses the packet from Arduino and places the valeus into the sensorVals array. I am assuming floats. Change the data type to match the datatype coming from Arduino. 

    if (sensorVal != startCode) { // avoids start code to get recorded
      TableRow newRow = table.addRow(); //add a row for this new reading
      newRow.setInt("id", table.lastRowIndex());//record a unique identifier (the row's index)

      //record time stamp
      newRow.setInt("year", year());
      newRow.setInt("month", month());
      newRow.setInt("day", day());
      newRow.setInt("hour", hour());
      newRow.setInt("minute", minute());
      newRow.setInt("second", second());

      //record sensor information. Customize the names so they match your sensor column names. 
      if (float(val) == earlyCode) {
        newRow.setString("sensor1", "early");
      } else {
        newRow.setFloat("sensor1", sensorVal);
      }

      readingCounter++; //optional, use if you'd like to write your file every numReadings reading cycles
    }
    //saves the table as a csv in the same folder as the sketch every numReadings. 
    if (readingCounter % numReadings ==0){//The % is a modulus, a math operator that signifies remainder after division. The if statement checks if readingCounter is a multiple of numReadings (the remainder of readingCounter/numReadings is 0)
      fileName = "data/" + str(year()) + str(month()) + str(day()) /*+" - " + str(table.lastRowIndex())*/ + ".csv"; //this filename is of the form year+month+day+readingCounter
      saveTable(table, fileName); //Woo! save it to your computer. It is ready for all your spreadsheet dreams.
    }
  }
}

void draw()
{ 
  //visualize your sensor data in real time here! In the future we hope to add some cool and useful graphic displays that can be tuned to different ranges of values.
}

Hello, glad to meet you all, this is my first post. I'm trying to setup a CSV file logging, in order to record some reaction time responses coming from arduino. So far i've managed to tweak some codes i've found in the internets and managed to get them to work sepparately: the first one (arduino side) measures the reaction time and prints it in the serial ("Your reaction time was:"). A different, processing code receives some data (button pressed or not) and logs it into a CSV file. The problem is, that this code will write ANY line that comes from the serial, which leaves no room for me to send useful message to the user (like "you pressed the button too early!").

**tl;dr **

Is there a way that I can modify the processing code to filter just the seconds of the reaction time instead of every line that comes from the serial?

Below there are 3 blocks of code:

1) the arduino code that i want to implement,

2) the processing code,

3) and the original arduino code meant for the processing code.

Arduino code so far:

(more readable pastebin here http://pastebin.com/Ej6jt6RZ)

 /* REACTION TIME (with 2 leds) v1.1
  *  Luis Andrés Gonzalez
  * Reaction time original version from http://www.instructables.com/id/Arduino-Reaction-Time-Tester/?ALLSTEPS
  * Send data to processing via the Serial Port original from By Elaine Laguerta http://url/of/online/tutorial.cc
 */
 int switchPin = 6;  // pin where the button will be connected
 int ledPin1 = 2 ;   // LED that signals starting of the game
 int ledPin2 = 8 ;   // LED that lights to test the reaction time
 
 // declare some variables:
 boolean lastButton = LOW;
 boolean currentButton = LOW;
 boolean Started = false;
 boolean timer = false;
 long startTime;
 long endTime;
 int randomTime;
 long beginTime;
 float elapsedTime;
 
 
 void setup()
 {
   // Setup button and LEDs:
   pinMode(switchPin, INPUT);
   pinMode(ledPin1, OUTPUT);
   pinMode(ledPin2, OUTPUT);
 
   // Begin serial communication
   Serial.begin(9600);
 }
 boolean debounce(boolean last)
 {
   boolean current = digitalRead(switchPin);
   if(last != current)
   {
     delay(5);
     current = digitalRead(switchPin);
   }
   return current;
 }
 
 
 void loop()
 {
   // see if button pressed
   currentButton = debounce(lastButton);
   if(lastButton == LOW && currentButton == HIGH)
   {
     if(Started==false){
       Started=true;
       randomTime = random(4,10);
       randomTime = randomTime*1000;
       Blink();
       beginTime=millis(); 
       
     }
     else{
       if((millis()-beginTime)>=randomTime){
           Stop();
           Started=false; 
           timer=false;         
       }
       
       else{
         Started=false;
         timer=false;
         Serial.println("You pressed the button too soon !");
         for(int i=0; i<3; i++){
           Blink();
         }
       }
     }
   }
      
   lastButton = currentButton;
   
   if(Started == true && (millis()-beginTime)>=randomTime && timer==false){
     Serial.println("Start");
     timer=true;
     Start();
   }
 }
   
 
 
 
 
 
 void Start(){
   startTime = millis();
   digitalWrite(ledPin1, HIGH);
 }
 
 void Blink(){
   digitalWrite(ledPin2, HIGH);
   delay(100);
   digitalWrite(ledPin2, LOW);
   delay(100);
 }
 
 void Stop(){
   endTime = millis();
   elapsedTime = (endTime - startTime)+5;
   elapsedTime = elapsedTime/1000;
   Serial.print("Time Seconds: ");
   Serial.println(elapsedTime);
   digitalWrite(ledPin1, LOW);
    
 }

Processing code:

(http://pastebin.com/EjEcuqct)

 
 /* 
   Saving Values from Arduino to a .csv File Using Processing - Pseduocode
 
   This sketch provides a basic framework to read data from Arduino over the serial port and save it to .csv file on your computer.
   The .csv file will be saved in the same folder as your Processing sketch.
   This sketch takes advantage of Processing 2.0's built-in Table class.
   This sketch assumes that values read by Arduino are separated by commas, and each Arduino reading is separated by a newline character.
   Each reading will have it's own row and timestamp in the resulting csv file. This sketch will write a new file a set number of times. Each file will contain all records from the beginning of the sketch's run.  
   This sketch pseduo-code only. Comments will direct you to places where you should customize the code.
   This is a beginning level sketch.
 
   The hardware:
   * Sensors connected to Arduino input pins
   * Arduino connected to computer via USB cord
         
   The software:
   *Arduino programmer
   *Processing (download the Processing software here: https://www.processing.org/download/
   *Download the Software Serial library from here: http://arduino.cc/en/Reference/softwareSerial
 
   Created 12 November 2014
   By Elaine Laguerta
   http://url/of/online/tutorial.cc
 
 */
 
 import processing.serial.*;
 Serial myPort; //creates a software serial port on which you will listen to Arduino
 Table table; //table where we will read in and store values. You can name it something more creative!
 
 int numReadings = 5; //keeps track of how many readings you'd like to take before writing the file. 
 int readingCounter = 0; //counts each reading to compare to numReadings. 
  
 String fileName;
 void setup()
 {
   String portName = Serial.list()[1]; 
   //CAUTION: your Arduino port number is probably different! Mine happened to be 1. Use a "handshake" sketch to figure out and test which port number your Arduino is talking on. A "handshake" establishes that Arduino and Processing are listening/talking on the same port.
   //Here's a link to a basic handshake tutorial: https://processing.org/tutorials/overview/
   
   myPort = new Serial(this, portName, 9600); //set up your port to listen to the serial port
   table = new Table(); 
   table.addColumn("id"); //This column stores a unique identifier for each record. We will just count up from 0 - so your first reading will be ID 0, your second will be ID 1, etc. 
   
   //the following adds columns for time. You can also add milliseconds. See the Time/Date functions for Processing: https://www.processing.org/reference/ 
   table.addColumn("year");
   table.addColumn("month");
   table.addColumn("day");
   table.addColumn("hour");
   table.addColumn("minute");
   table.addColumn("second");
   
   //the following are dummy columns for each data value. Add as many columns as you have data values. Customize the names as needed. Make sure they are in the same order as the order that Arduino is sending them!
   table.addColumn("sensor1");  
 
 }
 
 void serialEvent(Serial myPort){
   String val = myPort.readStringUntil('\n'); //The newline separator separates each Arduino loop. We will parse the data by each newline separator. 
   if (val!= null) { //We have a reading! Record it.
     val = trim(val); //gets rid of any whitespace or Unicode nonbreakable space
     println(val); //Optional, useful for debugging. If you see this, you know data is being sent. Delete if  you like. 
     int sensorVals = int(val); //parses the packet from Arduino and places the valeus into the sensorVals array. I am assuming floats. Change the data type to match the datatype coming from Arduino. 
    
     TableRow newRow = table.addRow(); //add a row for this new reading
     newRow.setInt("id", table.lastRowIndex());//record a unique identifier (the row's index)
     
     //record time stamp
     newRow.setInt("year", year());
     newRow.setInt("month", month());
     newRow.setInt("day", day());
     newRow.setInt("hour", hour());
     newRow.setInt("minute", minute());
     newRow.setInt("second", second());
     
     //record sensor information. Customize the names so they match your sensor column names. 
     newRow.setInt("sensor1", sensorVals);
     
     
     readingCounter++; //optional, use if you'd like to write your file every numReadings reading cycles
     
     //saves the table as a csv in the same folder as the sketch every numReadings. 
     if (readingCounter % numReadings ==0)//The % is a modulus, a math operator that signifies remainder after division. The if statement checks if readingCounter is a multiple of numReadings (the remainder of readingCounter/numReadings is 0)
     {
       //saveTable(table, "data/new.csv");
       fileName = "data/" + str(year()) + str(month()) + str(day()) + str(table.lastRowIndex()) + ".csv"; //this filename is of the form year+month+day+readingCounter
       saveTable(table, fileName); //Woo! save it to your computer. It is ready for all your spreadsheet dreams. 
     }
    }
 }
 
 void draw()
 { 
    //visualize your sensor data in real time here! In the future we hope to add some cool and useful graphic displays that can be tuned to different ranges of values. 
 }

The original Arduino code meant for the processing code above:

(http://pastebin.com/qQF7YbYN)

/*
Sending Data to Processing via the Serial Port
This sketch provides a basic framework to send data from Arduino to Processing over a Serial Port. This is a beginning level sketch.

Hardware:
* Sensors connected to Arduino input pins
* Arduino connected to computer via USB cord

Software:
*Arduino programmer
*Processing (download the Processing software here: https://www.processing.org/download/

Additional Libraries:
*Read about the Software Serial library here: http://arduino.cc/en/Reference/softwareSerial

Created 12 November 2014
By Elaine Laguerta
http://url/of/online/tutorial.cc
*/

/*To avoid overloading the Arduino memory, and to encourage portability to smaller microprocessors, this sketch
does not timestamp or transform data. In this tutorial, timestamping data is handled on the processing side.

Whether you process data on the Arduino side is up to you. Given memory limitations of the Arduino, even a few computations and mapping of values can
max out the memory and fail. I recommend doing as little as possible on the Arduino board.*/

//#include SoftwareSerial.h

/*Declare your sensor pins as variables. I'm using Analog In pins 0 and 1. Change the names and numbers as needed
Pro tip: If you're pressed for memory, use #define to declare your sensor pins without using any memory. Just be careful that your pin name shows up NOWHERE ELSE in your sketch!
for more info, see: http://arduino.cc/en/Reference/Define
*/
int sensor1Pin = 6;


/*Create an array to store sensor values. I'm using floats. Floats use 4 bytes to represent numbers in exponential notation. Use int if you are representing whole numbers from -32,768 to 32,767.
For more info on the appropriate data type for your sensor values, check out the language reference on data type: http://arduino.cc/en/Reference/HomePage
Customize the array's size to be equal to your number of sensors.
*/
/*
 * Prueba de dejar esto afuera
 float sensorVals[] = {0,0,0}
*/
/*Pro tip: if you have a larger number of sensors, you can use a for loop to initialize your sensor value array. Here's sample code (assuming you have 6 sensor values):
float sensorVals[6];
int i;
for (i=0; i<6; i++)
{
sensorVals[i] = 0;
}
*/

void setup(){
Serial.begin(9600); //This line tells the Serial port to begin communicating at 9600 bauds
}

//
void loop(){
//read each sensor value. We are assuming analog values. Customize as nessary to read all of your sensor values into the array. Remember to replace "sensor1Pin" and "sensor2Pin" with your actual pin names from above!
int sensorVal = digitalRead(sensor1Pin);

/*If you are reading digital values, use digitalRead() instead. Here's an example:
sensorVal[0] = digitalRead(sensor1Pin);
*/

//print over the serial line to send to Processing. To work with the processisng sketch we provide, follow this easy convention: separate each sensor value with a comma, and separate each cycle of loop with a newline character.
//Remember to separate each sensor value with a comma. Print every value and comma using Serial.print(), except the last sensor value. For the last sensor value, use Serial.println()
//Serial.print(sensors[0]);
//Serial.print(",");
//Serial.print(sensors[1]);
//Serial.print(",");
Serial.println(sensorVal);
delay(1000);
}

the image is just a reference of the european map to place the 'countries'. the csv is a spreadsheet that contains ("year","origin","destination","gender","","value") and its values

Thank you for all of the feedback and suggestions. The size of the dataset I am trying to analyze is approximately 10K X 10K X 10K points over thousands of years. I realize starting with this dataset is ridiculous, so I am starting with a very small subset.

The polygons (cubes at this stage) have different colors on each face for easy HUMAN visual interaction. The polygons rotate in different directions resulting from interactions from neighboring polygons. I realize that rendering all of the points as the full polygon (cube or other) they represent is not necessary for ALL of the points, I am also trying to figure out how to show the 99% of the cubes that are close enough as simple colored points of the color facing the camera, and as they come into view of sufficient closeness, they will be rendered as a polygon.

The PRIMARY setup of the cloud will be reading the data in from a database/spreadsheet and instantiating the environment. As points are influenced, they will change their rotations (therefore changing their properties and color).

The reason for the visualization is that we (the team) theorize that similar to sound waves, as we change the orientation of cubes, their rotation may/will change neighboring cubes and cause waves of some type to ripple for given distances across the world. One of the issues is that rotating a blue-facing red-topped cube clockwise will have a different affect in its neighbors that a yellow-facing red-topped cube will, etc. With the amount of data, looking at just the numbers is impossible, and requires some type of visual analysis.

I currently use PeasyCam for zooming around/through the world and have started seeing trends, but due to the size of the world, I keep running out of memory. The manipulation of the data happens on a 64GB RAM drive independent of the visualization using a different program, so that is the easy part. When I want to render the entire world and fly through/around it, that is where the problems pop up. I am assuming that if I use an Octree system with culling and some other type of graphics area selection, I can load the section that I am actually viewing into the GPU and select elements from that point. This is all a work in progress and I appreciate all of the input.

Blindfish: you are absolutely correct in your analysis also. The first step is to set up the simulation and watch for waves and trends by flying around and through the world until we see a wave/trend that we want more details on. As we see them, we would stop the time factor and click on one of the particular polygons of interest, to get the identifier for that element, time iteration, and X/Y/Z rotation parameters. by knowing this, we could redo the simulation and concentrate on just that area to understand more of what is going on, including exporting smaller datasets for more detailed analysis.

Any and all additional thought/comments are appreciated.

I mean each row in the spreadsheet points to a place on the screen eg.

0,0,0 1,-7,-43 2, -6.5, -57 3,-6.697, -66.536 4, -7.295, -76.951

and so on for 2000 rows. I wanted to use processing to link the points together with lines (like dot-to-dot) and yes the columns have headlines (time, x-value, y-value). I managed to create ellipses using these values but it was with a copy and paste not loadTable so the code is very long.

I'm afraid I don't understand what you mean by copying "19 test lines for the points and 19 excel lines for the connecting lines?" Sorry if I'm missing something bleedingly obvious, as I said I have no experience with coding (still watching the tutorials).

Hi! I know this is probably very simple but I am trying to work out how I can visualize a set of data with points and lines connecting the points as they progress (2000+ lines worth). The data is on an excel spreadsheet and the values range from around -680 to 190 on the y-axis and -150 to 240 on the x-axis. I want the coordinates 0,0 to be in the center.

I have no experience with code and am seriously struggling to find tutorials online that apply. Cheers

I'm trying to connect to a google spreadsheet but am having problems with the authentication. I have read access to the spreadsheet but when I try connecting to it I get: ERROR IN AUTHENTICATION

This is my code: `//This is the Google spreadsheet manager and the id of the spreadsheet that we want to populate, along with our Google username & password SimpleSpreadsheetManager sm; String sUrl = "1iKKDYwIzByzdoAMLwIlqY5aRdTjNtykAcD39z0uMVGM"; String googleUser = "user"; String googlePass = "pass";

void setup() { size(800,800); sm = new SimpleSpreadsheetManager(); sm.init("RandomNumbers", googleUser, googlePass); sm.fetchSheetByKey(sUrl, 0);

}

void draw() {

} `

` import com.google.gdata.client.spreadsheet.*; import com.google.gdata.data.*; import com.google.gdata.data.spreadsheet.*; import com.google.gdata.util.*;

import java.io.BufferedReader; import java.io.IOException; import java.io.InputStreamReader; import java.io.PrintStream; import java.net.URL; import java.util.HashMap; import java.util.List; import java.util.Map;

import java.util.Set;

public class SimpleSpreadsheetManager {

SpreadsheetService myService; SpreadsheetEntry spreadsheetEntry; SpreadsheetFeed sheetFeed; WorksheetEntry worksheetEntry;

List spreadsheets;

String user; String pass;

ListFeed currentListFeed; CellFeed currentCellFeed; List currentCells; List currentListEntries;

int currentTotalRows; int currentTotalCols;

String currentTitle; String[] tagArray;

URL listFeedUrl;

SimpleSpreadsheetManager() {

};

void init(String sessionName, String u, String p) { user = u; pass = p; myService = new SpreadsheetService(sessionName); try { myService.setUserCredentials(user, pass); } catch (Exception e) { println("ERROR IN AUTHENTICATION"); };

};

ListFeed fetchSheetByKey(String k, int wi) {

ListFeed f = new ListFeed();
CellFeed cf = new CellFeed();
WorksheetFeed w = new WorksheetFeed();

//GET WORKSHEETS FEED
try {
  URL worksheetFeedUrl = new URL("http://spreadsheets.google.com/feeds/worksheets/" + k + "/private/full");
  WorksheetFeed wf2 = new WorksheetFeed();
  w = myService.getFeed(worksheetFeedUrl, wf2.getClass());
}
catch(Exception e) {
  println("ERROR RETRIEVING WORKSHEET FEED");
};

List worksheets = w.getEntries();
WorksheetEntry we = (WorksheetEntry) worksheets.get(wi);   
println("RETRIEVED WORKSHEET " + we.getTitle().getPlainText()); 

//GET LIST FEED URL
try {
  listFeedUrl = we.getListFeedUrl();//new URL("http://spreadsheets.google.com/feeds/list/" + k + "/od6/private/full");
  ListFeed lf2 = new ListFeed();
  f = myService.getFeed(listFeedUrl, lf2.getClass());
}
catch(Exception e) {
  println("ERROR RETRIEVING LIST FEED");
};

//GET CELL FEED
try {
  URL cellFeedUrl = we.getCellFeedUrl();//new URL("http://spreadsheets.google.com/feeds/cells/" + k + "/od6/private/full");
  CellFeed lf2 = new CellFeed();
  cf = myService.getFeed(cellFeedUrl, lf2.getClass());

}
catch(Exception e) {
  println("ERROR RETRIEVING LIST FEED");
};

currentListFeed = f;
currentCellFeed = cf;
currentCells = cf.getEntries();
currentListEntries = f.getEntries();

currentTitle = we.getTitle().getPlainText();
currentTotalRows = currentListEntries.size();

if (currentListEntries.size() > 0) { ListEntry le = (ListEntry) currentListEntries.get(0);
currentTotalCols = le.getCustomElements().getTags().size();

Set<String> tags = le.getCustomElements().getTags();
tagArray = new String[tags.size()];
tagArray = tags.toArray(tagArray);

};

return(f);

};

String getCellValue(int c, int r) {

ListEntry le = (ListEntry) currentListEntries.get(r);    
Set<String> tags = le.getCustomElements().getTags();
String[] tagArray = new String[tags.size()];
tagArray = tags.toArray(tagArray);

return(le.getCustomElements().getValue(tagArray[c]));

};

String getCellValue(String tag, int r) {

ListEntry le = (ListEntry) currentListEntries.get(r);    
return(le.getCustomElements().getValue(tag));

};

void setCellValue(String tag, int r, String val) {

ListEntry le = (ListEntry) currentListEntries.get(r);    
le.getCustomElements().setValueLocal(tag, val);
try {
  ListEntry updatedRow = le.update();
}
catch (Exception e){

};

};

void setNewCellValue(String tag, int r, String val) {

ListEntry le = new ListEntry();  

try {
 le.getCustomElements().setValueLocal(tag, val);
 ListEntry insertedRow = myService.insert(listFeedUrl, le);
  ListEntry updatedRow = insertedRow.update();
}
catch (Exception e){

};

};

};`

Hi,

I would like to refine my question.

I just want to create table, as we see in excel. ( with row & col). You can say spreadsheet.

Where i can add data in fields in real time.

just like data base.

In a prior Upwork project I worked with a developer to analyze some text to understand the most important nouns in that text. Now I need a Processing script that will allow me to:

• Play with visualizing the results, and
• Export them to a PDF for playing with further in Illustrator or Sketch

I'm beyond my Processing skill level to create it, but I think if someone else did it and commented it well, I might be able to modify it. Having no luck with Upwork candidates who know Processing, so turning here.

The script would:

• Let me input the URL of the shared Google Spreadsheet
• Generate an adjacency diagram based on the noun hyponym trees in WordNet
• Generate an icicle diagram based on the same data
• Fill in the cells of the diagrams per the data in the Google Spreadsheet
• Let me play with variables to adjust the visuals of the output
• Export the resulting diagram to a basic PDF

See descriptions about these two adjacency diagrams down on the page at Washington.edu.
See one example of an adjacency diagram here.

This is a paid project, but I have no idea how complicated this is. If you are interested, please DM me with your sense of how long it would take, and what your hourly rate would be. Thanks!

Although QScript and Jasmine both evaluate expressions and algorithms they are NOT related in any way.

The power of Jasmine is its speed, it is thousands of times faster that QScript but to achieve that speed means that it is not possible to extend it by simply adding classes.

For a third party to extend Jasmine they would need to have

1) good knowledge of OO / Java

2) basic knowledge of Java byte code instructions

3) basic knowledge of Java class file structure (that's the compiled code not Java source code)

4) how to use the ASM library to create Java byte code.

to extend QScript you only needed (1)

Given these restrictions it will not be possible to create an extensible Jasmine :{

I must confess that I originally had no plans to create Jasmine. I discovered ASM over 12 months ago and I was intrigued with the idea of being able to modify compiler Java classes at run-time. ASM has a very steep learning curve and I must admit I couldn't get my head round it.

A few months ago I revisited ASM and took the plunge and printed out the library guide for it (all 170 or so pages). I was interested in the idea of creating a profiling tool for Processing and thought ASM might be up to the task. Jasmine is the by-product of me trying to learn to program with ASM.

I hope you enjoy using it, I am semi-seriously considering to use a modified version of it with G4P to create a simple spreadsheet control. :-?

Hi all,

I've been working with Google Sheets, which has a nicely documented API here: https://developers.google.com/google-apps/spreadsheets/#introduction

It works quite well, but I've read some commentary that Microsoft's Excel possesses greater power for in spreadsheet functions than Google's Sheets app. I haven't been able to find as well documented an API for Microsoft's Office 365.

Has anyone worked with Office 365 (specifically spreadsheets) in processing, and if so, where did you read up on how to implement the Office 365 API?

Many thanks!

Hi All--

I am trying to interact with a Google spreadsheet using processing. I had this working 10 months ago but now I can't seem to get it going again. I'm using the following info:

blog.blprnt.com/blog/blprnt/open-science-h1n1-processing-and-the-google-spreadsheet-api

https://developers.google.com/google-apps/spreadsheets/?csw=1

makezine.com/2010/12/10/save-sensor-data-to-google-spreadsh/

As a test, I'm using the code posted in the last link, with the lines associated with reading a sensor with an Arduino commented out:

    import com.google.gdata.client.spreadsheet.*;
    import com.google.gdata.data.*;
    import com.google.gdata.data.spreadsheet.*;
    import com.google.gdata.util.*;

    import processing.serial.*;

    import java.io.BufferedReader;
    import java.io.IOException;
    import java.io.InputStreamReader;
    import java.io.PrintStream;
    import java.net.URL;
    import java.util.HashMap;
    import java.util.List;
    import java.util.Map;
    import java.util.Set; 


    // Variables structures for google spreadsheet API
    SpreadsheetService service;  //Holds link to all your spreadsheets
    WorksheetEntry worksheet;  //Holds link to the sensor log spreadsheet
    String uname = "<user_name>";  //Your google account user name
    String pwd = "<password>";  //Your google account password
    String spreadsheet_name = "<spreadsheet_name>";  //Name of the spreadsheet you want to write data to.  Must match exactly, including case.
    int spreadsheet_idx = 0; //Index for the "sensor log spreadsheet


    //Variables for writing sensor data
    //Serial port;  // Create object from Serial class
    int oldTime;  //timer variable
    int reportingInterval = 4000;  //Number of miliiseconds between when sensor data is recorded

    // Sends the data to the spreadsheet
    void transmitData(float val) {
      String date = day() + "/" + month() + "/" + year();  //Build the current date
      String time = hour() + ":" + minute() + ":" + second(); //Build the current time
      try {
         //Create a new row with the name value pairs
         ListEntry newEntry = new ListEntry();    
         newEntry.getCustomElements().setValueLocal("date", date);
         newEntry.getCustomElements().setValueLocal("time", time);
         newEntry.getCustomElements().setValueLocal("reading", Float.toString(val));
         //Write it out to the google doc
         URL listFeedUrl = worksheet.getListFeedUrl();
         ListEntry insertedRow = service.insert(listFeedUrl, newEntry);
      } catch (Exception e) {
         println(e.getStackTrace());
      }  
    }


    void setup() {
      //Set up the serial port to read data
      //This code comes from example 11-8 of Getting Started with Processing
      //String arduinoPort = Serial.list()[0];
      //port = new Serial(this, arduinoPort, 9600);
      oldTime = millis();
      //Set up the google spreadsheet
      service = new SpreadsheetService("test");
      try {
         service.setUserCredentials(uname,  pwd);
         // Search for the spreadsheet named we're looking for
         // Note that according to the documentation you should be able to include the key in the URL, but I 
         // was unable to get this to work.  It looked like there was a bug report in.
         // As a work around, this code pulls a list of all the Spreadheets in your acocunt and searches for the
         // one with the matching name.  When it finds it, it breaks out of the loop and the index is set
         URL feedURL = new URL("http://spreadsheets.google.com/feeds/spreadsheets/private/full/");   
         SpreadsheetFeed feed = service.getFeed(feedURL, SpreadsheetFeed.class);
         for (SpreadsheetEntry entry: feed.getEntries()) {
           if (entry.getTitle().getPlainText().equals(spreadsheet_name) ) {
             break;
           } 
           spreadsheet_idx += 1;
         }   
         //Fetch the correct spreadsheet
         SpreadsheetEntry se = feed.getEntries().get(spreadsheet_idx); //Fetch the spreadsheet we want
         worksheet = se.getWorksheets().get(0);  //Fetch the first worksheet from that spreadsheet
         println("Found worksheet " + se.getTitle().getPlainText());

      } catch (Exception e) {
        println(e.toString());
      }
    }

    //Reads the port everye few seconds and sends the data back to Google
    void draw() {
      float val = 0.0;
      //if (port.available() > 0) { // If data is available,
        //val = port.read();        // read it and store it in val
      //}
      //Determine if we need to report the level
      if ((millis() - oldTime) > reportingInterval) {
        oldTime = millis();
        transmitData(val);
      }      
    }

I added the import.java....lines to fix one problem. To get this working, a Google spreadsheet must be created and the username, password and spreadsheet name must be entered in the code. Additionally, the 4 .jar files mentioned in the last link must be added to the sketch. It should write the value "0.0", along with the date and time, to the spreadsheet every 2 seconds. I was able to get it working before but now it doesn't and I can't find the problem. I get an "Invalid Credentials" error at the start and I have checked my credentials several times. Any ideas?

Yes, thats correct. The bigger the building, the smaller the radius of the circle representing it. The data is simply a spreadsheet with two columns - First column is a list of building names and beside that is a column with the heights in metres.

Hello,

I have the following loop:

    for (TableRow row : table.rows()) {

        x = row.getInt("Height");
        ellipse(0,0,x,x);

    };

In this loop x is taken from a spreadsheet showing the height of 50 buildings sorted from highest to smallest.

At the moment the size of the circle is determined by the size of each building so the higher the building, the bigger the circle.

The output image is 50 concentric circles. I am trying to change the sketch so that the biggest building = the smallest circle (like contour lines). Because there is no pattern in the building heights the circles are not evenly spaced and I cant work out how to keep swap the circles around (small-hight / large=low) and keep the circles spaced correctly.

I hope this makes sense, thanks!

Hello, I am having some difficulty with this loop, the objective is:

Draw a circle of 23 small ellipses. And each time one is drawn, the fill colour is taken from a column in a spreadsheet. So the ellipses should each be either green or blue depending on the contents of the spreadsheet column. At the moment however, all the ellipses are the same colour.

Table table;
int i=0;
float radius=300;
int numPoints=23;
float angle=TWO_PI/(float)numPoints;

String green = "Green";
String blue = "Blue";



 for (TableRow row : table.rows()) {
    myColor = row.getString("Colour");
    if (myColor.equals(green) == true) {
      fill(//green);
    }

     if (myColor.equals(blue) == true) {
      fill(//blue);
    }

    else {
      fill(//red);
    }

    while (i<=numPoints) {
      ellipse(radius*sin(angle*i), radius*cos(angle*i), 20, 20);
      i=i+1;
    }

Hello, I am trying to work out how to find the number of times a specific word appears in a string. I have been using this code which works in some cases:

 if( sheetData.indexOf(wordToFind) != -1){
 println("I HAVE FOUND wordToFind");
 i= i+1;
  println(i);
}

i is declared as a global variable

int i;

The reason this isnt working in come cases is because it is inside a for loop which sets up the string from a spreadsheet

for (TableRow row : table.rows()) {

}

So essentially the if statement is looking at the string row by row and if it finds the correct substring it is adding 1 to i. The problem with this is that it is only taking into account whether or not the desired substring is apparent and NOT taking into account the number of times it actually appears.

Hopefully that makes sense, any help is much appreciated!

Hello,

I am trying to find a way of counting the number of times a specific string appears within a spreadsheet (.csv file). I think it might involve a for loop that looks at the content of each cell but I could be wrong.

Any help would be much appreciated!

Hello,

I am trying to find a way to get data from a spreadsheet in Google Sheets into processing so that I can then use the data to generate something. I have found a few examples on the web however none of them seem to work - this may be because they are all a few years old so the code might be out of date.

(http://blog.blprnt.com/blog/blprnt/open-science-h1n1-processing-and-the-google-spreadsheet-api)

If someone could point me in the right direction then that would be excellent.

Thanks

Hey Everyone,

I was just attempting to access a new spreadsheet using Jer Thorps Simple Spreadsheet manager which he uses in a few tutorials - for example http://blog.blprnt.com/blog/blprnt/open-science-h1n1-processing-and-the-google-spreadsheet-api

&

http://blog.blprnt.com/blog/blprnt/your-random-numbers-getting-started-with-processing-and-data-visualization

I have used this code sucsessfully in the past on a number of occasions to access data in google spreadsheets, but I am having a very hard time accessing NEW spreadsheets using the code. Apparently the URL for sheets has changed slightly they no longer have the tag "key" in their URLS here is an old example

https://docs.google.com/spreadsheet/ccc?key=0AqmozCajcOz-dEhWWG1nc0pmYjlJalBhM1puMVRFVFE&usp=d.......

Now they look like this

https://docs.google.com/spreadsheets/d/1VI60CNwcZrl6z0ddTXYVLB1RDcasu2jzQXLBRjbx01Y/edit#gid=2103258622

But supposedly the access should be the same we just take the key after /d/ and before /edit - in the new URL.

Has anyone had any issues with this. I assume it has something to do with slightly changed functions, as opposed to the key per say. I can still scrape all the old URL's that have "key" in them but if I try and acrape any new URL I get the following error.

[Fatal Error] :1:1: Premature end of file. Oct 09, 2014 2:19:07 PM com.google.gdata.util.LogUtils logException WARNING: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 1; Premature end of file. Message: Premature end of file.

I mostly fumble my way through things, as you can probably see. If I had the skills I could probably re edit Jer's spreadsheet manager.

Thanks for any help

Cheers TIm

Let me try again (sorry for not properly reading the newbie notes)

<< copied>> Hi, GoToLoop &c

Thanks for the encouragement. I've been away from this project the past few days but am now ready to begin converting to the use of ArrayLists.

I'll comment here that I do not import any libraries in this sketch. I have relied heavily on the P2 classes as has been discussed. In short, the sketch reads data from two files. One holds financial data that my colleague wants to visualize through applying animation and other viz cues. The other provides dimensional information about the layout of the shapes that indicators will move along to implement the animation. I want my client to be able to fine tune, and thought that an input data file formatted as a spreadsheet would be a more effective way of making changes than asking them to learn processing itself.

I've set virtually all the variables as global at this point -- just a few specialized cases where I pass variables.

I've implemented a lot of user interaction through defining buttons, and also manage the placement of those within the sketch through IntLists. The number of buttons is determined from the content of the data file. Since I want my colleague to be able to alter the number of entries or substitute different versions of the data file, I chose to work with the List classes.

I also experimented with a FloatDict, but recognized that it is not at all an essential element of the sketch.

// Variables for managing the input data: financial and structural Table finData, finDataHeaders, trailData; StringList finHeaders, yearID, compID, startStr, endStr, modeID; IntList pathID, arcDirID, pathArc; FloatList radiusID, startID, endID;

Here's selected lines from setup().

void setup() {
        size(600,400); 
        frameRate(1);  
       background(0, 0, 125);

  // Instantiate the variables needed to make sense of the financial and trail data        
        yearID = new StringList(); 
        compID = new StringList(); 
        modeID = new StringList(); 
        pathID = new IntList(); 
        pathArc = new IntList(); 
        radiusID = new FloatList(); 
        arcDirID = new IntList(); 
        startID = new FloatList(); 
        endID = new FloatList();

  // Financial data input occurs in evalData(), found on the functions tab 
        trailData = loadTable("trailData.csv","csv, header"); 
        // inputs to draw trail 
        evalTrailData(); 
        //println(yearID); 
        evalData(); 
        spaces = new FloatDict(); 
        setSpaces();

Thanks again ~