Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

cedric.wa..

Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

in Contributed Library Questions • 1 year ago

Hi All,

I'm reading Ben Fry's book "Data visualization" and in Chapter 9 "Acquiring data" there's a section on Apache's HttpClient suite to easily download the content of a webpage.

The book provides the code, specifying that we first need to download three .jar files for the code to work properly. These files are available from Apache's HttpClient project webpage.

Ben then goes on to explain that we just need to put these .jar files into the same sketch folder containing our code and that it will work (he doesn't say we have to put the .jar files into the libraries folder).

Unfortunately I did exactly what he says but it doesn't work. I've got an error message telling me Processing can't find the libraries I'm trying to import:

import org.apache.commons.httpclient.*;

import org.apache.commons.httpclient.methods.*;

import org.apache.log4j.*;

Error message: "The package 'org.apache.commons' does not exist. You might be missing a library.

Can anyone help me with this?

Many thanks in advance

Replies(5)

calsign

Re: Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

1 year ago

Try putting them inside a folder called "code" in the sketch folder. This is fairly undocumented, but I think it works. The book is probably out of date...

PhiLho

Re: Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

1 year ago

As calsign said.
I think that alternatively, you can drag'n'drop the jars from some Explorer to the PDE window, it will put them automatically in the 'code' folder.

cedric.wa..

Re: Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

1 year ago

I tried putting the .jar files into a 'code' folder in the sketch folder, but it still doesn't work.

The .jar files are named as follows:

- commons-codec-1.6.jar

- commons-logging-1.1.1.jar

- fluent-hc-4.2.1.jar

- httpclient-4.2.1.jar

- httpclient-cache-4.2.1.jar

- httpcore-4.2.1.jar

- httpmime-4.2.1.jar

And the code is as follows:

import java.io.*;
import org.apache.commons.httpclient.*;
import org.apache.commons.httpclient.methods.*;
import org.apache.log4j.*;
import processing.core.*;
public class Browser {
PApplet parent;
HttpClient client;
String USER_AGENT = "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)";
public Browser(PApplet p) {
parent = p;
BasicConfigurator.configure();
Logger logger = logger.getRootLogger();
logger.setLevel(Level.FATAL);
client = new HttpClient();
client.getHttpConnectionManager().getParams().setConnectionTimeOut(5000);
}
public String load(String iurl) {
HttpMethod method = new GetMethod(iurl);
method.setRequestHeader(new Header("User-Agent", USER_AGENT));
String responseBody = null;
try {
client.executeMethods(method);
responseBody = method.getResponseBodyAsString();
} catch (HttpException he) {
System.err.println("HTTP error connecting to '" + iurl + "'");
System.err.println(he.getMEssage());
return null;
} catch (IOException ioe) {
System.err.println("Unable to connect to '" + iurl + "'");
return null;
}
method.releaseConnection();
return responseBody;
}
public void save(String url, String filename) {
String content = load(url);
if (content != null) {
parent.saveStrings(filename, new String[] { content });
}
}
}

PhiLho

Re: Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

1 year ago

Is that a .java file in your sketch folder? I suppose you have also a .pde file with the main sketch.
Have you still the same error?
The code folder is at the same level than your .pde file, right?

cedric.wa..

Re: Apache's HttpClient suite not working - Ben Fry's "Data visualization" chap. 9

1 year ago

Yes, this is a .java file in my sketch folder, it's called Browser.java. The main sketch is a .pde file named httpclient_jul08a.pde.

The content of my sketch folder is as follows:

- Browser.java

- httpclient_jul08a.pde

- code:

- commons-codec-1.6.jar

- commons-logging-1.1.1.jar

- fluent-hc-4.2.1.jar

- httpclient-4.2.1.jar

- httpclient-cache-4.2.1.jar

- httpcore-4.2.1.jar

- httpmime-4.2.1.jar

So the code folder is indeed at the same level than my .pde file.

Still the same error as before: "The package 'org.apache.commons' does not exist. You might be missing a library."

Top Reply