Reading a Webpage

General Discussion Other

shoffing

in General Discussion • Other • 2 years ago

I used to do a lot with java, and in java you could read from a URL ( http://snippets.dzone.com/posts/show/3553).

Is it possible to do something similar in Processing? Since Processing is based off java, I'd assume it would be...

Replies(6)

jp1001010..

Re: Reading a Webpage

1 year ago

You might be able to do it in the same way, because Processing is more of an extension of Java rather than separate.

Another way to do it is to use the loadStrings or Bytes method.

This should work but might be really slow or return something weird. Also it would return the HTML and all of that not a nice bit of text.

I just tried the loadStrings version and I could even resave it as an html and it would work.

Hope this helps.

buzlityr

Re: Reading a Webpage

6 months ago

I found the example for reading a html using loadStrings, but it requires you to enter the URL/web address.

String{} lines = loadStrings("http://webaddresshere.com/")

String html_source = join( lines, "\n" );

int index1 = ...

int index2 = ...

String txt = html_source.substring( index1, index2);

If I insert the IP address into the webaddress, I get a java.lang.NullpointerException error. Is there an equivalent set of commands if I only have an IP address?

As an alternative, I tried using Client

import processing.net*;

Client myClient;

String IPaddressString = "192.168.10.100";

String dataIn;

void setup() {

if (myClient.available()>0) {

myClient = new Client(this, IPaddressString, 80)

dataIn = myclient.readString();

}

void draw() {

}

But it doesn't seem to pick up any traffic. Any ideas on the latter problem as well?

dr.mo

Re: Reading a Webpage

5 months ago

processing is java, so you can do everything you can do in java. in certain cases you might need to use eclipse to develop but it doubt it for this case.

www.morishuz.com
www.videoreactive.com
www.electrovision-cinema.com

PhiLho

Re: Reading a Webpage

5 months ago

You have a creative syntax in your example....

I suppose it was correct in your attempt.
I tried too:
String[] page = loadStrings("http://www.processing.org");
println(page[0]);
gives
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">

OK, now:
String[] page = loadStrings("http://205.186.154.181");
println(page[0]);
gives
<html>

Ah? We go in HTML5 when accessing the IP address directly? Ah, not really:

<html>



<head> <title>
android.processing.org
</title> </head>

<body>

Looks like they serve a special content when accessing the IP address! Funny, but perhaps not the best example.
If I replace the above addresses respectively with http://www.w3.org and http://128.30.52.37, I get similar results.

Perhaps you forgot to put the http: protocol part in your attempt...

buzlityr

Re: Reading a Webpage

5 months ago

Bingo! It always is the simplest of errors.

The "http://" was missing. Thanks everyone! Glad that my first attempt at this forum posting was a success.

akiersky

Re: Reading a Webpage

5 months ago

jsoup : http://jsoup.org/ has some really great tools for parsing and extracting data out of html. may be helpful depending on what you are trying to do.

good luck,

Top Reply