Google Summer of Code (2013): my idea

General Discussion GSOC 2013

in_digo

Google Summer of Code (2013): my idea

in General Discussion • GSOC 2013 • 6 months ago

I couldn't find a thread or a recipient so I created a new topic.

I am interested in participating in this years “Google Summer of Code” for the Processing project.

I currently developing a tool for an art installation that I am creating. It is called “Processing Sequencer” and has two primary uses. First: time-controlled animation: arranging different processing sketches on a time line and stacking them (to be rendered at once). Second: it allows easy interaction with sensors (or any other data producer). I have attached a PDF describing the functionality in greater detail. I have already implemented a proof of concept model. However, now that I am more able to see the full potential, I would like to make a fully working open source program as a contribution to Processing. In my opinion it could contribute a wealth of possible applications to the Processing environment. By being supported through this years Summer of Code, I would be able to make this program available to a wide variety of users.

My tool makes use of the PDE, to which I would also like to add two functions:

An reflection based code completion tool, similar to that in Eclipse, which also implements the HTML-reference in the editor, so the user always has access to examples, argument lists etc.
A (pseudo) live code functionality.
This would allow the renderer to update without restarting the whole VM or reloading everything.

I would use the time in which I was funded in order to implement these two functions and to make “Processing Sequencer” a working program which could be used by anybody. If this is of interest, I would be able to send you a working copy of the tool within a few days (I would first need to eliminate some problems to make it work on other systems).

Who I am:
I am currently studying Neuroscience/Psychology at the HU-Berlin, but I always have been interested in programming. I started coding C++ at the age of 12, later changed to Java, and recently I have been using Matlab to analyze neural data. I began to be interested in art a few years ago, and this interest, in combination with my interest in programming, has lead me to create a large scale installation involving generative art. I already use Processing to create the visualizations, but in order to have time-based control, I began to develop the Processing Sequencer.

I am proficient in Java and have some knowledge of the Swing Library. Additionally, I started hacking Processing a while ago, so I have some basic knowledge of its structure.

I hope to hear from you soon. Please don't hesitate to contact me if you have any further questions.

And to all the others, who are not involved in the Summer of Code, I would really like to hear whats your thoughts on the project

Best,

David

Replies(14)

quarks

Re: Google Summer of Code (2013): my idea

6 months ago

I have moved this to General Discussion - there are other posts on GSOC 2013 here.

amnon.owed

Re: Google Summer of Code (2013): my idea

6 months ago

Code completion and live coding would be awesome contributions.

GoToLoop

Re: Google Summer of Code (2013): my idea

6 months ago

Code completion? I second that too!

It could be even better w/ a side panel w/ some short explanation of the command and its parameters!

in_digo

Re: Google Summer of Code (2013): my idea

6 months ago

Since I wrote I lot about the timeline tool, I will also describe how the two new PDE features could be implemented (just to show, I (hopefully) know what I am talking about) :

Code Completion

This feature is based on Java features, but can probably also be used in different modes. There would be needed some changes (since it will also show Java specific functions). I don't describe it here but it can be implemented after it works in Java mode.

a.) First an outline (like eclipse outline, but also with local vars) of the code is needed and a listener which triggers the code completion. Without doing much research I see 2 possibilities:

Writing the whole thing as a tool (PDE Plug_in). Someone already wrote a outline tool (https://forum.processing.org/topic/sketch-outline-new-processing-tool-announcement). In a tool you have access to the editor and could also add an keylistener (since it extends JComponent). I don’t like this option so much because it takes more resources than needed, since the code is analyzed separately from the syntax analyzer (jEdit)
Adding the outline analyzer and keybindings to the jEdit 2.2.1 syntax highlighting so the source is only phrased once. It also gives me more access to really integrate the completion in the editor!
Maybe I could combine those options (have to have a good look at the old jEdit classes). Which would be best, so there would be the abstraction and the performance.

b.) When the code completion is triggered, the class of the object, on which it is triggered, is needed(outline). If it is triggered on no object (no word before a “.”) it needs to show all (public/protected) members of the current class (extending PApplet, which makes it current class + PApplet) if it is triggered on an variables/field we need to get all members (public and depending of package protected) of the type of this var/field. This can be done by Java Reflection “.getClass().getMethods()” / “.getClass().getFields()”. Then a new JFrame (undecorated) will be shown, containing all methods and fields.

c.) There needs to be a method which members/fields are shown first. I would suggest that members of the direct ancestor is shown first plus there is some kind of method on how important the function is. In Eclipse it is done by the frequency of use, maybe I can implement something similar. (Suggestions?!)

d.) When navigating through that list another undecorated JFrame opens and shows JavaDoc or if it is a Processing Function the HTML help from the Website (I will write a crawler which gets all the pages, extracts just the content, and puts it in a different format). You can also browse between those pages (related functions). If you like you can make the window sticky (put it to the side and see it been updated automatically), and have a the help always by hand.

e.) If selected the code is copied in the editor at caret position and caret position jumps to first Argument. Maybe with tool tip explaining the use of the current argument (depends on how it looks and feels).

A (pseudo) live code functionality.
This feature is based on Java features, and will only be available when being in Java mode. Of course you can write your Code in Java mode and then switch.

I already have parts of this feature running in my time line project (read PDF in first post). I see 2 possible options for pseudo live coding:

Class unloading / reloading
Eclipse like “Hotswap Bug Fixing” / Java Platform Debugger Architecture (JPDA)

a.) In the PDE a sketch launches in its own virtual machine. So I need a method to communicate to the new virtual machine. Maybe “Remote Method Invocation”(RMI) / Still need to think about it

b.) The easy approach is to unload (every class needs its own classloader which will be set to null also, its important to make sure it really gets unloaded) a class (which has changed) and reload it (and copy all members). It works, but you it is not as fast as the Eclipse hot swap and needs recompiling (of the class).

I don't know much about the second approach and I would like to first implement the class unloading and then get information how to implement JPDA or other dynamic bytecode manipulation.

I know this is just a rough outline on whats needs to be done, and there will be a lot of tricky parts that I didn't think of yet.

in_digo

Re: Google Summer of Code (2013): my idea

6 months ago

I would like to add the following to my proposal:

- auto suggest Imports (when trying to use a Processing library or Java lib the IDE will suggest to import XXX), I use that a lot in eclipse and hate it if I just forgot where HashSet or what ever is defined.

- Maybe if there is still time also Mouse over variable opens Tooltip to show type and offeres to jump to place of definition.

- and shows the value of a variable in experimental mode when stoped at a breakpoint

- I would probably work on the experimental mode a bit and implement most features there (already good base to implement what I would like to do)

Chrisir

Re: Google Summer of Code (2013): my idea

6 months ago

I think the most advance tool for the IDE is this

http://forum.processing.org/topic/sketch-outline-new-processing-tool-announcement

in_digo

Re: Google Summer of Code (2013): my idea

6 months ago

I think it is an awsome tool, but has the disadvantage of rephrasing the code all the time which is already done by jEdit 2.2.1(in some kind). So I would prefere to implement it in a way which makes use of already exsisting resources (See Code Completion / a ).

I kind of already know how to implement the stuff I am suggesting. The " auto suggest imports", and "mouse over variable label " I just added since it will be kind of easy to implement if I do the rest (code completion).

GoToLoop

Re: Google Summer of Code (2013): my idea

6 months ago

I wished that Processing had a more beginner friendly IDE, à la MS Small Basic's.
Code completion w/ a clean side panel is much more intuitive!

in_digo

Re: Google Summer of Code (2013): my idea

6 months ago

I just had a few hours to play a bit with the idea of the Code completion. I took the Outline tool to have knowlege about the type of Variables.

- Until now it does not take into account what you wrote (so I ignored the outline) but it works with external Objects.

- Also it does not work with local variables, but it will all come :)

- Most Features (like in Eclipse) dont work, until now it only tells you which methods and fields you have inside of an Object and you can always press STRG+SPACE to get the PApplet functions. (later it will also give you the members you created of course)

- But the Import suggestion works

If you like you can download the tool and try it. Until now it is kind of useless but If you would like to give me some advice on the design, now would be the perfect time.

It is a Processing tool, just copy to your tool folder. If you have the Outline installed, you will need to move the original folder somewhere else while you have my tool installed (they have the same name)

CodeCompletionTool (its quite big because it has the whole JavaDoc attached to it, so it can also help you outside of Processing ---- ArrayList for example or what ever you need)

ijeoma

Re: Google Summer of Code (2013): my idea

6 months ago

great work! you should put it on github.

amnon.owed

Re: Google Summer of Code (2013): my idea

6 months ago

Looks promising so far.

in_digo

Re: Google Summer of Code (2013): my idea

6 months ago

@ ijeoma: I definitely will, but I only publish code after the main structure is clear to me (main class structure, interfaces, listeners). Despite the saying you should have that clear before writing code, I just start by writing quick and dirty code. After I know what I want I rewrite everything in a structure that is understandable for others. In short terms, I will publish the code when I have rewritten the code. This week I will need to do neuro research stuff (my studies) but I will work on the code on the weekend and next week and then publish the code and create a new thread (in the " Library and Tool Development" area,since the tool is not directly related to the GSOC) .

shiffman

Re: Google Summer of Code (2013): my idea

5 months ago

Re: the sequencer idea, this sounds pretty interesting. Have you taken a look at James George's ofxtimeline for OF?

https://vimeo.com/33135665

Some useful ideas here for you.

in_digo

Re: Google Summer of Code (2013): my idea

5 months ago

Didn't know that but it sounds interesting, it kind of is for openframework what the Animator(within my tool) could be for processing. I will probably take a look on the gui and cool features that I could "borrow"

Top Reply