Processing Forum

Screen name:
meoceo

meoceo's Profile

2 Posts

5 Responses

0 Followers

Activity Trend

Last 30 days

Loading Chart...

Show:

Expanded view
List view

Matching Strings

[1 Reply]
- 11-Jun-2012 01:17 AM
- Forum: Programming Questions
I must match entries coming from arrays of Strings, strings are Author names, but the code doesn't work, as processing recognises as different equal strings

for instance the same author name written in the same way, parsed via a regex that makes sure spaces are not there, are not seen as equal, but they should be recognised as coincident (FROM LINE 170 to the end)

I've uploaded the file "MyEndNoteCopy.txt" on the following link: https://rapidshare.com/files/3286203740/MyEndNoteCopy.txt
2. String rows[] = loadStrings("MyEndNoteCopy.txt");
3. String [][] csv; // initialize csv file
4. //String [][] csv2; // initialize reduced csv file
5. int csvWidth=0;
6. String auToMatch; // Authors to Match: from citations
7. String [] auToBeMatched; // Authors to be matched: from articles
8. int colCit = 11; // column in which citations starts
10. //calculate max width of csv file
11. String regexSplit = "[;\\t]";
13. for (int i=0; i < rows.length; i++)
14. {
15. rows[i] = rows[i].replaceAll("\t", ";");
16. String [] columns = split(rows[i],";"); //separatore ;
17. if (columns.length>csvWidth)
18. {
19. csvWidth=columns.length;
20. }
21. //print(colonna.length);
22. }
23. //print(csvWidth);
25. //create csv array based on # of rows and columns in csv file
26. csv = new String [rows.length][csvWidth];
28. //parse values into 2d array
29. for (int i=0; i < rows.length; i++) {
30. String [] temp = new String [csvWidth];
31. temp= split(rows[i], ';');
32. for (int j=0; j < temp.length; j++){
33. temp[j]=temp[j].replaceAll(" ", ""); //toglie gli spazi che appaiono all'inizio di ogni citazione
34. temp[j] = temp[j].toLowerCase();
35. csv[i][j]=temp[j];
36. }
37. }
40. //test
41. println(csv[0][0]); //colonna 11 è la prima citazione!
42. //println(csv.length);
43. //println(csv[0].length);
44. //println(((row-1)/2));
48. int col = csv[0].length;
49. int row = csv.length;
50. int newR;
52. //print(csv2[303][1]);
53. //print(csv2[1].length);
54. // references authors and matching
55. //
57. String wordRegex = "\\b\\w+\\b"; //regex to match
58. String digitRegex = "\\b(\\d+)\\b";
60. //
61. //
62. // CREATE LISTS OF Key 1stAu Jou Page nRef ((REMEMBER to change ROW var name)
63. //
64. //
68. int [] keyNo = new int[row];
69. String [] firstAuthor = new String[row];
70. String [] yr = new String[row];
71. String [] jou = new String[row];
72. String [] page = new String[row];
73. int [] nRef = new int[row]; //Numero cit: utilizzato come lunghezza vettore citazioni
76. for (int r =0; r<row; r++)
77. {
79. keyNo[r] = r;
81. String [] temp = split(csv[r][0],',');
82. firstAuthor[r] = temp[0];
83. firstAuthor[r] = trim(firstAuthor[r]);
85. //year yr
86. yr[r] = trim(csv[r][1]);
88. //journal jou
89. String temp1 = csv[r][2];
90. temp1 = temp1.replace(".", "");
91. jou[r] = trim(temp1);
93. //page page
94. if (csv[r][4] != null){
95. String [] temp2 = split(csv[r][4],'-');
96. page[r] = temp2[0];
97. }
99. //number of References nRef
100. int refNo =0;
101. for (int c = colCit; c<col; c++)
102. {
103. if (csv[r][c] != null)
104. {
105. String [] cell = split(csv[r][c],',');
106. if (cell.length>2)
107. {
108. refNo = refNo+1;
109. }
110. }
111. nRef[r] = refNo;
112. }
114. //TEST
115. //println(keyNo[r] + "," + firstAuthor[r] + ", yr: " + yr[r] + ", jou: " + jou[r] + ", page: " + page[r] + ", # ref: " + nRef[r]);
117. }
119. String [] correggiErrore = match(firstAuthor[0],wordRegex);
120. print (correggiErrore[0]);
121. firstAuthor[0] = correggiErrore[0];
123. //
124. //
125. // CREATE ARRAYS OF CITATIONS (auth, yr, jou, page) FOR EACH ROW
126. //
127. //
131. String [] authorM;
132. String [] yrM;
133. String [] jouM;
134. String [] pageM;
135. int [] KeyCit; //qui inserisco le chiavi degli articoli citati
137. //println("REFERENZA: "+ nRef[1]);
139. for (int r = 0; r<1; r++){
140. int noRef = nRef[r]; // numero referenza
141. authorM = new String [noRef]; // definire la lunghezza del vettore
142. yrM = new String [noRef];
143. jouM = new String [noRef];
146. // fill vectors
147. int position = 0; //position of the citation in the vector
149. for (int c = colCit; c<col; c++) {
150. if (csv[r][c] != null)
151. {
152. String [] cell = split(csv[r][c],',');
153. if (cell.length>2)
154. {
155. cell[0]= trim(cell[0]); //remove white spaces at the beginning of the string
156. cell[0] = cell[0].replaceAll("\\s", "#");
157. String [] tempAuthor = split(cell[0],'#');
158. String tempYr = trim(cell[1]);
159. String tempJou = trim(cell[2]);
160. //println(tempAuthor[0]);
161. authorM [position] = tempAuthor[0];
162. yrM[position] = tempYr;
163. jouM[position] = tempJou;
164. position = position +1;
165. }
167. }
168. }
170. //println("AUTORI CITATI "+authorM[1]+","+yrM[1]+","+jouM[1]);
171. int comuni = 0;
172. // MATCHING VALUES (and decide whether to add new lines)
173. for (int cit = 0; cit<noRef; cit++)
174. {
175. String [] temp1 = match(authorM[cit],wordRegex);
176. println("citation author: " + temp1[0]);
178. for (int paper =0; paper<1; paper++)
179. {
180. String [] temp = match(firstAuthor[paper],wordRegex);
181. println("article author: " + temp[0]);
182. println(temp1[0] == temp[0] + ",");
183. //if (common[0] != null)
184. //{
185. // println(common[0]);
186. //}
187. //String [] temp= match(authorM[cit],firstAuthor[paper]); //&& yrM[cit] == yr[paper] && jouM[cit] == jou[paper])
188. // print(temp[0]);
189. /*
190. if (temp[0] != null){
191. comuni = comuni +1;
192. }
193. */
194. }
195. }
196. }

Reducing a 2d array (with some blank rows) into a 2d csv

[7 Replies]
- 28-May-2012 08:29 AM
- Forum: Programming Questions
I have the following problem, I imported a file .csv into a 2d array called csv.

This has null entries in each odd row, therefore just even rows, starting from 0 (0, 2, 4, ... 606) are filled with data relevant for me

so, the size of the 2d array is 609, 560 and they come from printing csv.length and csv[1].length

I need to have a file whose size is 304x561, and I call it csv2.

However, the following code gives me an error
1. String rows[] = loadStrings("cit2.txt");
  
  String [][] csv; // initialize csv file
  
  String [][] csv2; // initialize reduced csv file
  
  int csvWidth=0;
  
  //calculate max width of csv file
  
  for (int i=0; i < rows.length; i++) {
  
  String [] columns = split(rows[i],'\t');
  
  if (columns.length>csvWidth){
  
  csvWidth=columns.length;
  
  }
  
  }
  
  //create csv array based on # of rows and columns in csv file
  
  csv = new String [rows.length][csvWidth];
  
  //parse values into 2d array
  
  for (int i=0; i < rows.length; i++) {
  
  String [] temp = new String [rows.length];
  
  //strDelimiter = (strDelimiter || ",");
  
  temp= split(rows[i], '\t');
  
  for (int j=0; j < temp.length; j++){
  
  csv[i][j]=temp[j];
  
  }
  
  }
  
  //test
  
  println(csv[604][0]);
  
  println(csv.length);
  
  println(csv[0].length);
  
  int newrow;
  
  int col = csv[0].length;
  
  int row = csv.length;
  
  csv2 = new String [((row-1)/2)-1][col];
  
  for (int c=0; c <csv[0].length; c++)
  
  {
  
  newrow=0;
  
  for(int r=0; r<(csv.length)-1; r = r+2)
  
  {
  
  String temp = csv[r][c];
  
  newrow = newrow +1;
  
  csv2[newrow][c]= temp;
  
  }
  
  }
any idea?

«Prev
Next »