Howdy, Stranger!
We are about to switch to a new forum software. Until then we have removed the registration on this forum.
Categories
- All Categories 25.7K
- Announcements & Guidelines 13
- Common Questions 30
- Using Processing 22.1K
- Programming Questions 12.2K
- Questions about Code 6.4K
- How To... 4.2K
- Hello Processing 72
- GLSL / Shaders 292
- Library Questions 4K
- Hardware, Integration & Other Languages 2.7K
- Kinect 668
- Arduino 1K
- Raspberry PI 188
- Questions about Modes 2K
- Android Mode 1.3K
- JavaScript Mode 413
- Python Mode 205
- Questions about Tools 100
- Espanol 5
- Developing Processing 548
- Create & Announce Libraries 211
- Create & Announce Modes 19
- Create & Announce Tools 29
- Summer of Code 2018 93
- Rails Girls Summer of Code 2017 3
- Summer of Code 2017 49
- Summer of Code 2016 4
- Summer of Code 2015 40
- Summer of Code 2014 22
- p5.js 1.6K
- p5.js Programming Questions 947
- p5.js Library Questions 315
- p5.js Development Questions 31
- General 1.4K
- Events & Opportunities 288
- General Discussion 365
loadJSONArray() file size limit?
I have a very large json file I would like to load and analyse. I am using loadJSONArray() but it is pulling the following error:
Expected a ',' or '}'
If I load a trimmed version (only 1000 elements instead of 10000 elements) it is fine. I think my json is formatted fine, but I guess it could be an error in it, but I was wondering if it was possible there is a limit to the size of the file you can load? The larger file is 12MB and the smaller file 363KB.
If there is a limit, is there a handy way to load the data line by line? Or would it be possible to convert it to a txt file and load it line by line and get to the data I need (maybe using BufferedReader.readLine() and match())?
Thanks, really want to get to grips with this data!!!
David
Answers
OK I have finally found a json validator app that will handle a file of this size (the web based ones all crashed) and it looks like there were a couple errors in the file. Fixed those and Processing seems to handle it fine!
Out of curiosity, what application did you use?
I used JSON Validator https://itunes.apple.com/gb/app/json-validator/id457563999?mt=12
It could handle 10,000 lines (12MB) and 20,000 lines (approx 24MB) but crashed when I tried to paste in any more. Still much better than any web-based app I tried.