Update: This code has now been put into production. You can get the latest copy here.
The last few upgrades of this code were purely for compatibility with internal changes in the streaming API, so I wanted to give people code that didn’t require any changes to their own programming. Those upgrades seem to have gone well for everyone. Now its time to start modifying the code to turn this framework into a production tweet collection system. This will require changes to the db schema and the core code in scripts like get_tweets.php and parse_tweets.php. I also want to rewrite the tweet display module, which has been causing problems for some people.
I have a beta test ready for a new version of both the database server and tweet display modules. They have quite a few changes. I have tested it as much as I can, but I’d like some people to try it out before making a general release. The files contain change logs, but here is an overview of some of the enhancements:
- Tweets from json_cache are deleted after parsing to improve insertion speed.
- The entities object is no longer stored in the tweets table for linkifying tweet text.
- Retweets are flagged in the tweets table.
- The twitter display has been rewritten for several browser issues.
If you can give me a hand by trying out this code, I’d appreciate it. You can download the beta code for version 0.30 of the framework here. Please share any bugs or comments with me (adam@140dev.com)
