This blog focuses on the relationships that connect us together providing potent insights for decision makers. In addition, a few data mining topics are presented.
Tuesday, April 01, 2008
Freemium Business Model
Monday, March 31, 2008
Freebase
At the SIP Symposium (at Stanford), there were some guys from the Freebase development crew. This was my first exposure to Freebase and I was intrigued with the idea. According to Kurt Bollacker (the Chief Scientist) the reason they were at the symposium was to "get people using our data". I also learned from him that they were VC funded and currently had about 60 developers.They have built upon the existing data sources, such as Wikipedia, and have added structurally typed data to go along with it. The resulting data repository is then easily accessible via the Freebase API.
It'll be interesting to see what happens with it.
Wednesday, March 26, 2008
SIP Recap - Wednesday
I'm here in Palo Alto, California attending the AAAI Spring Symposium at Stanford. So far, the Social Information Processing Symposium has been very interesting and exciting. So far, I've met some people doing some neat research. Today's presentations were the following (I've added links to those I could find online):
(Oh, and I lost my cell phone today.)
I'm looking forward to another great day tomorrow!
- Bernardo Huberman (HP Labs), Social Dynamics in the Age of the Web
- Ed Chi (PARC), Augmented Social Cognition
- Tad Hogg (HP Labs), Solving the organizational free riding problem with social networks
- Riley Crane (ETH), Viral, Quality, and Junk Videos on YouTube: Separating Content From Noise in an Information-Rich Environment
- Yi-Ching Huang (NTU), You Are What You Tag
- Julia Stoyanovich (Columbia), Leveraging Tagging to Model User Interests in del.icio.us
- Steve Whittaker (Sheffield), Temporal Tagging: Implicit Behaviour Identifies Points of Interest in Complex Event
- Georg Groh, Implicit Social Network Construction and Expert User Determination in Web Portals
- Elizeu Santos-Neto, Content Reuse and Interest Sharing in Tagging Communities
- Matt Smith (BYU), Social Capital in the Blogosphere: A Case Study (this was our presentation, of course)
(Oh, and I lost my cell phone today.)
I'm looking forward to another great day tomorrow!
Thursday, March 20, 2008
Firefox 3 Extensions
As Firefox 3 nears graduation from the Beta phase, many of the great extensions are finally becoming available. Here are links to the extensions that I find essential:
What extensions do you use?
What extensions do you use?
Monday, March 17, 2008
Sunday, March 09, 2008
Emptying a File in the Terminal
Here is a handy trick that I find useful from time to time:

$ echo "here is some jibberish" > somefile.txt
$ cat somefile.txt
here is some jibberish
$ cat /dev/null > somefile.txt
$ cat somefile.txt
$
Essentially by calling "cat /dev/null > somefile.txt" we redirect nothing (/dev/null) to the file 'somefile.txt', which in effect empties it. I like to use this for emptying log files as it saves time recreating files and possibly resetting the right permissions.
If interested, you can read more on I/O redirection.

$ echo "here is some jibberish" > somefile.txt
$ cat somefile.txt
here is some jibberish
$ cat /dev/null > somefile.txt
$ cat somefile.txt
$
Essentially by calling "cat /dev/null > somefile.txt" we redirect nothing (/dev/null) to the file 'somefile.txt', which in effect empties it. I like to use this for emptying log files as it saves time recreating files and possibly resetting the right permissions.
If interested, you can read more on I/O redirection.
Thursday, February 28, 2008
Social Science Data
Amidst my search for social science data (to perform social capital experiments), I have discovered the following data:
- Social Science Data on the Internet - seems to have lots of links to data, however the search is limited and results pages are clunky.
- Social capital datasets - presents some information on data sources that are specifically related to investigating social capital.
- INSNA - has the data used in Wasserman and Faust book on Social Network Analysis.
- ICIPSR - Inter-university consortium for political and social research
- SDA - web-based software available for accessing much of the social science data. Additionally, I noticed some archived data available.
There appears to be plenty of data. Now on to the task of filtering it down to the most relevant...
Wednesday, February 27, 2008
Social Network Graphing Tools
Here is a write-up on various social network graphing tools that I posted on the Data Mining Lab wiki: Social Network Graphing Tools
Most recently, I have enjoyed using Cytoscape and the Network Workbench Tool for larger networks and GraphViz for small example networks.
What tools do you like to use?
Most recently, I have enjoyed using Cytoscape and the Network Workbench Tool for larger networks and GraphViz for small example networks.
What tools do you like to use?
Tuesday, February 26, 2008
Google Chatback
Google just released a new gadget that will allow people visiting your blog or website to chat with you (via Google Talk). It is like the live chat and call-back buttons that have been available previously. To set it up, all you need to do is add the chatback badge code to your blog. Then, it'll look something like this...
Monday, February 25, 2008
Quick Mac and Windows Keyboard Switching
Since Mac OS X doesn't save profiles for multiple keyboards (which I hope will change in subsequent versions), I had to find a solution for quickly changing between a Windows style keyboard and a Mac style keyboard. After spending some time with Google, I found some AppleScript that seems to provide an adequate solution. For convenience, I made two scripts: one called keyboard_win.scpt that switches the modifier keys on a Windows style keyboard to behave Mac-like, and one called keyboard_mac.scpt that restores the default keyboard behavior for a Mac style keyboard.
(1) keyboard_win.scpt:
(2) keyboard_mac.scpt:
Hopefully, this will save you some time.
(1) keyboard_win.scpt:
(2) keyboard_mac.scpt:
Hopefully, this will save you some time.
Thursday, February 21, 2008
Mining "Stories" from Blogs
I just finished reading a paper called, Mining Blog Stories Using Community-Based and Temporal Clustering, which I found very interesting as it is extremely related to the work that we have been doing. As I read, I had the following thoughts and questions.
Thoughts
Thoughts
- It is refreshing to discover others that are pursuing similar research paths as us.
- Their work gives more fuel to the approaches we have been taking.
- Some of the formalism is elegant and useful (particularly, for talking about blogs and entries), however, some of it gets cumbersome (the lookup table is definitely necessary).
- Using Lucene library to index the data is an idea that we could consider (we have been storing the data in a MySQL database of our own make)
- I'd be curious to know how many degrees of separation they crawled from their seed blogs? I would guess that they did not get too far since the blogs in our study appear to be less sparse on average. They reported over 2,000 blogs having 1 million entries (on average, 50 entires per blog per month). In Social Capital in the Blogosphere we retrieved blog content just two degrees away from Scoble (our single seed blog) and obtained over 38,000 blogs having 13 million entries (on average, 28.5 entries per blog per month).
- How did they perform blog entity resolution? (here is an approach that we used)
Bandwidth
The Bandwidth Place is a nice site that tests the bandwidth available with you current network connection.
Escaping JavaScript and PHP
Here are some references for encoding and decoding in JavaScript and PHP, so that passing information via ajax or urls can be done cleanly.
The Art of Web - useful testing area for JavaScript and PHP.
W3Schools JavaScript Reference - just JavaScript
The Art of Web - useful testing area for JavaScript and PHP.
W3Schools JavaScript Reference - just JavaScript
What is Uplift Modeling?
Uplift modeling is an approach to predicting the incremental impact a marketing campaign has on a customer through controlled experimentation. It measures the variation in the difference between a treated group and a control group segmenting customers into the following groups:
1. Those that buy only when treated
2. Those that would buy or not buy regardless of whether or not they were treated
3. Those that do not buy when treated, but do buy when not treated
I've have yet to use Uplift Modeling, but it sounds rather interesting.
Would you like to read more?
DM Review article
Using Control Groups to Target on Predicted Lift
1. Those that buy only when treated
2. Those that would buy or not buy regardless of whether or not they were treated
3. Those that do not buy when treated, but do buy when not treated
I've have yet to use Uplift Modeling, but it sounds rather interesting.
Would you like to read more?
DM Review article
Using Control Groups to Target on Predicted Lift
Wednesday, February 20, 2008
Star Rating Widget
Here is a rating widget and how to use it. It can be used for collecting ratings from website visitors. Typically, it will be used for five-star rating, but you can pass it any number, so that it can be used as an n-star rating widget.
Subscribe to:
Posts (Atom)


















