ForwardTrack is an open source tool (now entirely written in php) that allows email campaigns to be tracked and mapped as they are forwarded from person to person. This is definitely useful as it reveals the spread of information and some of the underlying social network.
This blog focuses on the relationships that connect us together providing potent insights for decision makers. In addition, a few data mining topics are presented.
Wednesday, April 23, 2008
ForwardTrack
ForwardTrack is an open source tool (now entirely written in php) that allows email campaigns to be tracked and mapped as they are forwarded from person to person. This is definitely useful as it reveals the spread of information and some of the underlying social network.
Political Campaign Contributions
The Federal Election Commission (FEC) requires that all campaign contributions over $200 (per donor) be reported publicly. The reported information includes the donor's name, job title, zip code, and even address. All of it, since 2001 is available electronically via FTP at ftp://ftp.fec.gov/FEC/electronic/.
In collaboration with Political Scientists here at BYU we have been performing record linkage (aka. entity resolution) on this data, so that they will be able to more accurately perform their studies.
Fundrace
On a related note, fundrace.org has created an interesting mashup (shown below) that maps donors on a Google map colored by the party or candidate donated to. It also, reveals donor information and appears do do some coarse record linkage.

FEC Maps
Additionally, the FEC itself has started to produce maps both for the Presidential Election and House and Senate Elections. The maps they provide aggregate the donated funds by state, party, and candidate.

In collaboration with Political Scientists here at BYU we have been performing record linkage (aka. entity resolution) on this data, so that they will be able to more accurately perform their studies.
Fundrace
On a related note, fundrace.org has created an interesting mashup (shown below) that maps donors on a Google map colored by the party or candidate donated to. It also, reveals donor information and appears do do some coarse record linkage.

FEC Maps
Additionally, the FEC itself has started to produce maps both for the Presidential Election and House and Senate Elections. The maps they provide aggregate the donated funds by state, party, and candidate.

Tuesday, April 22, 2008
Duncan Watts Downplays Viral Marketing Hype
A while back I quickly saw Clive Thompson's article entitled Is the Tipping Point Toast?, but didn't have the time to read it all nor investigate it any further --- until today.
Thompson's article pits Malcolm Gladwell's thesis (in The Tipping Point) against the recent research of Duncan Watts (cited below). I thought the article was well-written and adequately presented both sides of the issue. In short, Watt's claims that spending time and money marketing to influential individuals is no better than marketing to the masses.
Through all of this, Watts makes some important points such as (quoted from Thompson's article):
The idea that there is "no free lunch" in viral marketing is useful to point out, as "there are many more unsuccessful attempts that one never hears about." He also, points out that it is "hard, if not impossible" to predict which of attempts will succeed.
The take-home message in the conclusion is that effective marketing campaigns can be produced without identifying "influentials", but simply by adding a mechanism of peer-to-peer sharing to propagate the message. (As an aside, the formalism presented in the paper is useful for discussing the problem and easily evaluating the results.)
Watts makes some good points, however, I would still argue that people with high social capital (you might call "highly influential") can heighten the network effect. This is even evidenced in Duncan's paper --- as one of Tom Mauser's 'friend' was StopTheNRA, who, in turn sent a large email blast (Table 1, footnote 1). So, Tom Mauser, had a significant enough relationship with StopTheNRA that they used their resources (their large email list) to forward his message.
Although, there is an element of hype in the presentation of "Big Seed Marketing", I find it useful as it presents a nice way of making the issue sticky and bringing to light these more subtle points. The desired effect of propagating these ideas seems to be occurring.
Update (4/23): Podcast with Duncan Watts on Buzz Marketing (mp3)
Thompson's article pits Malcolm Gladwell's thesis (in The Tipping Point) against the recent research of Duncan Watts (cited below). I thought the article was well-written and adequately presented both sides of the issue. In short, Watt's claims that spending time and money marketing to influential individuals is no better than marketing to the masses.
Through all of this, Watts makes some important points such as (quoted from Thompson's article):
- The problem of popular viral marketing talk is that it is "incredibly vague"; "how an influential actually influences is not explained." "Precision matters when trying to explain highly social epidemics"
- "Influentials don't govern person-to-person communication. We all do."
"Common sense is misleading" - Thompson writes that Watts found the "rank-and-file citizen [to be] far more likely to start a contagion"
The idea that there is "no free lunch" in viral marketing is useful to point out, as "there are many more unsuccessful attempts that one never hears about." He also, points out that it is "hard, if not impossible" to predict which of attempts will succeed.
The take-home message in the conclusion is that effective marketing campaigns can be produced without identifying "influentials", but simply by adding a mechanism of peer-to-peer sharing to propagate the message. (As an aside, the formalism presented in the paper is useful for discussing the problem and easily evaluating the results.)
Watts makes some good points, however, I would still argue that people with high social capital (you might call "highly influential") can heighten the network effect. This is even evidenced in Duncan's paper --- as one of Tom Mauser's 'friend' was StopTheNRA, who, in turn sent a large email blast (Table 1, footnote 1). So, Tom Mauser, had a significant enough relationship with StopTheNRA that they used their resources (their large email list) to forward his message.
Although, there is an element of hype in the presentation of "Big Seed Marketing", I find it useful as it presents a nice way of making the issue sticky and bringing to light these more subtle points. The desired effect of propagating these ideas seems to be occurring.
Update (4/23): Podcast with Duncan Watts on Buzz Marketing (mp3)
Tuesday, April 15, 2008
Looking for a Job?
There are a lots of places to search for jobs online these days including:
- SimplyHired - easy to use job search
- HotJobs - Yahoo's job site
- Monster - you've probably heard of Monster
- Indeed - newer site that allows you to filter by salary (for instance, here is an example salary search on computer science and data mining)
- LinkedIn - use your social network to find your next job
- erecruiting - for new college graduates
An interesting approach to finding your next job might be to leverage your social connections to match you with a good employer with needs inline with your skills. Of course, as nice that sounds in theory, I would bet it could be challenging in practice.
Although, I won't be needing a full-time job for another couple years, it is always interesting to see what jobs are available (and what skills are in demand) by quickly searching on your skills and interests.
Tuesday, April 01, 2008
SIP Recap - Thursday
Here is a recap from the Social Information Processing Symposium:
The Wednesday talks were excellent. In particular, I really enjoyed:
- Brian Skyrms (UCI), Signaling Games: Some Dynamics of Evolution and Learning
- John Nicholson (USU), The Blind Leading the Blind: Toward Collaborative Online Route Information
Cosma Shalizi (CMU), Social Media as Windows on the Social Life of the Mind- Gustavo Glusman (Systems Biologist), Users, photos, groups, words: Analyzing mixed networks on Flickr
- Luc Steels (Vrije U), Social tagging in community memories
- Aram Galstyan (USC/ISI), Influence Propagation in Modular Networks
- Adam Anthony (UMBC), Generative Models for Clustering: The Next Generation
- Peter Pirolli (PARC), A Probabilistic Model of Semantics in Social Information Foraging
- Hak-Lae Kim (DERI), int.ere.st: Building a Tag Sharing Service with the SCOT Ontology
- Yu Zhang (Zhejiang U), Mining Target Marketing Groups From Users' Web of Trust on Epinions
- Andrei Broder (Yahoo), Reviewing the Reviewers: Characerizing Biases and Competencies using Socially Meaningful Attributes (see Sihem Amer-Yahia)
The Wednesday talks were excellent. In particular, I really enjoyed:
- The subtleties of the blind leading the blind (see 2 above)
- Gustavo's unique way of analyzing Flickr relationships (see 4)
- Adam Anthony's overview of generative models that can be used in clustering (see 7)
- Pirolli's analysis of Lostpedia using LDA (see 8)
- Hak-Lae Kim's tag aggregator application (see 9)
- The use of socially meaningful attributes as presented by Yahoo's Andrei Broder (see 11)
Freemium Business Model
Monday, March 31, 2008
Freebase
At the SIP Symposium (at Stanford), there were some guys from the Freebase development crew. This was my first exposure to Freebase and I was intrigued with the idea. According to Kurt Bollacker (the Chief Scientist) the reason they were at the symposium was to "get people using our data". I also learned from him that they were VC funded and currently had about 60 developers.They have built upon the existing data sources, such as Wikipedia, and have added structurally typed data to go along with it. The resulting data repository is then easily accessible via the Freebase API.
It'll be interesting to see what happens with it.
Wednesday, March 26, 2008
SIP Recap - Wednesday
I'm here in Palo Alto, California attending the AAAI Spring Symposium at Stanford. So far, the Social Information Processing Symposium has been very interesting and exciting. So far, I've met some people doing some neat research. Today's presentations were the following (I've added links to those I could find online):
(Oh, and I lost my cell phone today.)
I'm looking forward to another great day tomorrow!
- Bernardo Huberman (HP Labs), Social Dynamics in the Age of the Web
- Ed Chi (PARC), Augmented Social Cognition
- Tad Hogg (HP Labs), Solving the organizational free riding problem with social networks
- Riley Crane (ETH), Viral, Quality, and Junk Videos on YouTube: Separating Content From Noise in an Information-Rich Environment
- Yi-Ching Huang (NTU), You Are What You Tag
- Julia Stoyanovich (Columbia), Leveraging Tagging to Model User Interests in del.icio.us
- Steve Whittaker (Sheffield), Temporal Tagging: Implicit Behaviour Identifies Points of Interest in Complex Event
- Georg Groh, Implicit Social Network Construction and Expert User Determination in Web Portals
- Elizeu Santos-Neto, Content Reuse and Interest Sharing in Tagging Communities
- Matt Smith (BYU), Social Capital in the Blogosphere: A Case Study (this was our presentation, of course)
(Oh, and I lost my cell phone today.)
I'm looking forward to another great day tomorrow!
Thursday, March 20, 2008
Firefox 3 Extensions
As Firefox 3 nears graduation from the Beta phase, many of the great extensions are finally becoming available. Here are links to the extensions that I find essential:
What extensions do you use?
What extensions do you use?
Monday, March 17, 2008
Sunday, March 09, 2008
Emptying a File in the Terminal
Here is a handy trick that I find useful from time to time:

$ echo "here is some jibberish" > somefile.txt
$ cat somefile.txt
here is some jibberish
$ cat /dev/null > somefile.txt
$ cat somefile.txt
$
Essentially by calling "cat /dev/null > somefile.txt" we redirect nothing (/dev/null) to the file 'somefile.txt', which in effect empties it. I like to use this for emptying log files as it saves time recreating files and possibly resetting the right permissions.
If interested, you can read more on I/O redirection.

$ echo "here is some jibberish" > somefile.txt
$ cat somefile.txt
here is some jibberish
$ cat /dev/null > somefile.txt
$ cat somefile.txt
$
Essentially by calling "cat /dev/null > somefile.txt" we redirect nothing (/dev/null) to the file 'somefile.txt', which in effect empties it. I like to use this for emptying log files as it saves time recreating files and possibly resetting the right permissions.
If interested, you can read more on I/O redirection.
Thursday, February 28, 2008
Social Science Data
Amidst my search for social science data (to perform social capital experiments), I have discovered the following data:
- Social Science Data on the Internet - seems to have lots of links to data, however the search is limited and results pages are clunky.
- Social capital datasets - presents some information on data sources that are specifically related to investigating social capital.
- INSNA - has the data used in Wasserman and Faust book on Social Network Analysis.
- ICIPSR - Inter-university consortium for political and social research
- SDA - web-based software available for accessing much of the social science data. Additionally, I noticed some archived data available.
There appears to be plenty of data. Now on to the task of filtering it down to the most relevant...
Wednesday, February 27, 2008
Social Network Graphing Tools
Here is a write-up on various social network graphing tools that I posted on the Data Mining Lab wiki: Social Network Graphing Tools
Most recently, I have enjoyed using Cytoscape and the Network Workbench Tool for larger networks and GraphViz for small example networks.
What tools do you like to use?
Most recently, I have enjoyed using Cytoscape and the Network Workbench Tool for larger networks and GraphViz for small example networks.
What tools do you like to use?
Tuesday, February 26, 2008
Google Chatback
Google just released a new gadget that will allow people visiting your blog or website to chat with you (via Google Talk). It is like the live chat and call-back buttons that have been available previously. To set it up, all you need to do is add the chatback badge code to your blog. Then, it'll look something like this...
Monday, February 25, 2008
Quick Mac and Windows Keyboard Switching
Since Mac OS X doesn't save profiles for multiple keyboards (which I hope will change in subsequent versions), I had to find a solution for quickly changing between a Windows style keyboard and a Mac style keyboard. After spending some time with Google, I found some AppleScript that seems to provide an adequate solution. For convenience, I made two scripts: one called keyboard_win.scpt that switches the modifier keys on a Windows style keyboard to behave Mac-like, and one called keyboard_mac.scpt that restores the default keyboard behavior for a Mac style keyboard.
(1) keyboard_win.scpt:
(2) keyboard_mac.scpt:
Hopefully, this will save you some time.
(1) keyboard_win.scpt:
(2) keyboard_mac.scpt:
Hopefully, this will save you some time.
Subscribe to:
Posts (Atom)


















