Wednesday, April 23, 2008

ForwardTrack

ForwardTrack is an open source tool (now entirely written in php) that allows email campaigns to be tracked and mapped as they are forwarded from person to person. This is definitely useful as it reveals the spread of information and some of the underlying social network.

Political Campaign Contributions

The Federal Election Commission (FEC) requires that all campaign contributions over $200 (per donor) be reported publicly. The reported information includes the donor's name, job title, zip code, and even address. All of it, since 2001 is available electronically via FTP at ftp://ftp.fec.gov/FEC/electronic/.

In collaboration with Political Scientists here at BYU we have been performing record linkage (aka. entity resolution) on this data, so that they will be able to more accurately perform their studies.

Fundrace
On a related note, fundrace.org has created an interesting mashup (shown below) that maps donors on a Google map colored by the party or candidate donated to. It also, reveals donor information and appears do do some coarse record linkage.


FEC Maps
Additionally, the FEC itself has started to produce maps both for the Presidential Election and House and Senate Elections.  The maps they provide aggregate the donated funds by state, party, and candidate.

Tuesday, April 22, 2008

Duncan Watts Downplays Viral Marketing Hype

A while back I quickly saw Clive Thompson's article entitled Is the Tipping Point Toast?, but didn't have the time to read it all nor investigate it any further --- until today.

Thompson's article pits Malcolm Gladwell's thesis (in The Tipping Point) against the recent research of Duncan Watts (cited below). I thought the article was well-written and adequately presented both sides of the issue. In short, Watt's claims that spending time and money marketing to influential individuals is no better than marketing to the masses.

Through all of this, Watts makes some important points such as (quoted from Thompson's article):
  • The problem of popular viral marketing talk is that it is "incredibly vague"; "how an influential actually influences is not explained." "Precision matters when trying to explain highly social epidemics"
  • "Influentials don't govern person-to-person communication. We all do."
    "Common sense is misleading"
  • Thompson writes that Watts found the "rank-and-file citizen [to be] far more likely to start a contagion"
So, today I finally took the time to learn more about Watts' recent research, available at Collective Dynamics Group website (at Columbia University) as a Working paper in the Papers section. Through the years, I had previously read some of Watts' work, so I was excited to see his recent findings. In this paper he presents an approach they call "Big Seed Marketing", which in essence combines a traditional mass marketing model with a viral propagation.

The idea that there is "no free lunch" in viral marketing is useful to point out, as "there are many more unsuccessful attempts that one never hears about." He also, points out that it is "hard, if not impossible" to predict which of attempts will succeed.

The take-home message in the conclusion is that effective marketing campaigns can be produced without identifying "influentials", but simply by adding a mechanism of peer-to-peer sharing to propagate the message. (As an aside, the formalism presented in the paper is useful for discussing the problem and easily evaluating the results.)

Watts makes some good points, however, I would still argue that people with high social capital (you might call "highly influential") can heighten the network effect. This is even evidenced in Duncan's paper --- as one of Tom Mauser's 'friend' was StopTheNRA, who, in turn sent a large email blast (Table 1, footnote 1). So, Tom Mauser, had a significant enough relationship with StopTheNRA that they used their resources (their large email list) to forward his message.

Although, there is an element of hype in the presentation of "Big Seed Marketing", I find it useful as it presents a nice way of making the issue sticky and bringing to light these more subtle points. The desired effect of propagating these ideas seems to be occurring.

Update (4/23): Podcast with Duncan Watts on Buzz Marketing (mp3)

Tuesday, April 15, 2008

Looking for a Job?

There are a lots of places to search for jobs online these days including:
An interesting approach to finding your next job might be to leverage your social connections to match you with a good employer with needs inline with your skills. Of course, as nice that sounds in theory, I would bet it could be challenging in practice.

Although, I won't be needing a full-time job for another couple years, it is always interesting to see what jobs are available (and what skills are in demand) by quickly searching on your skills and interests.

Tuesday, April 01, 2008

SIP Recap - Thursday

Here is a recap from the Social Information Processing Symposium:
  1. Brian Skyrms (UCI), Signaling Games: Some Dynamics of Evolution and Learning
  2. John Nicholson (USU), The Blind Leading the Blind: Toward Collaborative Online Route Information
  3. Cosma Shalizi (CMU), Social Media as Windows on the Social Life of the Mind
  4. Gustavo Glusman (Systems Biologist), Users, photos, groups, words: Analyzing mixed networks on Flickr
  5. Luc Steels (Vrije U), Social tagging in community memories
  6. Aram Galstyan (USC/ISI), Influence Propagation in Modular Networks
  7. Adam Anthony (UMBC), Generative Models for Clustering: The Next Generation
  8. Peter Pirolli (PARC), A Probabilistic Model of Semantics in Social Information Foraging
  9. Hak-Lae Kim (DERI), int.ere.st: Building a Tag Sharing Service with the SCOT Ontology
  10. Yu Zhang (Zhejiang U), Mining Target Marketing Groups From Users' Web of Trust on Epinions
  11. Andrei Broder (Yahoo), Reviewing the Reviewers: Characerizing Biases and Competencies using Socially Meaningful Attributes (see Sihem Amer-Yahia)

The Wednesday talks were excellent. In particular, I really enjoyed:
  • The subtleties of the blind leading the blind (see 2 above)
  • Gustavo's unique way of analyzing Flickr relationships (see 4)
  • Adam Anthony's overview of generative models that can be used in clustering (see 7)
  • Pirolli's analysis of Lostpedia using LDA (see 8)
  • Hak-Lae Kim's tag aggregator application (see 9)
  • The use of socially meaningful attributes as presented by Yahoo's Andrei Broder (see 11)

Freemium Business Model

The freemium model is something that I've been telling start-up businesses to do for quite a while. It allows community --- where social capital resides --- to build around your service at a fundamental level. After a captive community has been established, premium features (or services) can be offered, which effectively converts social capital into profit.

Monday, March 31, 2008

Freebase

At the SIP Symposium (at Stanford), there were some guys from the Freebase development crew. This was my first exposure to Freebase and I was intrigued with the idea. According to Kurt Bollacker (the Chief Scientist) the reason they were at the symposium was to "get people using our data". I also learned from him that they were VC funded and currently had about 60 developers.

They have built upon the existing data sources, such as Wikipedia, and have added structurally typed data to go along with it. The resulting data repository is then easily accessible via the Freebase API.

It'll be interesting to see what happens with it.

Wednesday, March 26, 2008

SIP Recap - Wednesday

I'm here in Palo Alto, California attending the AAAI Spring Symposium at Stanford. So far, the Social Information Processing Symposium has been very interesting and exciting. So far, I've met some people doing some neat research. Today's presentations were the following (I've added links to those I could find online):
  1. Bernardo Huberman (HP Labs), Social Dynamics in the Age of the Web
  2. Ed Chi (PARC), Augmented Social Cognition
  3. Tad Hogg (HP Labs), Solving the organizational free riding problem with social networks
  4. Riley Crane (ETH), Viral, Quality, and Junk Videos on YouTube: Separating Content From Noise in an Information-Rich Environment
  5. Yi-Ching Huang (NTU), You Are What You Tag
  6. Julia Stoyanovich (Columbia), Leveraging Tagging to Model User Interests in del.icio.us
  7. Steve Whittaker (Sheffield), Temporal Tagging: Implicit Behaviour Identifies Points of Interest in Complex Event
  8. Georg Groh, Implicit Social Network Construction and Expert User Determination in Web Portals
  9. Elizeu Santos-Neto, Content Reuse and Interest Sharing in Tagging Communities
  10. Matt Smith (BYU), Social Capital in the Blogosphere: A Case Study (this was our presentation, of course)
I enjoyed all of the presentations, in particular I liked Bernardo's address which covered a variety of interesting topics, Ed's comments, Riley's trend analysis, Julia's talk analyzing del.icio.us hotlist generation and tag, Steve's flamboyant presentation, Georg's work (as it had some thoughts related to our work on Implicit Affinity Networks).

(Oh, and I lost my cell phone today.)

I'm looking forward to another great day tomorrow!

Thursday, March 20, 2008

Firefox 3 Extensions

As Firefox 3 nears graduation from the Beta phase, many of the great extensions are finally becoming available. Here are links to the extensions that I find essential:
What extensions do you use?

Monday, March 17, 2008

Sunday, March 09, 2008

Emptying a File in the Terminal

Here is a handy trick that I find useful from time to time:

$ echo "here is some jibberish" > somefile.txt
$ cat somefile.txt
here is some jibberish
$ cat /dev/null > somefile.txt
$ cat somefile.txt
$

Essentially by calling "cat /dev/null > somefile.txt" we redirect nothing (/dev/null) to the file 'somefile.txt', which in effect empties it. I like to use this for emptying log files as it saves time recreating files and possibly resetting the right permissions.

If interested, you can read more on I/O redirection.

Thursday, February 28, 2008

Social Science Data

Amidst my search for social science data (to perform social capital experiments), I have discovered the following data:
  • Social Science Data on the Internet - seems to have lots of links to data, however the search is limited and results pages are clunky.
  • Social capital datasets - presents some information on data sources that are specifically related to investigating social capital.
  • INSNA - has the data used in Wasserman and Faust book on Social Network Analysis.
  • ICIPSR - Inter-university consortium for political and social research
  • SDA - web-based software available for accessing much of the social science data. Additionally, I noticed some archived data available.
There appears to be plenty of data.  Now on to the task of filtering it down to the most relevant...

Wednesday, February 27, 2008

Social Network Graphing Tools

Here is a write-up on various social network graphing tools that I posted on the Data Mining Lab wiki: Social Network Graphing Tools

Most recently, I have enjoyed using Cytoscape and the Network Workbench Tool for larger networks and GraphViz for small example networks.

What tools do you like to use?

Tuesday, February 26, 2008

Google Chatback

Google just released a new gadget that will allow people visiting your blog or website to chat with you (via Google Talk). It is like the live chat and call-back buttons that have been available previously. To set it up, all you need to do is add the chatback badge code to your blog. Then, it'll look something like this...

Monday, February 25, 2008

Quick Mac and Windows Keyboard Switching

Since Mac OS X doesn't save profiles for multiple keyboards (which I hope will change in subsequent versions), I had to find a solution for quickly changing between a Windows style keyboard and a Mac style keyboard. After spending some time with Google, I found some AppleScript that seems to provide an adequate solution. For convenience, I made two scripts: one called keyboard_win.scpt that switches the modifier keys on a Windows style keyboard to behave Mac-like, and one called keyboard_mac.scpt that restores the default keyboard behavior for a Mac style keyboard.

(1) keyboard_win.scpt:
(2) keyboard_mac.scpt:
Hopefully, this will save you some time.