Idea: Transaction Logger

It would be great to create a device that logs all of my transactions (whatever the method used to purchase) that could be carried around while shopping. This would then enable consumers to do personal data-mining on all of their own transactions. This would be a unique tool to help consumers improve purchasing habits and make smarter decisions. Additional interesting product associations could also be calculated and analyzed.

Web Data Mining (for Business Intelligence)

Bamshad Mobasher teaches a nice Web Mining course entitled "Web Data Mining (for Business Intelligence)" at DePaul University in Illinois. Currently, it is one of the few courses dedicated solely to this topic. I expect, as time goes, the number of courses on this topic will grow dramatically.

Exploring Bayesian Methods

Bayesian methods can be used to deal with uncertainty.
Here are some links that help to explore the area:
Bayesian Inference
Empirical Bayes
Hierarchal Bayes
Bayesian Network
Bayes' theorem

Statistics Topics
Expected Value
Likelihood
Mean
Variance
Mean Squared Error (MSE)
Posterior Probability
Conditional, Joint, and Marginal Probability
Utility Functions (Link  2)

Distributions
Normal
Gamma
Poisson
Beta
Binomial
Conjugate Prior

Other Related Topics
Markov Chain Monte Carlo (MCMC)
Simulated Annealing
Tabu Search (Link 2)
Kalman Filter (Link 2)
Particle Filter
Directed Acyclic Graphs (DAG)
Markovian Random Field (MRF)
EM Algorithm (Bayesian Structural EM - Friedman)
Reading List of Bayesian Methods

Helpful Software
JavaBayes
Graphviz

Useful Java Libraries
Colt
Tomato

Web Content Mining: Bing Liu

Bing Liu from the University of Chicago is very interested in Web Content Mining. He compiled of list of references regarding the topic. In addition, he gave a tutorial on Web content mining in Chiba, Japan in May, 2005.

Natural Language Processing

Here is a nice introduction and dictionary for Natural Langauge Processing (NLP). This reference might come in handy when mining text documents.

Link to Tingshao Zhu's Web Mining Research

Personalized Assistance System

A researcher, from Penn State, has been working on a personalized assistance system that automatically helps users find more relevant search results (see the article).

Stages of Knowledge Discovery in Websites

                                          |------------------
                     |--------------------| 3. PERSONALIZATION
|---------------------| 2. Advanced Web Mining
| 1. Clickstream Analysis

Personalization Companies

Rule-based Personalization:
ATG, BroadVision, Epiphany, Blue Martini

Collaborative Filtering Personalization:
Amazon.com

Statistical Modeling:
Touch Clarity

State-based Personalization:
Xamplify

Web Mining Research Links by Tingshao Zhu

Social Network Analysis

The Oracle of Bacon

Erdös Number Project

Six Degrees of Separation Experiment

ReferralWeb

Scale-Free Networks

Most social networks including the Web seem to be scale-free networks. A Scale-free network is unique because a small number of nodes are highly connected (e.g., the majority of nodes are sparsely connected).

Wikipedia Encyclopedia

Data Mining Researchers

Rakesh Agrawal
Surajit Chaudhuri
Umesh Dayal
Max J. Egenhofer
Usama Fayyad (Microsoft)
Christophe Giraud-Carrier
Jiawei Han
Daniel Keim
Hans-Peter Kriegel
Yike Guo
Laks V.S. Lakshmanan
Hongjun Lu
Alberto Mendelzon
Raymond T. Ng
Tamer Ozsu
Rajeev Rastogi
Ken Ross
Sunita Sarawagi
Wei-Min Shen
Kyuseok Shim
Avi Silberschatz
Matt Smith
Jaideep Srivastava
Philip S. Yu
Clement Yu
Jeffrey D. Ullman
Ke Wang
Osmar Zaiane

24 Key Database Marketing Techniques

This article is a good overview of 24 marketing methods which are useful in determining what data should be collected in order to personalize a website.

Collaborative Filtering Resources

Collaborative Filtering (Berkeley)

Data Mining Resources

Data Mining Resources (@ www.scd.ucar.edu)

Data Mining Resources (@ www.cs.purdue.edu)

Data Mining Resources (Zillman's List)