Tuesday, February 14, 2006
Based on the feedback for the proposal we choose a new topic, the basic idea is to cluster the bloglines blogs. Here is our proposal. We have submit the a new proposal.
Mining for Blog communities
Personal Blogs gives rise to interesting social networks. When we consider a Personal blog as a vertex of a graph, there are two types of edges that are connected to that particular vertex. Given a particular blog X;
Apart form this there are subscriptions are pointed to popular news feeds which could potentially unveil information about the user. In this project we try to analyze the connectivity of public blogs at www.bloglines.com to identify the communities and to observe the interests of the groups based on the public
news feeds they refer to. The information will be mined at the blogs of individuals starting form seeds harvested by querying the subscribers to popular news feeds. Starting form these seeds the system will identify and build blog connectivity graph which would be a directed graph in which the vertices would represent the individual bloggers and the edges would represent the subscriptions to blogs. In other words the If A has subscribed
to B's blog then (A, B) would be a directed edge.
The analysis is geared towards
Tasks
Note: We have looked in to the robots.txt file at www.bloglines.com and we can extract necessary information without violating it.
Mining for Blog communities
Personal Blogs gives rise to interesting social networks. When we consider a Personal blog as a vertex of a graph, there are two types of edges that are connected to that particular vertex. Given a particular blog X;
- Subscriptions to the blog X
- Blog X owner's Subscriptions
Apart form this there are subscriptions are pointed to popular news feeds which could potentially unveil information about the user. In this project we try to analyze the connectivity of public blogs at www.bloglines.com to identify the communities and to observe the interests of the groups based on the public
news feeds they refer to. The information will be mined at the blogs of individuals starting form seeds harvested by querying the subscribers to popular news feeds. Starting form these seeds the system will identify and build blog connectivity graph which would be a directed graph in which the vertices would represent the individual bloggers and the edges would represent the subscriptions to blogs. In other words the If A has subscribed
to B's blog then (A, B) would be a directed edge.
The analysis is geared towards
- Community identification
- Identifying meta-groups of similar interest within a community by filtering the individuals that has subscribed to popular feeds of same or similar interest.
- Given initials seeds that would contain blogs of individuals that share same interest or may be interested in same area of technology, identify a community that consist of individuals that share the same interest with high probability.
Tasks
- Identifying seed blogs - This would be based on either harvesting the blog by
- going to subscribers to popular news feed or by user input depending on the use case.
- Crawling the blogs - Involves crawling the blogs based on initial seeds and
- building a frontier by analyzing already crawled blogs.
- Social network analysis using graph algorithms - Involves connectivity graph
- analysis and graph overlap analysis based on use case.
- Visualization and filtering of communities -Using a visualization package to
- visualize the output graph and to emphasize the relationships and clusters/communities identified.
Note: We have looked in to the robots.txt file at www.bloglines.com and we can extract necessary information without violating it.
# posted by Web Mining (B659) 2006 @ 8:09 PM 
