Comments for Teofil Achirei http://teofilachirei.wordpress.com Teofil Achirei's official blog Thu, 03 Sep 2009 12:30:43 +0000 http://wordpress.com/ hourly 1 Comment on Evil Links by Google Summer of Code 2009 « Teofil Achirei http://teofilachirei.wordpress.com/2009/04/01/evil-links/#comment-49 Google Summer of Code 2009 « Teofil Achirei Thu, 03 Sep 2009 12:30:43 +0000 http://teofilachirei.wordpress.com/?p=191#comment-49 [...] am going to start a project about style-sheet extraction, CSS analyzing and CSS optimizing” here? Well, I was talking about the style support for XOffice. This page has more information about this [...] [...] am going to start a project about style-sheet extraction, CSS analyzing and CSS optimizing” here? Well, I was talking about the style support for XOffice. This page has more information about this [...]

]]> Comment on Evil Links by dangiankit http://teofilachirei.wordpress.com/2009/04/01/evil-links/#comment-48 dangiankit Tue, 14 Jul 2009 09:09:26 +0000 http://teofilachirei.wordpress.com/?p=191#comment-48 You might be interested in learning about Crawling Web 2.0 Applications. I have cited two papers at <a href="http://en.wikipedia.org/wiki/Web_crawler#Crawling_Web_2.0_Applications" rel="nofollow">Wiki Article on Web Crawlers</a>. If you get more information, do drop me an email and update the same wiki article, for the rest of the world. You might be interested in learning about Crawling Web 2.0 Applications. I have cited two papers at Wiki Article on Web Crawlers. If you get more information, do drop me an email and update the same wiki article, for the rest of the world.

]]> Comment on Classification and clustering [part one] by teofilachirei http://teofilachirei.wordpress.com/2009/05/17/classification-clustering-1/#comment-43 teofilachirei Mon, 18 May 2009 19:23:19 +0000 http://teofilachirei.wordpress.com/?p=294#comment-43 Right now, using the Thesaurus and Link classes the crawler can only determine if a document is interesting (it's on topic) and if *some* links also look interesting and should be considering for crawling. The next step (and I'll post about it pretty soon) is to determine as accurate as possible the links that are worth to follow. That's the reason the thesaurus is so simple right now. Also, the number of links extracted from a certain page will probably be limited, because I don't want to crawl only one website. After this step is complete, I'll modify the Thesaurus class so it can be used for classifying documents (pages). Simply put: the thesaurus will have "categories" and each category will have a certain list of keywords. An hash map should be simply enough for this. To resume: - cluster or classify documents, not links - use the thesaurus just for the Best-First algorithm - the thesaurus will be soon improved and I'll come with some simple document classification Right now, using the Thesaurus and Link classes the crawler can only determine if a document is interesting (it’s on topic) and if *some* links also look interesting and should be considering for crawling.
The next step (and I’ll post about it pretty soon) is to determine as accurate as possible the links that are worth to follow. That’s the reason the thesaurus is so simple right now.
Also, the number of links extracted from a certain page will probably be limited, because I don’t want to crawl only one website.
After this step is complete, I’ll modify the Thesaurus class so it can be used for classifying documents (pages). Simply put: the thesaurus will have “categories” and each category will have a certain list of keywords. An hash map should be simply enough for this.

To resume:
- cluster or classify documents, not links
- use the thesaurus just for the Best-First algorithm
- the thesaurus will be soon improved and I’ll come with some simple document classification

]]> Comment on Classification and clustering [part one] by Ionut Popa http://teofilachirei.wordpress.com/2009/05/17/classification-clustering-1/#comment-42 Ionut Popa Mon, 18 May 2009 13:38:13 +0000 http://teofilachirei.wordpress.com/?p=294#comment-42 So are you going to use the classifier class to classify both the page and the links? Or if the document matches the thesaurus you'll extract all the links from it? So are you going to use the classifier class to classify both the page and the links? Or if the document matches the thesaurus you’ll extract all the links from it?

]]> Comment on Google Summer of Code 2009 by Ionut Popa http://teofilachirei.wordpress.com/2009/05/11/google-summer-of-code-2009/#comment-41 Ionut Popa Tue, 12 May 2009 16:05:13 +0000 http://teofilachirei.wordpress.com/?p=276#comment-41 Felicitari si spor la treaba Felicitari si spor la treaba

]]> Comment on Google Summer of Code 2009 by Amit |Web Design http://teofilachirei.wordpress.com/2009/05/11/google-summer-of-code-2009/#comment-40 Amit |Web Design Tue, 12 May 2009 09:35:57 +0000 http://teofilachirei.wordpress.com/?p=276#comment-40 Hey Good luck and enjoy Let us know how it was :) Hey
Good luck and enjoy
Let us know how it was :)

]]> Comment on Web Crawler Architectures by Does your ISP block Web Crawling? « NetEqualizer News Blog http://teofilachirei.wordpress.com/2009/04/14/web-crawler-architectures/#comment-22 Does your ISP block Web Crawling? « NetEqualizer News Blog Thu, 16 Apr 2009 14:17:16 +0000 http://teofilachirei.wordpress.com/?p=248#comment-22 [...] See also a generic flow diagram of a Web Crawler. [...] [...] See also a generic flow diagram of a Web Crawler. [...]

]]> Comment on Evil Links by 7kittens http://teofilachirei.wordpress.com/2009/04/01/evil-links/#comment-14 7kittens Wed, 08 Apr 2009 23:27:55 +0000 http://teofilachirei.wordpress.com/?p=191#comment-14 Your welcome. Post looks great. Your welcome. Post looks great.

]]> Comment on Evil Links by teofilachirei http://teofilachirei.wordpress.com/2009/04/01/evil-links/#comment-12 teofilachirei Tue, 07 Apr 2009 09:50:30 +0000 http://teofilachirei.wordpress.com/?p=191#comment-12 Thank you very much! I was searching for something like that for a long time. I tried <strong>code</strong> tag but it was awful with my current theme. It really helps! I'll try to update my posts to replace old <strong>pre</strong> tags with <strong>sourcecode</strong> Thank you very much! I was searching for something like that for a long time. I tried code tag but it was awful with my current theme.
It really helps!
I’ll try to update my posts to replace old pre tags with sourcecode

]]> Comment on Evil Links by 7kittens http://teofilachirei.wordpress.com/2009/04/01/evil-links/#comment-11 7kittens Mon, 06 Apr 2009 23:48:39 +0000 http://teofilachirei.wordpress.com/?p=191#comment-11 Oh by the way, there is a <b>sourcecode</b> tag to format and color code your example code, like so: <pre class="brush: xml;"> <script type="text/javascript"> document.write("<div style='display:none'>"); </script> <a href="URL6" rel="nofollow">Hidden Link 6</a> <script type="text/javascript"> document.write("</div>"); </script> </pre> Hope this helps. Oh by the way, there is a sourcecode tag to format and color code your example code, like so:

<script type="text/javascript">
   document.write("<div style='display:none'>");
</script>

<a href="URL6" rel="nofollow">Hidden Link 6</a>

<script type="text/javascript">
   document.write("</div>");
</script>

Hope this helps.

]]>