Alex Xu on Twitter: "🔹 Optimize the web page The crawler crawls the HTML contents, therefore the title and description should be optimized to include keywords and also be concise. The body
![A web page distillation strategy for efficient focused crawling based on optimized Naïve bayes (ONB) classifier - ScienceDirect A web page distillation strategy for efficient focused crawling based on optimized Naïve bayes (ONB) classifier - ScienceDirect](https://ars.els-cdn.com/content/image/1-s2.0-S1568494616306536-gr2.jpg)
A web page distillation strategy for efficient focused crawling based on optimized Naïve bayes (ONB) classifier - ScienceDirect
![Sustainability | Free Full-Text | Using Web Crawler Technology for Geo-Events Analysis: A Case Study of the Huangyan Island Incident Sustainability | Free Full-Text | Using Web Crawler Technology for Geo-Events Analysis: A Case Study of the Huangyan Island Incident](https://pub.mdpi-res.com/sustainability/sustainability-06-01896/article_deploy/html/images/sustainability-06-01896-g001.png?1424778107)
Sustainability | Free Full-Text | Using Web Crawler Technology for Geo-Events Analysis: A Case Study of the Huangyan Island Incident
![Development of training image database using web crawling for vision-based site monitoring - ScienceDirect Development of training image database using web crawling for vision-based site monitoring - ScienceDirect](https://ars.els-cdn.com/content/image/1-s2.0-S0926580522000140-gr1.jpg)