Create web server to download files
It allows you to create web applications with Apache2, PHP and a Mysql database. Alongside, PhpMyAdmin allows you to manage easily your databases. Web crawlers typically identify themselves to a Web server by using the User-agent field of an HTTP request. Web site administrators typically examine their Web servers' log and use the user agent field to determine which crawlers have…