It’s done! System reached its first million!
1,169,265 pages got already parsed from internet with links, keywords and other useful information. From those, 769,636 are already processed for duplication. From those pages, 15,521,162 are still to be loaded by the clients.
Slowly, but surely, database is growing.
For the work in progress, I’m currently working on the servers machines. I’m planning to had 2 new servers and remove one which is to slow.
I have also started on the automated reporting to display automatically on this site the number of pages processed and the number of links pending for retrieval.
Let’s see when we will reach the 2 millions…