2011-06-06, 17:05:11
ooxoweb Wrote:I'm working on a project which requires me to stuff 1.300.000 pages, whoopsy !!! Works great for the keyword indexing until 1.000 but when I try 10.000 it's stuck, but the major problem is the sitemap it starts indexing until it reaches 1.8mo then empty itself and restart, again and again.
Would it be possible to have a sitemap.html >> sitemap/sitemapX.xml so all the links could be indexed ??? I don't know if it's a bug/problem or a feature request...
I'm using GetSimple 3.0, I18n pack, External Comment, I also have Jquery (from CDN) and fancybox.
(and if anyone have a little something to help me indexing this keywords for the I18n search thing)
Regarding I18N Search: Limiting factors are memory and execution time (e.g. my hoster limits memory to 64 MB and execution time to about 30s).
Basically all unique words and for each word all page slugs including this word are stored in memory before saving everything, e.g.
5000 unique words * 10 characters per word + 1300000 pages * 100 unique words per page * 20 characters length per slug = 2.6 GB
And for each search, the plugin would read all this information sequentially again.
I'd say this is way outside the targeted usage for I18N search.
But it's nice to know that it works with 1000 pages :-)
BTW: What are you needing a million pages for???