|
|
|
|
|
http://ljfind.livejournal.com/4201.html
More...
Published by :ljfind 2006-03-29 12:38:16.0
|
|
|
|
http://ljfind.livejournal.com/4033.html
OKay so finally we have got to the point that search works accross the whole index. This is currently 25 million posts, and 1 million journals. We still have some work to do, but I expect to put it live in a couple of weeks. Search currently takes 2 seconds on average, sometimes longer sometimes much faster. We will obviously be working to make this faster in the future, but for now Im quite happy.
More...
Published by :ljfind 2006-03-08 15:02:48.0
|
|
|
|
http://ljfind.livejournal.com/3621.html
So ok, the website is making good progress we can now search and return journals userpic, text and link to the post. The next week or so will be spent resolving the search side, as at the moment it only searches a few million posts. Once this is done I can hesitantly release a basic search. I wont however be publishing this to widely, as I want there to be loads more features available first.
SO stay tuned
More...
Published by :ljfind 2006-02-28 15:37:18.0
|
|
|
|
http://ljfind.livejournal.com/3499.html
The first phase of the website development is nearly complete.
The programmer has calculated if we slow the search down we should be able to stop the memory problems, it means searches will take a couple of seconds rather than miliseconds, so sorry about that!
We are seperating search, indexing and crawling into seperate processes all next week so if there is a problem with one it wont effect th
More...
Published by :ljfind 2006-02-22 13:55:05.0
|
|
|
|
http://ljfind.livejournal.com/3087.html
Well search is currently working but only on a very limited number of posts (about 5 million). We get memory issues on the current hardware, so will either have to upgrade the memory (from 4gb to 8gb) or rewrite our methods..
Our servlet container seems to crash once a day at the mo, but the programmer as found a bug which he is currently fixing. Then we are going to work full steam ahead on website develo
More...
Published by :ljfind 2006-02-17 10:01:59.0
|
|
|
|
http://ljfind.livejournal.com/2972.html
So I have come back from snowboarding in Meribel France after an awesome week to find our indexer software seemed to not handle an index over 3.5 gb which meant the developers rewrote it to work in lots of seperate index files. I am at the least annoyed and the most pissed off! I was really hoping to see good progress on the website it now turns out we have almost moved backwards, as I cant run the search! We hope to
More...
Published by :ljfind 2006-02-13 16:30:42.0
|
|
|
|
http://ljfind.livejournal.com/2534.html
So In the last minute today search was working. This left me in a great mood for my holiday.Finally it seems things are coming together! The developers had to create a mirrored index , one ofr updating, one for runniong searches against it runs lighting quick Im very pleased. Hopefully good progress will be made on the website next week.
More...
Published by :ljfind 2006-02-13 16:22:17.0
|
|
|
|
http://ljfind.livejournal.com/2288.html
Well I am afraid we are going to miss our beta release deadline.
To be honest I am quite dissapointed with progress. I was told we would have search working online by last friday, it is now Tuesday and the search still doesnt work. It just falls over with a memory error!!! AHHHH. To make matters worse I go on holiday for a week on friday and was planning to have the beta version of search running. Now Im n
More...
Published by :ljfind 2006-01-31 17:29:06.0
|
|
|
|
http://ljfind.livejournal.com/1855.html
The crawler and listener has now been running stably for several days importing all your great journals!(Only the public ones)
The designers have now finished on the look and feel which I am very pleased with.
Its all coming together!
More...
Published by :ljfind 2006-01-26 18:06:16.0
|
|
|
|
http://ljfind.livejournal.com/1656.html
We were having real load problems on the server caused which I eventually narrowed down to a very slow query against the database. This one query was taking over 4 minutes and running every 4 minutes. The programmers managed to optimise this and serverload has dropped down from 5 to 0.5 (for unix guys).
Note to anyone running a heavy db application, optimise those queries!!!!
Anyway good progre
More...
Published by :ljfind 2006-01-23 13:13:49.0
|
|
