[WIP] ES Search 2

Post » Tue May 17, 2011 8:00 am

I'd love this! There's a PES one though? Where at?
http://www.yacoby.net/searchplugins/index.php
User avatar
Jenna Fields
 
Posts: 3396
Joined: Mon Dec 11, 2006 11:36 am

Post » Tue May 17, 2011 8:50 am

http://www.yacoby.net/searchplugins/index.php

Thank you kind sir. :)

Now I hope to see some more soon, maybe ones for GHF, TR, the Morrowind sections here, TES Nexus, etc.
User avatar
Emma-Jane Merrin
 
Posts: 3477
Joined: Fri Aug 08, 2008 1:52 am

Post » Tue May 17, 2011 8:59 am

Can anyone see any major issues with swapping from the current version to http://search2.yacoby.net? Quick check that it all works OK etc
User avatar
carla
 
Posts: 3345
Joined: Wed Aug 23, 2006 8:36 am

Post » Tue May 17, 2011 5:51 am

Just did a search on my mods (of course :P)
It returns results for the previous version of mods that don't exist anymore.

eg:
http://search2.yacoby.net/mods/19917/Signy+Signposts(!%3b%29%3A+Tamriel+Rebuilt
http://search2.yacoby.net/mods/8523/Signy+Signposts(!%3b%29+-+TR+Map+1%3A+Telvannis

Both of these links contain a link to the same PES page, but one reads as the previous version of the mod.
I guess that this is part of the caching? :unsure:
User avatar
anna ley
 
Posts: 3382
Joined: Fri Jul 07, 2006 2:04 am

Post » Tue May 17, 2011 5:09 am

Just did a search on my mods (of course :P)
It returns results for the previous version of mods that don't exist anymore.

[censored] :P

Thanks for pointing that out :). I knew about the issue but didn't think it would be a major problem.

The issue is that the new version doesn't map URLs to mods. Sure the mod has a url, but that is just a property. Everything is based arround the name and author. This has a bonus in that you can have multiple mods per url, but some major drawbacks (as you pointed out) in that changing the name leads to a new entry. It is basically the exact opposite of version 1 that had a very strong relationship between the mod and url.

The two solutions I can think of. One is to only allow one mod per url. The other is to allow users to report duplicates. They both have their upsides and downsides, but I think I am leaning to only allowing one mod per url as it requires less longterm effort on my part.

I'll take a look
User avatar
Laura Elizabeth
 
Posts: 3454
Joined: Wed Oct 11, 2006 7:34 pm

Post » Tue May 17, 2011 4:18 am

I just have a request/idea. Is it possible to make a firefox search plugin from it like your PES and other site ones? It would make it a lot easier.


Seconded! I was hoping someone else has suggested this before me. :)

Just saw the thread, so I'll get the new search a try. :)

Edit: Works well. And its fast. :) Perhaps you should note in the results that the wiwiland links are in french?
User avatar
Matt Bigelow
 
Posts: 3350
Joined: Sun Sep 30, 2007 6:36 pm

Post » Tue May 17, 2011 9:01 am

The two solutions I can think of. One is to only allow one mod per url. The other is to allow users to report duplicates. They both have their upsides and downsides, but I think I am leaning to only allowing one mod per url as it requires less longterm effort on my part.

Sounds like a good solution. :)
If the issue only crops up when the title of a mod changes, then it's probably a fairly uncommon issue too. You're just unlucky that I happened to come upon this thread. :P

Otherwise, this ES Search 2 is great. I like how when I searched Souly Soulgems(!), it gave one mod entry, which then expands in the next page to locations of the mod - plus version numbers. Works brilliantly. :D
User avatar
renee Duhamel
 
Posts: 3371
Joined: Thu Dec 14, 2006 9:12 am

Post » Tue May 17, 2011 12:01 am

How often do you index PES Yacoby?

Just wondered as I did a search on a couple of mods and they didn't come up either by author name or mod name - they are about 6 months old now - so was just wondering if newer content than mine was being picked up?
User avatar
Chloe :)
 
Posts: 3386
Joined: Tue Jun 13, 2006 10:00 am

Post » Mon May 16, 2011 11:43 pm

Sounds like a good solution. :)
If the issue only crops up when the title of a mod changes, then it's probably a fairly uncommon issue too. You're just unlucky that I happened to come upon this thread. :P

I have just thought of a third solution, which is to switch over to version 2 now, see how it preforms (read does the host complain about cpu usage) and update the code when I have the time.

How often do you index PES Yacoby?

Just wondered as I did a search on a couple of mods and they didn't come up either by author name or mod name - they are about 6 months old now - so was just wondering if newer content than mine was being picked up?

Theoretically 24/7. Can you give me the mod names and I will look into it :)
User avatar
Danger Mouse
 
Posts: 3393
Joined: Sat Oct 07, 2006 9:55 am

Post » Tue May 17, 2011 5:30 am

I have just thought of a third solution, which is to switch over to version 2 now, see how it preforms (read does the host complain about cpu usage) and update the code when I have the time.

It's a really minor issue anyway, to the extent that I personally might not even be bothered with fixing it, if I were in your position. :P
Let's hope the host doesn't complain. :D

Your hard work is appreciated, Yacoby. :goodjob:
User avatar
Susan Elizabeth
 
Posts: 3420
Joined: Sat Oct 21, 2006 4:35 pm

Post » Tue May 17, 2011 6:26 am

I don't see any reason to delay indexing MMH. I've decided not to do anything with the domain right now. I've got another project on the drawing board which is going to usurp this one, but it will take a number of months to even get somewhat functional. So consider MMH to be somewhat permanent until further notice.
User avatar
Portions
 
Posts: 3499
Joined: Thu Jun 14, 2007 1:47 am

Post » Mon May 16, 2011 11:55 pm

I don't see any reason to delay indexing MMH. I've decided not to do anything with the domain right now. I've got another project on the drawing board which is going to usurp this one, but it will take a number of months to even get somewhat functional. So consider MMH to be somewhat permanent until further notice.

Good to know. I will get around to writing the indexer when I have completed version 2.1 (fixing the issue Earth_Wyrm mentioned, more unit tests, better UI etc). ATM I have got a UI I am far happier with and I am in the process of tweaking the screen scraqer to keep line breaks in the descriptions. Then I just have to write a load of tests for some things that may fail, re factor the code a bit and I will call it done :)

I am also hoping to make the code open source at some point. Nothing gained from keeping it closed source really and it is complex enough that it isn't really easy to set up, so my main concern of having 1000s of script kiddies setting up sites, using my code and ruining mod sites bandwidth isn't too much of an issue. (I doubt many shared servers would like the size or the load. Libraries included it is about 80mb of code alone :P)

I would also like to have database dumps available for download. :)
User avatar
kiss my weasel
 
Posts: 3221
Joined: Tue Feb 20, 2007 9:08 am

Post » Tue May 17, 2011 8:20 am

Sorry to interupt, firstly, great work with this so far Yacoby

I was just curious... how is your avatar different for every other post???

And VTMB is an amazing game!!!
User avatar
Lilit Ager
 
Posts: 3444
Joined: Thu Nov 23, 2006 9:06 pm

Post » Tue May 17, 2011 12:25 pm

I was just curious... how is your avatar different for every other post???
My avatar is severed from a script rather than a static image. The script then choses an image and sends it as a response.
User avatar
Manuela Ribeiro Pereira
 
Posts: 3423
Joined: Fri Nov 17, 2006 10:24 pm

Post » Tue May 17, 2011 1:15 am

http://search2.yacoby.net/. Comments and Constructive Crits.

The two things I know of are:
Doesn't swap between simple and advanced searches anywhere except the home page
Doesn't store the game selection, so you have to continually re-select Oblivion.
User avatar
Juliet
 
Posts: 3440
Joined: Fri Jun 23, 2006 12:49 pm

Post » Tue May 17, 2011 5:32 am

Great job on the new version! I love it. Much better than ver. 1. Especially having the descriptions on the search page. Makes finding what you're looking much, much faster.
User avatar
Tracey Duncan
 
Posts: 3299
Joined: Wed Apr 18, 2007 9:32 am

Post » Tue May 17, 2011 2:21 pm

My search for "Tamriel Rebuilt" displays results from Oblivion mods when I have selected Morrowind. I don't know if it's because they're not attributed properly wherever they are located, or if its on the search engine's end.
User avatar
KiiSsez jdgaf Benzler
 
Posts: 3546
Joined: Fri Mar 16, 2007 7:10 am

Post » Tue May 17, 2011 8:25 am

My search for "Tamriel Rebuilt" displays results from Oblivion mods when I have selected Morrowind. I don't know if it's because they're not attributed properly wherever they are located, or if its on the search engine's end.

:banghead: My bad somewhere. I will see if I can get it fixed :)

Edit1:
It is an error in the index, not in the main db.


Edit2:
Found the issue, it was adding mod details to all open indexes rather than just the correct one.

Edit3:
7 hours to rebuild the index :(
User avatar
Darlene Delk
 
Posts: 3413
Joined: Mon Aug 27, 2007 3:48 am

Post » Tue May 17, 2011 10:07 am

My search for "Tamriel Rebuilt" displays results from Oblivion mods when I have selected Morrowind. I don't know if it's because they're not attributed properly wherever they are located, or if its on the search engine's end.

Thanks for your testing (I need to get that credits page together at some point), I have rebuilt the index, so the http://search2.yacoby.net/ should work fine.

It was a subtle bug in that I store Morrowind and Oblivion search data in different indexes, but due to an error, when adding a mod it opened (if required) the index but added the mod to all open indexes. Fine if I only add one mod at a time, but when more than one from different games, it adds them to both.
User avatar
Prisca Lacour
 
Posts: 3375
Joined: Thu Mar 15, 2007 9:25 am

Post » Tue May 17, 2011 12:13 am

I could give you some results from a quick test of the http://search2.yacoby.net/ of yours. I search for "Morrowind Mod" and I get a mixed list of both mods & tools. I don't know if you would expect that. I have already made a bookmark of the http://search2.yacoby.net/ to test it further. :talk: :twirl:
User avatar
Talitha Kukk
 
Posts: 3477
Joined: Sun Oct 08, 2006 1:14 am

Post » Tue May 17, 2011 1:05 am

Cool, it appears to be working properly in regard to the previous aspects now. Although you misspelled the word "design" on your copyright footer :P

EDIT: and I believe your temporary display about monkeys or something includes the word "infinate", which should instead be "infinite" (no a).
User avatar
Danial Zachery
 
Posts: 3451
Joined: Fri Aug 24, 2007 5:41 am

Post » Tue May 17, 2011 10:08 am

I love the "general" input field. The searches from Census and Excise Office that are based solely upon the file name now return far more relevant hits. :goodjob:
User avatar
Alexis Estrada
 
Posts: 3507
Joined: Tue Aug 29, 2006 6:22 pm

Post » Mon May 16, 2011 11:44 pm

I love the "general" input field. The searches from Census and Excise Office that are based solely upon the file name now return far more relevant hits. :goodjob:

That was partly the idea, as it also allows me to put together some browser search plugins :)

I could give you some results from a quick test of the http://search2.yacoby.net/ of yours. I search for "Morrowind Mod" and I get a mixed list of both mods & tools. I don't know if you would expect that.

I haven't separated tools from the other mods as it is more effort for a smaller amount of payback and a more complex interface.

Cool, it appears to be working properly in regard to the previous aspects now. Although you misspelled the word "design" on your copyright footer :P

EDIT: and I believe your temporary display about monkeys or something includes the word "infinate", which should instead be "infinite" (no a).

:lol: I am fairly sure I would misspell my own name if given the chance ;)
User avatar
Ysabelle
 
Posts: 3413
Joined: Sat Jul 08, 2006 5:58 pm

Post » Tue May 17, 2011 12:38 am

Project is now http://code.google.com/p/es-search/ for anyone who is interested. The http://code.google.com/p/es-search/source/browse/#svn/trunkbe looked at without a svn client
User avatar
Ludivine Dupuy
 
Posts: 3418
Joined: Tue Mar 27, 2007 6:51 pm

Post » Tue May 17, 2011 1:54 am

At some point soon (within a day), it should start indexing modhistory.fliggerty.com :)

It is only indexing http://modhistory.fliggerty.com/index.php?cid=5 at the moment. I don't know how many of the files are going to be moved from the unprocessed section?


As a quick UI question, how useful was it having the start of the descriptions visible on the search page without having to on the link to get it to load it?
User avatar
Abi Emily
 
Posts: 3435
Joined: Wed Aug 09, 2006 7:59 am

PreviousNext

Return to III - Morrowind