[WIP] TES Search

Post » Sat Oct 08, 2011 11:26 pm

I'd love this! There's a PES one though? Where at?
http://www.yacoby.net/searchplugins/index.php
User avatar
Teghan Harris
 
Posts: 3370
Joined: Mon Mar 05, 2007 1:31 pm

Post » Sun Oct 09, 2011 12:06 pm

http://www.yacoby.net/searchplugins/index.php

Thank you kind sir. :)

Now I hope to see some more soon, maybe ones for GHF, TR, the Morrowind sections here, TES Nexus, etc.
User avatar
Catharine Krupinski
 
Posts: 3377
Joined: Sun Aug 12, 2007 3:39 pm

Post » Sat Oct 08, 2011 10:46 pm

Can anyone see any major issues with swapping from the current version to http://search2.yacoby.net? Quick check that it all works OK etc
User avatar
Yonah
 
Posts: 3462
Joined: Thu Aug 02, 2007 4:42 am

Post » Sun Oct 09, 2011 3:45 am

Just did a search on my mods (of course :P)
It returns results for the previous version of mods that don't exist anymore.

eg:
http://search2.yacoby.net/mods/19917/Signy+Signposts(!%3b%29%3A+Tamriel+Rebuilt
http://search2.yacoby.net/mods/8523/Signy+Signposts(!%3b%29+-+TR+Map+1%3A+Telvannis

Both of these links contain a link to the same PES page, but one reads as the previous version of the mod.
I guess that this is part of the caching? :unsure:
User avatar
Chantel Hopkin
 
Posts: 3533
Joined: Sun Dec 03, 2006 9:41 am

Post » Sat Oct 08, 2011 7:51 pm

Just did a search on my mods (of course :P)
It returns results for the previous version of mods that don't exist anymore.

[censored] :P

Thanks for pointing that out :). I knew about the issue but didn't think it would be a major problem.

The issue is that the new version doesn't map URLs to mods. Sure the mod has a url, but that is just a property. Everything is based arround the name and author. This has a bonus in that you can have multiple mods per url, but some major drawbacks (as you pointed out) in that changing the name leads to a new entry. It is basically the exact opposite of version 1 that had a very strong relationship between the mod and url.

The two solutions I can think of. One is to only allow one mod per url. The other is to allow users to report duplicates. They both have their upsides and downsides, but I think I am leaning to only allowing one mod per url as it requires less longterm effort on my part.

I'll take a look
User avatar
Teghan Harris
 
Posts: 3370
Joined: Mon Mar 05, 2007 1:31 pm

Post » Sun Oct 09, 2011 9:11 am

I just have a request/idea. Is it possible to make a firefox search plugin from it like your PES and other site ones? It would make it a lot easier.


Seconded! I was hoping someone else has suggested this before me. :)

Just saw the thread, so I'll get the new search a try. :)

Edit: Works well. And its fast. :) Perhaps you should note in the results that the wiwiland links are in french?
User avatar
sam westover
 
Posts: 3420
Joined: Sun Jun 10, 2007 2:00 pm

Post » Sat Oct 08, 2011 8:05 pm

The two solutions I can think of. One is to only allow one mod per url. The other is to allow users to report duplicates. They both have their upsides and downsides, but I think I am leaning to only allowing one mod per url as it requires less longterm effort on my part.

Sounds like a good solution. :)
If the issue only crops up when the title of a mod changes, then it's probably a fairly uncommon issue too. You're just unlucky that I happened to come upon this thread. :P

Otherwise, this ES Search 2 is great. I like how when I searched Souly Soulgems(!), it gave one mod entry, which then expands in the next page to locations of the mod - plus version numbers. Works brilliantly. :D
User avatar
Stephanie Valentine
 
Posts: 3281
Joined: Wed Jun 28, 2006 2:09 pm

Post » Sun Oct 09, 2011 8:32 am

How often do you index PES Yacoby?

Just wondered as I did a search on a couple of mods and they didn't come up either by author name or mod name - they are about 6 months old now - so was just wondering if newer content than mine was being picked up?
User avatar
Jade Barnes-Mackey
 
Posts: 3418
Joined: Thu Jul 13, 2006 7:29 am

Post » Sun Oct 09, 2011 10:37 am

Sounds like a good solution. :)
If the issue only crops up when the title of a mod changes, then it's probably a fairly uncommon issue too. You're just unlucky that I happened to come upon this thread. :P

I have just thought of a third solution, which is to switch over to version 2 now, see how it preforms (read does the host complain about cpu usage) and update the code when I have the time.

How often do you index PES Yacoby?

Just wondered as I did a search on a couple of mods and they didn't come up either by author name or mod name - they are about 6 months old now - so was just wondering if newer content than mine was being picked up?

Theoretically 24/7. Can you give me the mod names and I will look into it :)
User avatar
Krista Belle Davis
 
Posts: 3405
Joined: Tue Aug 22, 2006 3:00 am

Post » Sun Oct 09, 2011 9:18 am

I have just thought of a third solution, which is to switch over to version 2 now, see how it preforms (read does the host complain about cpu usage) and update the code when I have the time.

It's a really minor issue anyway, to the extent that I personally might not even be bothered with fixing it, if I were in your position. :P
Let's hope the host doesn't complain. :D

Your hard work is appreciated, Yacoby. :goodjob:
User avatar
Zach Hunter
 
Posts: 3444
Joined: Wed Aug 08, 2007 3:26 pm

Post » Sun Oct 09, 2011 1:25 am

I don't see any reason to delay indexing MMH. I've decided not to do anything with the domain right now. I've got another project on the drawing board which is going to usurp this one, but it will take a number of months to even get somewhat functional. So consider MMH to be somewhat permanent until further notice.
User avatar
Shannon Marie Jones
 
Posts: 3391
Joined: Sun Nov 12, 2006 3:19 pm

Post » Sun Oct 09, 2011 12:54 am

I don't see any reason to delay indexing MMH. I've decided not to do anything with the domain right now. I've got another project on the drawing board which is going to usurp this one, but it will take a number of months to even get somewhat functional. So consider MMH to be somewhat permanent until further notice.

Good to know. I will get around to writing the indexer when I have completed version 2.1 (fixing the issue Earth_Wyrm mentioned, more unit tests, better UI etc). ATM I have got a UI I am far happier with and I am in the process of tweaking the screen scraqer to keep line breaks in the descriptions. Then I just have to write a load of tests for some things that may fail, re factor the code a bit and I will call it done :)

I am also hoping to make the code open source at some point. Nothing gained from keeping it closed source really and it is complex enough that it isn't really easy to set up, so my main concern of having 1000s of script kiddies setting up sites, using my code and ruining mod sites bandwidth isn't too much of an issue. (I doubt many shared servers would like the size or the load. Libraries included it is about 80mb of code alone :P)

I would also like to have database dumps available for download. :)
User avatar
Andres Lechuga
 
Posts: 3406
Joined: Sun Aug 12, 2007 8:47 pm

Post » Sat Oct 08, 2011 9:08 pm

Sorry to interupt, firstly, great work with this so far Yacoby

I was just curious... how is your avatar different for every other post???

And VTMB is an amazing game!!!
User avatar
Blackdrak
 
Posts: 3451
Joined: Thu May 17, 2007 11:40 pm

Post » Sun Oct 09, 2011 3:27 am

I was just curious... how is your avatar different for every other post???
My avatar is severed from a script rather than a static image. The script then choses an image and sends it as a response.
User avatar
Judy Lynch
 
Posts: 3504
Joined: Fri Oct 20, 2006 8:31 am

Post » Sun Oct 09, 2011 12:14 pm

http://search2.yacoby.net/. Comments and Constructive Crits.

The two things I know of are:
Doesn't swap between simple and advanced searches anywhere except the home page
Doesn't store the game selection, so you have to continually re-select Oblivion.
User avatar
Chloe Mayo
 
Posts: 3404
Joined: Wed Jun 21, 2006 11:59 pm

Post » Sun Oct 09, 2011 6:52 am

Great job on the new version! I love it. Much better than ver. 1. Especially having the descriptions on the search page. Makes finding what you're looking much, much faster.
User avatar
Captian Caveman
 
Posts: 3410
Joined: Thu Sep 20, 2007 5:36 am

Post » Sun Oct 09, 2011 8:14 am

My search for "Tamriel Rebuilt" displays results from Oblivion mods when I have selected Morrowind. I don't know if it's because they're not attributed properly wherever they are located, or if its on the search engine's end.
User avatar
Luis Reyma
 
Posts: 3361
Joined: Fri Nov 02, 2007 11:10 am

Post » Sun Oct 09, 2011 10:13 am

My search for "Tamriel Rebuilt" displays results from Oblivion mods when I have selected Morrowind. I don't know if it's because they're not attributed properly wherever they are located, or if its on the search engine's end.

:banghead: My bad somewhere. I will see if I can get it fixed :)

Edit1:
It is an error in the index, not in the main db.


Edit2:
Found the issue, it was adding mod details to all open indexes rather than just the correct one.

Edit3:
7 hours to rebuild the index :(
User avatar
Krista Belle Davis
 
Posts: 3405
Joined: Tue Aug 22, 2006 3:00 am

Post » Sat Oct 08, 2011 8:55 pm

My search for "Tamriel Rebuilt" displays results from Oblivion mods when I have selected Morrowind. I don't know if it's because they're not attributed properly wherever they are located, or if its on the search engine's end.

Thanks for your testing (I need to get that credits page together at some point), I have rebuilt the index, so the http://search2.yacoby.net/ should work fine.

It was a subtle bug in that I store Morrowind and Oblivion search data in different indexes, but due to an error, when adding a mod it opened (if required) the index but added the mod to all open indexes. Fine if I only add one mod at a time, but when more than one from different games, it adds them to both.
User avatar
Klaire
 
Posts: 3405
Joined: Wed Sep 27, 2006 7:56 am

Post » Sun Oct 09, 2011 10:02 am

I could give you some results from a quick test of the http://search2.yacoby.net/ of yours. I search for "Morrowind Mod" and I get a mixed list of both mods & tools. I don't know if you would expect that. I have already made a bookmark of the http://search2.yacoby.net/ to test it further. :talk: :twirl:
User avatar
Shelby McDonald
 
Posts: 3497
Joined: Sat Jan 13, 2007 2:29 pm

Post » Sat Oct 08, 2011 11:07 pm

Cool, it appears to be working properly in regard to the previous aspects now. Although you misspelled the word "design" on your copyright footer :P

EDIT: and I believe your temporary display about monkeys or something includes the word "infinate", which should instead be "infinite" (no a).
User avatar
~Amy~
 
Posts: 3478
Joined: Sat Aug 12, 2006 5:38 am

Post » Sat Oct 08, 2011 7:42 pm

I love the "general" input field. The searches from Census and Excise Office that are based solely upon the file name now return far more relevant hits. :goodjob:
User avatar
Tamara Primo
 
Posts: 3483
Joined: Fri Jul 28, 2006 7:15 am

Post » Sun Oct 09, 2011 6:20 am

I love the "general" input field. The searches from Census and Excise Office that are based solely upon the file name now return far more relevant hits. :goodjob:

That was partly the idea, as it also allows me to put together some browser search plugins :)

I could give you some results from a quick test of the http://search2.yacoby.net/ of yours. I search for "Morrowind Mod" and I get a mixed list of both mods & tools. I don't know if you would expect that.

I haven't separated tools from the other mods as it is more effort for a smaller amount of payback and a more complex interface.

Cool, it appears to be working properly in regard to the previous aspects now. Although you misspelled the word "design" on your copyright footer :P

EDIT: and I believe your temporary display about monkeys or something includes the word "infinate", which should instead be "infinite" (no a).

:lol: I am fairly sure I would misspell my own name if given the chance ;)
User avatar
sara OMAR
 
Posts: 3451
Joined: Wed Jul 05, 2006 11:18 pm

Post » Sun Oct 09, 2011 11:26 am

Project is now http://code.google.com/p/es-search/ for anyone who is interested. The http://code.google.com/p/es-search/source/browse/#svn/trunkbe looked at without a svn client
User avatar
Jeneene Hunte
 
Posts: 3478
Joined: Mon Sep 11, 2006 3:18 pm

Post » Sun Oct 09, 2011 12:20 pm

At some point soon (within a day), it should start indexing modhistory.fliggerty.com :)

It is only indexing http://modhistory.fliggerty.com/index.php?cid=5 at the moment. I don't know how many of the files are going to be moved from the unprocessed section?


As a quick UI question, how useful was it having the start of the descriptions visible on the search page without having to on the link to get it to load it?
User avatar
T. tacks Rims
 
Posts: 3447
Joined: Wed Oct 10, 2007 10:35 am

PreviousNext

Return to III - Morrowind