Signup
Welcome to... Canonfire! World of GreyhawK
Features
Touring the Flanaess
Greyhawk Wiki
#greytalk
JOIN THE CHAT
ON DISCORD
    Canonfire :: View topic - Announcement: Search through Dragon Magazine and others
    Canonfire Forum Index -> World of Greyhawk Discussion
    Announcement: Search through Dragon Magazine and others
    Author Message
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Sun May 12, 2019 8:40 am  
    Announcement: Search through Dragon Magazine and others

    Now with a web (and mobile-friendly) interface.

    Instantly search through Dragon's full run of issues including The Strategic Review, the Best of issues, and the Annuals; Oerth Journal; the LGG; and whatever else we might cram into the database.

    No ads. No frills.

    Looking for that article that had something about orgies you vaguely remember from when you were 10? This can help you find it.

    http://wait-wtf.com:3001

    Updated:

    As an experiment I've change the nature of searches over 4 characters in length to attempt to capture results that were being excluded due to bad OCR. An example of the problem being solved can be found here: http://wait-wtf.com:3001/terrible (page 21 of Dragon 10)

    If there's any feedback on the change (false positives, slow results returns, etc) feel free to let me know.


    Last edited by lamashtu on Mon Jun 10, 2019 8:53 am; edited 1 time in total
    Apprentice Greytalker

    Joined: Oct 05, 2003
    Posts: 50
    From: Gettysburg, PA

    Send private message
    Mon May 13, 2019 4:37 am  

    This is terrific, thank you!
    Dave Guerrieri
    Apprentice Greytalker

    Joined: Aug 31, 2004
    Posts: 95
    From: Charlotte, NC

    Send private message
    Tue May 14, 2019 4:22 pm  

    What is the URL?
    Master Greytalker

    Joined: Nov 01, 2007
    Posts: 698
    From: NOW IN Cape May, NJ! Loving the new digs!

    Send private message
    Thu May 16, 2019 3:17 am  
    Re: Boccob Online

    heychadwick wrote:
    What is the URL?

    Heychadwick, Lamashtu included it, above, at the end of his post.
    lamashtu wrote:
    http://wait-wtf.com:3001



    Lamashtu, it's an incredible resource.
    Very useable. Beneficial to just about any D&D player, not just Greyhawk. I'm not sure, but, it seems this is based on your work with the bot you used to work on in the old IRC chat. I'm glad you converted Boccob to an online resource.

    Congratulations, and appreciation, man.
    A *huge* addition to the gaming community.
    Many thanks for creating it, and sharing it with us.
    _________________
    Owner and Lead Admin: https://greyhawkonline.com
    Editor-in-Chief of the Oerth Journal: https://greyhawkonline.com/oerthjournal
    Visit my professional art gallery: https://wkristophnolen.daportfolio.com
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Thu May 16, 2019 7:04 am  

    That's correct Icarus, the backend is (mostly) the same as what boccob was using in IRC.

    For you and anyone following the thread, and as I say in the FAQ, I can add more sources (Dungeon? Modules?), so everyone is welcome to let me know what they'd like to see.

    Future development is contingent on use and feedback.
    Apprentice Greytalker

    Joined: Aug 31, 2004
    Posts: 95
    From: Charlotte, NC

    Send private message
    Fri May 17, 2019 3:12 am  
    Re: Boccob Online

    Icarus wrote:
    heychadwick wrote:
    What is the URL?

    Heychadwick, Lamashtu included it, above, at the end of his post.
    lamashtu wrote:
    http://wait-wtf.com:3001



    Wellll.....color me purple and call me Iggwilv! I didn't see it. I think it was too close to the lower bar.
    CF Admin

    Joined: Jun 29, 2001
    Posts: 1386
    From: Wichita, KS, USA

    Send private message
    Mon Jun 03, 2019 6:23 pm  

    Any chance we could get the 1e rulebooks added into the mix too? :D

    Allan.
    _________________
    Allan Grohe (grodog@gmail.com)
    http://www.greyhawkonline.com/grodog/greyhawk.html
    Black Hand of Oblivion

    Joined: Feb 16, 2003
    Posts: 3769
    From: So. Cal

    Send private message
    Mon Jun 03, 2019 9:32 pm  

    Just testing it out... I did a search for "Iuz." Lots of hits, but nothing going back prior to Dragon #103. Is this due to OCR problems with early issues?
    _________________
    - Moderator/Admin (in some areas)/Member -
    Forum Moderator

    Joined: Feb 26, 2004
    Posts: 2568
    From: Ullinois

    Send private message
    Tue Jun 04, 2019 5:48 pm  

    This is pretty cool, even with the limitations that Cebrion mentions. Happy
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Fri Jun 07, 2019 10:31 am  

    Cebrion wrote:
    Just testing it out... I did a search for "Iuz." Lots of hits, but nothing going back prior to Dragon #103. Is this due to OCR problems with early issues?


    I'm investigating this, however I believe you've found a bug.
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Fri Jun 07, 2019 11:57 am  

    Cebrion wrote:
    Just testing it out... I did a search for "Iuz." Lots of hits, but nothing going back prior to Dragon #103. Is this due to OCR problems with early issues?


    This should be corrected now. Some issues failed to index correctly, and a parameter on the database needed to be tweaked.

    Thank you very much for reporting this Cebrion!

    As I say in the FAQ, I probably can't/won't fix most issues - but I will always investigate them. If it's NOT a problem with the OCR, I will do my utmost to make it work.
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Fri Jun 07, 2019 2:55 pm  

    ...and whatever, figured I'd improve the sorting a bit. It's still... weird in a way that isn't yet making sense to me. But I think you'll find it improved.
    Black Hand of Oblivion

    Joined: Feb 16, 2003
    Posts: 3769
    From: So. Cal

    Send private message
    Fri Jun 07, 2019 6:44 pm  

    Yes, it would be great if it sorted sources numerically/alphabetically.

    But...getting stuff to appear at all is at the least very useful.

    The effort is greatly appreciated. Cool
    _________________
    - Moderator/Admin (in some areas)/Member -
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Fri Jun 07, 2019 7:31 pm  

    Cebrion wrote:
    Yes, it would be great if it sorted sources numerically/alphabetically.

    But...getting stuff to appear at all is at the least very useful.

    The effort is greatly appreciated. Cool


    I decided to just recreate the database with an improved schema. Sorting should be perfect now. Every issue should be able to return results (excepting those listed in the FAQ). In theory it should also bit a tiny bit quicker now.
    Black Hand of Oblivion

    Joined: Feb 16, 2003
    Posts: 3769
    From: So. Cal

    Send private message
    Sat Jun 08, 2019 5:50 pm  

    Just tried it out, and it looks like it is working really well! Cool
    _________________
    - Moderator/Admin (in some areas)/Member -
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Mon Jun 10, 2019 9:05 am  

    As an experiment I've change the nature of searches over 4 characters in length to attempt to capture results that were being excluded due to bad OCR.

    An example of the problem being solved can be found here: http://wait-wtf.com:3001/terrible (page 21 of Dragon 10)

    If there's any feedback on the change (false positives, slow results returns, etc) feel free to let me know.
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Thu Jun 20, 2019 3:22 pm  

    After a some research, I implemented a new processing chain for OCRing the sources. Took about 200 hours of every core running flat out, but the result should be a reduction in false-negatives of around 10-15%, without any slowdown to the end user.

    Future plans include:

    - adding additional sources (including the long absent Dragons 147-149)

    - providing an interface to filter out sources the user doesn't want to see

    - allowing 'match' queries, which will permit searches that require more flexibility
    Adept Greytalker

    Joined: Jul 29, 2006
    Posts: 472
    From: Dantredun, MN

    Send private message
    Thu Jun 20, 2019 5:43 pm  

    +1 for OJ#15. I've used Magna Alumnae a bit IMC.

    OJ#7 also has a bardic order of "Keepers" devoted to Wee Jas described in her article.

    The flavor text in the Complete Bard's Handbook has some light Greyhawk references.
    Master Greytalker

    Joined: Nov 01, 2007
    Posts: 698
    From: NOW IN Cape May, NJ! Loving the new digs!

    Send private message
    Wed Sep 04, 2019 8:18 am  
    Lauding the Textual Search website.

    Just for the sake of saying:
    Lamashtu, this is an incredibly useful resource.
    I've just recently used it in research for a "constellations" article for OJ30, coming out this month.
    Andy Miller is writing a follow-up to his article in OJ22, and starting a web-series on Greyhawkonline.com, and it's resources like this that make research manageable when grinding through books and magazine for information.

    What's more, in writing the introduction to the article series, I've repeated the search more than once, and recorded the results. I note that now, the results are all listed in order, (Dragon first, then the OJ, then other products), and there are more/better results for it.

    Thank you, again! You've given a lot to the community!
    _________________
    Owner and Lead Admin: https://greyhawkonline.com
    Editor-in-Chief of the Oerth Journal: https://greyhawkonline.com/oerthjournal
    Visit my professional art gallery: https://wkristophnolen.daportfolio.com
    Apprentice Greytalker

    Joined: Jan 13, 2016
    Posts: 113
    From: SF, CA

    Send private message
    Sun Oct 06, 2019 5:39 pm  

    Good hear it was useful, makes me super happy to see a real use case!

    With a new job, and more or less leaving the world of gaming again, I haven't worked on this much recently. I'm aware that there are some speed and out-of-order operations problems, but it's just not a super high priority right now.

    I continue to support it and pay for its presence on the net, and that won't change.

    Anyone who is trying to utilize it for a project and encounters a problem should probably email me (the FAQ page has my contact info), as my visits to Canonfire are very rare now.

    Icarus in particular since you found it useful, please don't hesitate to reach out if there are additional books you'd like to see added. I still have many essentially ready to be added if I find the time or someone pokes me.
    Apprentice Greytalker

    Joined: Oct 09, 2014
    Posts: 96


    Send private message
    Sun Oct 06, 2019 7:15 pm  

    So I just did a search for Greyhawk. You know, just to see what would turn up.

    Shocked Embarassed Surprised Laughing

    Horned Society next.
    Apprentice Greytalker

    Joined: Aug 24, 2019
    Posts: 8
    From: Germany

    Send private message
    Sat Jun 13, 2020 10:34 am  
    Database is down

    Dear lamashtu,

    I'm incredible sorry for this necromancy, but the collection is too valuable to let it vanish.
    It seems like the link you posted does not work anymore. Strangly enough, your mirror of the Greyhawk Wiki still does its job.

    I tried to commune with you via private messaging, alas, it seems like my spell failed and never reached out to you!
    If you read this, please, bring back the searchable magic.

    Greetings from Germany,
    -r
    _________________
    There's never enough time to do all the nothing you want...
    Display posts from previous:   
       Canonfire Forum Index -> World of Greyhawk Discussion All times are GMT - 8 Hours
    Page 1 of 1

    Jump to:  

    You cannot post new topics in this forum
    You cannot reply to topics in this forum
    You cannot edit your posts in this forum
    You cannot delete your posts in this forum
    You cannot vote in polls in this forum


    Forums ©


    Canonfire! is a production of the Thursday Group in assocation with GREYtalk and Canonfire! Enterprises

    Contact the Webmaster.  Long Live Spidasa!


    Greyhawk Gothic Font by Darlene Pekul is used under the Creative Commons License.

    PHP-Nuke Copyright © 2005 by Francisco Burzi. This is free software, and you may redistribute it under the GPL. PHP-Nuke comes with absolutely no warranty, for details, see the license.
    Page Generation: 0.38 Seconds