Username Password
   or Create an Account
HomeForumsFAQArticlesReviewsDownloadsLinksTop 20Feedback
 Features
 
Greyhawk Wiki

 
Canonfire :: View topic - Announcement: Search through Dragon Magazine and others
Announcement: Search through Dragon Magazine and others

 
Post new topic   Reply to topic    Canonfire Forum Index -> World of Greyhawk Discussion
View previous topic :: View next topic  
Author Message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Sun May 12, 2019 8:40 am    Post subject: Announcement: Search through Dragon Magazine and others Reply with quote

Now with a web (and mobile-friendly) interface.

Instantly search through Dragon's full run of issues including The Strategic Review, the Best of issues, and the Annuals; Oerth Journal; the LGG; and whatever else we might cram into the database.

No ads. No frills.

Looking for that article that had something about orgies you vaguely remember from when you were 10? This can help you find it.

http://wait-wtf.com:3001

Updated:

As an experiment I've change the nature of searches over 4 characters in length to attempt to capture results that were being excluded due to bad OCR. An example of the problem being solved can be found here: http://wait-wtf.com:3001/terrible (page 21 of Dragon 10)

If there's any feedback on the change (false positives, slow results returns, etc) feel free to let me know.


Last edited by lamashtu on Mon Jun 10, 2019 8:53 am; edited 1 time in total
Back to top
View user's profile Send private message
Thyrnbryn
Apprentice Greytalker


Joined: Oct 05, 2003
Posts: 48
Location: Gettysburg, PA

PostPosted: Mon May 13, 2019 4:37 am    Post subject: Reply with quote

This is terrific, thank you!
Dave Guerrieri
Back to top
View user's profile Send private message Send e-mail AIM Address
heychadwick
Journeyman Greytalker


Joined: Aug 31, 2004
Posts: 91
Location: Charlotte, NC

PostPosted: Tue May 14, 2019 4:22 pm    Post subject: Reply with quote

What is the URL?
Back to top
View user's profile Send private message
Icarus
Master Greytalker


Joined: Nov 01, 2007
Posts: 638
Location: NOW IN Cape May, NJ! Loving the new digs!

PostPosted: Thu May 16, 2019 3:17 am    Post subject: Re: Boccob Online Reply with quote

heychadwick wrote:
What is the URL?

Heychadwick, Lamashtu included it, above, at the end of his post.
lamashtu wrote:
http://wait-wtf.com:3001



Lamashtu, it's an incredible resource.
Very useable. Beneficial to just about any D&D player, not just Greyhawk. I'm not sure, but, it seems this is based on your work with the bot you used to work on in the old IRC chat. I'm glad you converted Boccob to an online resource.

Congratulations, and appreciation, man.
A *huge* addition to the gaming community.
Many thanks for creating it, and sharing it with us.
_________________
Visit my professional Art Gallery: http://wkristophnolen.daportfolio.com
Owner and Lead Admin: https://GreyhawkOnline.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website Yahoo Messenger
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Thu May 16, 2019 7:04 am    Post subject: Reply with quote

That's correct Icarus, the backend is (mostly) the same as what boccob was using in IRC.

For you and anyone following the thread, and as I say in the FAQ, I can add more sources (Dungeon? Modules?), so everyone is welcome to let me know what they'd like to see.

Future development is contingent on use and feedback.
Back to top
View user's profile Send private message
heychadwick
Journeyman Greytalker


Joined: Aug 31, 2004
Posts: 91
Location: Charlotte, NC

PostPosted: Fri May 17, 2019 3:12 am    Post subject: Re: Boccob Online Reply with quote

Icarus wrote:
heychadwick wrote:
What is the URL?

Heychadwick, Lamashtu included it, above, at the end of his post.
lamashtu wrote:
http://wait-wtf.com:3001



Wellll.....color me purple and call me Iggwilv! I didn't see it. I think it was too close to the lower bar.
Back to top
View user's profile Send private message
grodog
CF Admin
CF Admin


Joined: Jun 29, 2001
Posts: 1306
Location: Wichita, KS, USA

PostPosted: Mon Jun 03, 2019 6:23 pm    Post subject: Reply with quote

Any chance we could get the 1e rulebooks added into the mix too? :D

Allan.
_________________
Allan Grohe (grodog@gmail.com)
http://www.greyhawkonline.com/grodog/greyhawk.html
Back to top
View user's profile Send private message Send e-mail Visit poster's website AIM Address
Cebrion
Black Hand of Oblivion
Black Hand of Oblivion


Joined: Feb 16, 2003
Posts: 3701
Location: So. Cal

PostPosted: Mon Jun 03, 2019 9:32 pm    Post subject: Reply with quote

Just testing it out... I did a search for "Iuz." Lots of hits, but nothing going back prior to Dragon #103. Is this due to OCR problems with early issues?
_________________
- Moderator/Admin (in some areas)/Member -
Back to top
View user's profile Send private message
mortellan
Forum Moderator
Forum Moderator


Joined: Feb 26, 2004
Posts: 2560
Location: Ullinois

PostPosted: Tue Jun 04, 2019 5:48 pm    Post subject: Reply with quote

This is pretty cool, even with the limitations that Cebrion mentions. Happy
Back to top
View user's profile Send private message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Fri Jun 07, 2019 10:31 am    Post subject: Reply with quote

Cebrion wrote:
Just testing it out... I did a search for "Iuz." Lots of hits, but nothing going back prior to Dragon #103. Is this due to OCR problems with early issues?


I'm investigating this, however I believe you've found a bug.
Back to top
View user's profile Send private message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Fri Jun 07, 2019 11:57 am    Post subject: Reply with quote

Cebrion wrote:
Just testing it out... I did a search for "Iuz." Lots of hits, but nothing going back prior to Dragon #103. Is this due to OCR problems with early issues?


This should be corrected now. Some issues failed to index correctly, and a parameter on the database needed to be tweaked.

Thank you very much for reporting this Cebrion!

As I say in the FAQ, I probably can't/won't fix most issues - but I will always investigate them. If it's NOT a problem with the OCR, I will do my utmost to make it work.
Back to top
View user's profile Send private message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Fri Jun 07, 2019 2:55 pm    Post subject: Reply with quote

...and whatever, figured I'd improve the sorting a bit. It's still... weird in a way that isn't yet making sense to me. But I think you'll find it improved.
Back to top
View user's profile Send private message
Cebrion
Black Hand of Oblivion
Black Hand of Oblivion


Joined: Feb 16, 2003
Posts: 3701
Location: So. Cal

PostPosted: Fri Jun 07, 2019 6:44 pm    Post subject: Reply with quote

Yes, it would be great if it sorted sources numerically/alphabetically.

But...getting stuff to appear at all is at the least very useful.

The effort is greatly appreciated. Cool
_________________
- Moderator/Admin (in some areas)/Member -
Back to top
View user's profile Send private message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Fri Jun 07, 2019 7:31 pm    Post subject: Reply with quote

Cebrion wrote:
Yes, it would be great if it sorted sources numerically/alphabetically.

But...getting stuff to appear at all is at the least very useful.

The effort is greatly appreciated. Cool


I decided to just recreate the database with an improved schema. Sorting should be perfect now. Every issue should be able to return results (excepting those listed in the FAQ). In theory it should also bit a tiny bit quicker now.
Back to top
View user's profile Send private message
Cebrion
Black Hand of Oblivion
Black Hand of Oblivion


Joined: Feb 16, 2003
Posts: 3701
Location: So. Cal

PostPosted: Sat Jun 08, 2019 5:50 pm    Post subject: Reply with quote

Just tried it out, and it looks like it is working really well! Cool
_________________
- Moderator/Admin (in some areas)/Member -
Back to top
View user's profile Send private message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Mon Jun 10, 2019 9:05 am    Post subject: Reply with quote

As an experiment I've change the nature of searches over 4 characters in length to attempt to capture results that were being excluded due to bad OCR.

An example of the problem being solved can be found here: http://wait-wtf.com:3001/terrible (page 21 of Dragon 10)

If there's any feedback on the change (false positives, slow results returns, etc) feel free to let me know.
Back to top
View user's profile Send private message
lamashtu
Journeyman Greytalker


Joined: Jan 13, 2016
Posts: 112
Location: SF, CA

PostPosted: Thu Jun 20, 2019 3:22 pm    Post subject: Reply with quote

After a some research, I implemented a new processing chain for OCRing the sources. Took about 200 hours of every core running flat out, but the result should be a reduction in false-negatives of around 10-15%, without any slowdown to the end user.

Future plans include:

- adding additional sources (including the long absent Dragons 147-149)

- providing an interface to filter out sources the user doesn't want to see

- allowing 'match' queries, which will permit searches that require more flexibility
Back to top
View user's profile Send private message
vestcoat
Adept Greytalker


Joined: Jul 29, 2006
Posts: 438
Location: Dantredun, MN

PostPosted: Thu Jun 20, 2019 5:43 pm    Post subject: Reply with quote

+1 for OJ#15. I've used Magna Alumnae a bit IMC.

OJ#7 also has a bardic order of "Keepers" devoted to Wee Jas described in her article.

The flavor text in the Complete Bard's Handbook has some light Greyhawk references.
Back to top
View user's profile Send private message
Icarus
Master Greytalker


Joined: Nov 01, 2007
Posts: 638
Location: NOW IN Cape May, NJ! Loving the new digs!

PostPosted: Wed Sep 04, 2019 8:18 am    Post subject: Lauding the Textual Search website. Reply with quote

Just for the sake of saying:
Lamashtu, this is an incredibly useful resource.
I've just recently used it in research for a "constellations" article for OJ30, coming out this month.
Andy Miller is writing a follow-up to his article in OJ22, and starting a web-series on Greyhawkonline.com, and it's resources like this that make research manageable when grinding through books and magazine for information.

What's more, in writing the introduction to the article series, I've repeated the search more than once, and recorded the results. I note that now, the results are all listed in order, (Dragon first, then the OJ, then other products), and there are more/better results for it.

Thank you, again! You've given a lot to the community!
_________________
Visit my professional Art Gallery: http://wkristophnolen.daportfolio.com
Owner and Lead Admin: https://GreyhawkOnline.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website Yahoo Messenger
Display posts from previous:   
Post new topic   Reply to topic    Canonfire Forum Index -> World of Greyhawk Discussion All times are GMT - 8 Hours
Page 1 of 1

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Canonfire phpBB2 theme by Jakob Persson (http://www.eddingschronicles.com).
Powered by phpBB © 2001 phpBB Group
All times are GMT - 8 Hours
Stone textures by Patty Herford
Ported for PHP-Nuke by nukemods.com
Forums ©


Canonfire! is a production of the Thursday Group in assocation with GREYtalk and Canonfire! Enterprises

Contact the Webmaster.  Long Live Spidasa!

PHP-Nuke Copyright © 2005 by Francisco Burzi. This is free software, and you may redistribute it under the GPL. PHP-Nuke comes with absolutely no warranty, for details, see the license.
Page Generation: 0.29 Seconds