Welcome, Guest. Please login or register.
May 08, 2025, 03:31:44 AM

Login with username, password and session length

Recent Topics

by jed
[May 06, 2025, 04:22:23 PM]

[May 05, 2025, 09:12:01 AM]

[May 03, 2025, 06:39:16 PM]

by jed
[May 02, 2025, 09:57:11 AM]

[May 01, 2025, 05:53:19 PM]

[April 26, 2025, 04:27:54 PM]

[April 23, 2025, 11:10:07 AM]

by [WR]
[April 23, 2025, 09:15:13 AM]

[April 21, 2025, 10:44:08 AM]

[April 17, 2025, 04:48:17 PM]

[April 17, 2025, 08:45:02 AM]

by jed
[April 11, 2025, 01:03:22 PM]

[April 11, 2025, 06:19:31 AM]

[April 07, 2025, 07:03:34 AM]

[April 05, 2025, 08:50:20 PM]

Picture Of The Month



Guess who's back?
jed with a spring Big Mack

Topic: CL RSS Feed Aggregator  (Read 8294 times)

0 Members and 1 Guest are viewing this topic.

polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095
Thanks for the recent postings for CL ads for kayaks.  I'm working on an application to aggregate CL feeds for all the WA and OR CL's.  Using just "sit on top kayaks" culls the list to a reasonable level, but still picks up some junk and misses other valid posts.  I'm sure there is a more complicated search string to get better results.  Anyone out there using one that works well for them?  I may have to iterate via trial and error to get it right.  I hope to have the app up within a week.

-Allen


coosbayyaker

  • Sturgeon
  • *******
  • "Hooky Thing"
  • Location: Coos Bay Oregon
  • Date Registered: Oct 2007
  • Posts: 3862
huh? .. ???   ;D

no worries, i don't know anything about that stuff. I do know the search on CL is a bit quirky. You can't search the whole state or the whole CL site on a single search
See ya on the water..
Roy



bsteves

  • Fish Nerd
  • Administrator
  • Sturgeon
  • *****
  • Better fishing through science
  • Location: Portland, OR
  • Date Registered: Feb 2007
  • Posts: 4584
Thanks Allen,
I might be the only one here that understands/appreciates RSS feed aggregators.  For those that don't, RSS feeds and feed aggregators can help you monitor forums and news items as well as keep track of things like searches on craigslist or ebay.  When Allen get's the craigslist aggregator setup on this site it should create an up to date list of all the search results for sit on top kayaks from the Washington and Oregon CL sites right here on the NWKA site.  Think of it this way, it will replace our own CoosBayYaker in weeding through the various craigslists and posting them here.

Another use for RSS feeds is that you can use them in conjunction with something like a personalized Google home page (see an image of mine below below).

Speaking of RSS feeds, the AOTY app has two of them; one for the overall leaderboard and one for the ten most recent catches.  Of course with nothing posted yet they don't do much right now.

leaderboard RSS
http://aoty.northwestkayakanglers.com/leaderboard/rss

recent catches RSS
http://aoty.northwestkayakanglers.com/catch/rss

and of course the most recent NWKA forum posts have an rss feed as well
http://www.northwestkayakanglers.com/index.php?type=rss;action=.xml

Brian
“People say nothing is impossible, but I do nothing every day.”

― A.A. Milne, Winnie-the-Pooh


polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095
huh? .. ???   ;D

no worries, i don't know anything about that stuff. I do know the search on CL is a bit quirky. You can't search the whole state or the whole CL site on a single search

Yup, that's right, larger scale searches are not possible at CL itself.  You can use RSS feeds to put together a larger search which I'll try to do here.  Or you can use something like http://www.craigshelper.com/ which they claim doesn't violate Craigslist search policies.

BTW, there is a mechanism that uses RSS in conjunction with a posting bot to put RSS entires as posts on a forum here.  I tried it yesterday for a bit, but felt the number of posts could get out of hand and clutter things up, so I pulled the plug on it.  I may still revert to that if I can modify the software to not include these posts in the "show recent" or "show unread" utilities.

-Allen


polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095
OK ... check it out.

http://www.northwestkayakanglers.com/index.php?page=15

Thanks to PapaBill from NCKA who already had something like this up and running at NCKA.

Currently I have the search phrase set to "sit on top kayak".  I'll fiddle around with that some to make it more robust.  Suggestions welcome.

Also, there is an option to enable Ebay RSS feeds, something I'll also fiddle around with.

-Allen


bsteves

  • Fish Nerd
  • Administrator
  • Sturgeon
  • *****
  • Better fishing through science
  • Location: Portland, OR
  • Date Registered: Feb 2007
  • Posts: 4584
Nice Allen...

But what is "coosbayyaker" going to do with his spare time now?

Brian
“People say nothing is impossible, but I do nothing every day.”

― A.A. Milne, Winnie-the-Pooh


polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095
Nice Allen...

But what is "coosbayyaker" going to do with his spare time now?

Brian

Get out fishing of course!!!

-Allen


polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095
Oh what fun with Craigslist.  I guess they don't have advanced searching using logic AND, OR, or NOT functions.  So to do more advanced searches I need to do individual searches of various terms.  Still no easy way to use NOT to exclude items.

That is unless I'm missing something and anyone has any suggestions ...

-Allen



coosbayyaker

  • Sturgeon
  • *******
  • "Hooky Thing"
  • Location: Coos Bay Oregon
  • Date Registered: Oct 2007
  • Posts: 3862
Oh what fun with Craigslist.  I guess they don't have advanced searching using logic AND, OR, or NOT functions.  So to do more advanced searches I need to do individual searches of various terms.  Still no easy way to use NOT to exclude items.

That is unless I'm missing something and anyone has any suggestions ...

-Allen



Huh? ... ???

Well, since i don't have to keep up with CL anymore, I'll have to go out to Eel lake tomorrow and rack up a steelie for the AOTY.
See ya on the water..
Roy



ZeeHawk

  • Administrator
  • Sturgeon
  • *****
  • Sauber is my co-pilot.
  • Location: Seattle, WA
  • Date Registered: Sep 2006
  • Posts: 5506
Go get 'em CBY. Don't forget the camera and measuring device! ;)

Z
2010 Angler Of The Year
2008 Moutcha Bay Pro - Winner
Jackson kayaks, Kokatat, Daiwa, Werner Paddles, Orion, RinseKit, Kayak Academy


coosbayyaker

  • Sturgeon
  • *******
  • "Hooky Thing"
  • Location: Coos Bay Oregon
  • Date Registered: Oct 2007
  • Posts: 3862
Nice Allen...

But what is "coosbayyaker" going to do with his spare time now?

Brian

I could complain about there not being a link to it.... >:D. Sticky it with a link in the classified section?
See ya on the water..
Roy



polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095
Nice Allen...

But what is "coosbayyaker" going to do with his spare time now?

Brian

I could complain about there not being a link to it.... >:D. Sticky it with a link in the classified section?

Your wish is my command.  It is done.

-Allen


coosbayyaker

  • Sturgeon
  • *******
  • "Hooky Thing"
  • Location: Coos Bay Oregon
  • Date Registered: Oct 2007
  • Posts: 3862
Now thats service. Thank you, our flealess leader... :D
See ya on the water..
Roy



polepole

  • Administrator
  • Sturgeon
  • *****
  • NorthWest Kayak Anglers
  • Location: San Jose, CA :(
  • Date Registered: Apr 2006
  • Posts: 10095


bsteves

  • Fish Nerd
  • Administrator
  • Sturgeon
  • *****
  • Better fishing through science
  • Location: Portland, OR
  • Date Registered: Feb 2007
  • Posts: 4584
Allen,

Do you know if your RSS aggregator creates an aggregated RSS feed that it then formats, or does it simply format the various rss feeds directly as they come in?   Why am I asking?  Well, if you can figure out the aggregated RSS feeds from each search, then you should be able to create a super aggreator to aggregate all your searches.

Brian
“People say nothing is impossible, but I do nothing every day.”

― A.A. Milne, Winnie-the-Pooh