Binary Harvesters in Ports? - BSD
This is a discussion on Binary Harvesters in Ports? - BSD ; I'm looking for a usenet binary harvester, preferably in the ports
collection. I tried using aub, but it apparently decides based on
message Subject: whether to extract the post. The group that I'm
trying to extract (alt.binaries.pictures.woodworking) doesn't follow
the ...
-
Binary Harvesters in Ports?
I'm looking for a usenet binary harvester, preferably in the ports
collection. I tried using aub, but it apparently decides based on
message Subject: whether to extract the post. The group that I'm
trying to extract (alt.binaries.pictures.woodworking) doesn't follow
the warez/porn/whatever conventions for that, just people posting
pictures of their work. So I'm only grabbing maybe 1/3 of the
pictures.
Any suggestions on a more simplistic harvester? I doubt anything
ever gets posted multi-part there.
--
Drew Lawson | I told them we had learned to change
drew@furrfu.com | our swordblades into plows.
http://www.furrfu.com/ | I told them they should learn from us
| what should I tell them now?
-
Re: Binary Harvesters in Ports?
Drew Lawson wrote:
> Any suggestions on a more simplistic harvester? I doubt anything
> ever gets posted multi-part there.
Not that I have tested it, but PicMonger[1] perhaps?
Other alternatives are bgrab, brag, cg, hellanzb, newsgrab, nzbget,
nzbperl, ubh, and probably more.
References:
1) http://www.freshports.org/news/PicMonger/
--
Torfinn Ingolfsen,
Norway
-
Re: Binary Harvesters in Ports?
Drew Lawson wrote:
> I'm looking for a usenet binary harvester, preferably in the ports
> collection. I tried using aub, but it apparently decides based on
> message Subject: whether to extract the post. The group that I'm
> trying to extract (alt.binaries.pictures.woodworking) doesn't follow
> the warez/porn/whatever conventions for that, just people posting
> pictures of their work. So I'm only grabbing maybe 1/3 of the
> pictures.
>
> Any suggestions on a more simplistic harvester? I doubt anything
> ever gets posted multi-part there.
>
As already suggested by Torfinn... I personally use bgrab... nice
console grabber.
-
Re: Binary Harvesters in Ports?
drew@furrfu.com (Drew Lawson) writes:
> I'm looking for a usenet binary harvester, preferably in the ports
> collection. I tried using aub, but it apparently decides based on
> message Subject: whether to extract the post. The group that I'm
> trying to extract (alt.binaries.pictures.woodworking) doesn't follow
> the warez/porn/whatever conventions for that, just people posting
> pictures of their work. So I'm only grabbing maybe 1/3 of the
> pictures.
>
> Any suggestions on a more simplistic harvester? I doubt anything
> ever gets posted multi-part there.
I would think you'd rather have a newsreader that can pick up the
pictures, rather than an outside program. This is more intrusive on
your habits, but has a significant advantage in that the pictures stay
attached to the text that they illustrate.
-
Re: Binary Harvesters in Ports?
In article ,
Drew Lawson wrote:
>
>
>I'm looking for a usenet binary harvester, preferably in the ports
>collection. I tried using aub, but it apparently decides based on
>message Subject: whether to extract the post. The group that I'm
>trying to extract (alt.binaries.pictures.woodworking) doesn't follow
>the warez/porn/whatever conventions for that, just people posting
>pictures of their work. So I'm only grabbing maybe 1/3 of the
>pictures.
>
>Any suggestions on a more simplistic harvester? I doubt anything
>ever gets posted multi-part there.
Well, if you don't mind using something interactive rather than automated,
both pan and klibido do a very nice job of downloading and extracting
binaries. Klibido is the more "dedicated" of the two, in that it's not
really a newsreader per se, but was created solely for the purpose of
downloading Usenet binaries.
HTH
--
Conrad J. Sabatier
"Procrastinate now; don't put it off." -- Ellen Degeneres
-
Re: Binary Harvesters in Ports?
Begin
On Fri, 04 Jan 2008 17:44:57 GMT, Drew Lawson wrote:
> Any suggestions on a more simplistic harvester? I doubt anything
> ever gets posted multi-part there.
Not exactly what you want, but I do remember writing such a thing using
uh, python and some nntp library. Being a relative python newbie back
then (five or more years ago, the source I probably lost) it took a day
or two to get the basics up, and the script ended up being something
like a hundred lines total. I think it did do multipart and pieced
things together based on regular expressions. Of course, if you want
to run it regularly such a thing should probably keep a last-read mark
instead of just feeding it a list of things to fetch. But the point is
that it isn't exactly hard to write a simplistic fetcher if you already
have something that talks nntp.
--
j p d (at) d s b (dot) t u d e l f t (dot) n l .
This message was originally posted on Usenet in plain text.
Any other representation, additions, or changes do not have my
consent and may be a violation of international copyright law.