[Buildroot] [PATCH 01/14] support/scripts/pkg-stats: URL checking support

[Matthew Weber]

Thomas,

On Fri, Sep 21, 2018 at 8:08 AM Thomas Petazzoni
<thomas.petazzoni at bootlin.com> wrote:
>
> Hello,
>
> On Fri, 21 Sep 2018 07:56:46 -0500, Matthew Weber wrote:
>
> > How does this look? (Still some bugs with some of the invalid sites,
> > the webservers are reporting incorrect codes....)
> > https://pste.eu/p/JpsH.html
>
> Looks good!
>
> > Before adding URL checking, it takes ~2mins.  I was able to keep the
> > runtime at 2mins 20sec by pulling in your code for threading and using
> > 64 threads.
>
> I think my threading stuff had some issues, which were reported by
> Ricardo, and are the reason why my "upstream version checking" stuff
> was not merged.
>
> I'd say, let's merge a first version without threading, and we'll see
> at adding threading later.
>

Sounds good.  I'll submit it in two pieces, the first without
threading and the second, adding the threading as a general feature
you can add various tasks to and run them in parallel.

Matt