Buggy output on pages with javascript

[falkecarlsen]

When testing on reddit and a task hit a submission the following output was produced. Something janky might've been submitted to the queue.

Output:

Worker W1 received task https://old.reddit.com/r/BetterEveryLoop/gilded
Worker W1 received task https://old.reddit.com/r/BetterEveryLoop/comments/do6b4r/donald_slowly_realising_a_whole_stadium_is_booing/
Worker W1 received task javascript: void 0;
W1 failed to download a page.
Worker W1 received task https://old.reddit.com/#
Worker W1 received task javascript:void(0)
W1 failed to download a page.
Worker W1 received task javascript:void(0)
W1 failed to download a page.
Worker W1 received task https://old.reddit.com/

[falkecarlsen]

Could have something to do with the extractor that @jenrik built.

[jenrik]

The HTMLLinkExtractor assumes that the href attribute of a anchor tag is always a valid URL, so yes it's broken because of the extractor I built

[lars4509]

The extractor now only look for schemes where http or https are used, this also mean that javascript:void(0) will be discarded, since the parser will recognise javasript as the scheme.