Question

Bioconductor code browser time out

2

Entering edit mode

Marek Gierlinski ▴ 30

@mgierlinski-7369

Last seen 5 months ago

United Kingdom

Bioconductor code browser has been unresponsive for a while (at least since yesterday). When you try, for example,

https://code.bioconductor.org/browse/limma/RELEASE_3_18/

it munches through it for a while and returns "Bad gateway".

Bioconductor • 558 views

ADD COMMENT • link updated 10 months ago by Mike Smith ★ 6.6k • written 10 months ago by Marek Gierlinski ▴ 30

1

Entering edit mode

Thanks for the report. The site seems to being hit by a huge number of access attempts from a single IP and overloading it. I'm investigating the issue now.

ADD REPLY • link 10 months ago Mike Smith ★ 6.6k

0

Entering edit mode

It is back to normal now. Thank you.

ADD REPLY • link 10 months ago Marek Gierlinski ▴ 30

score 1 · Answer 1 · 2024-01-10

The site was being overwhelmed by various webcrawler bots, which were trying to index everything including all commits across all branches etc. There's potientially hundred of thousands of pages if you consider that, and I think the cumulative effect of those bots brought the site down.

I've now implemented a robots.txt which hopefully most of them will respect to try and limit what they access.