Discover · simplecast.com

How Stack Overflow fends off scraping bots

The Stack Overflow Podcast simplecast.com

This is what was read here when it was published. simplecast.com no longer carries it in what it publishes now.

As Josh explains, DDoS attacks aim to take down a website, while bot scrapers try to gather as much data as possible without getting caught.

Josh Zhang is a staff site reliability engineer (SRE) at Stack Overflow. Connect with him on LinkedIn.

More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

Names and references

  1. Stack Overflow — objectQ549037wikidata via qlever

Named in it

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

Also from The Stack Overflow Podcast

  1. The pioneering coding tricks that built Doom and Quakesimplecast.com
  2. Agentic search doesn't find pages, it assembles answerssimplecast.com
  3. Customer support is the gnarliest AI problemsimplecast.com
  4. Welcome to life in the chip agesimplecast.com
  5. Oh, your agents need OAuth2, toosimplecast.com
  6. It’s ok that computers are (sometimes) better than ussimplecast.com