Zyte Blog Posts
Insights, tutorials and analysis on web scraping and data extraction — written by the people closest to the data.
- Posts
- 74 from 18 May 2022 to 5 Nov 2026
- Posting
- weekly (72 in the last year)
- Kind
- company blog
- Feed
- https://www.zyte.com/rss.xml
2026 71
- Self-healing scrapers: four things to put in place before an AI agent fixes your spiders
- Web Scraping for RAG: Build a Reliable Pipeline with Zyte API, Qdrant and LangChain
- How to use browser DevTools for web scraping
- What web access actually costs - the tier picture
- 12 things I use Zyte MCP for, ranked, with prompts and rules you can copy
- Agentic QA for data: Bots go beyond the rules
- The trouble with variants: Solving the web's infinite ecommerce explosion
- Need for speed: How data inertia kills business ambition
- Scrapy vs BeautifulSoup vs Selenium vs Playwright: which should you use?
- The web's layered defences - how access barriers combine
- How I use Zyte MCP to plan web scrapers
- Self-healing spiders: letting an agent fix your Scrapy crawl, with a lid on it
- The anti-ban arms race: Agentic traffic and the fight for the open web
- TLS fingerprinting, the handshake that reveals your true intent
- How to convert a website to Markdown for AI: 7 methods compared
- Train AI on industry-leading Markdown with Zyte’s new extraction mode
- JSON Parsing with Python [Practical Guide]
- JavaScript renders almost half of sites invisible
- Five takeaways from Extract Summit 2026 Austin
- Rate limiting is a roadblock, not a speed limit
- Dateparser: a date parsing library for Python
- Introducing Zyte MCP: Powerful web data gathering for your agent
- AI web scraping and scalable data collection
- CAPTCHA is more than just a puzzle piece
- Zyte Developer Community Meetup #2: the recap, slides, and recordings
- Inside Scrapy's RemoteControl extension
- Scrapy MCP: debug your crawl while it runs
- One Scrapy Spider, Three Browser Setups: Playwright, Patchright, and Zyte
- Stopping a crawl when the data stops looking real with Jev
- Jev, the model that cannot write a word, and where it fits in web scraping(does it?)
- Inside antibot, the arms race you can't see
- uv Python cheatsheet: what changed in 0.12 and what still trips you up
- Firewalls run the web, just not on purpose
- Give your AI agent a browser: search, compare, and check product availability with Zyte CDP
- The page your agent scrapes is now an attack surface. Is it ready for the hostile web?
- Running Playwright at scale: connecting to the Zyte CDP browser
- Four in 10 sites block AI bots with robots.txt
- Fable 5.1 shipped, and GLM-5.3-Flash turned out to be someone I already met
- Web data in a reactive notebook: an introduction to marimo
- 75% of the web uses robots.txt - here's how
- Introducing Zyte CDP support: Your browser automation, our infrastructure
- Why Europe’s new AI scraping guidelines miss the mark
- WebFetch is ‘lossy’ by design: give your coding agent a better fetch in one command
- Revealed: How retailers use tech to block the bots
- The web is being priced, not blocked
- Fashion websites are the hardest to size up
- The web is synthetic. Now look at the human trail
- The State of Web Access: How different industries behave to bots
- A $70-a-month production app replaced a $5,000-a-month platform: What production-grade AI coding looks like
- Podcast Episode 10 is out: Skills, packages & updates
- Chrome has a new potential fingerprint vector
- The State of Web Access: How today's web raises its barriers
- Harness Engineering, part 4: giving your agent a custom fetch tool that survives the real web
- Meet scrapy-spidey-sense: A preflight check for Scrapy spiders
- Rendering Javascript pages without giving up Scrapy
- Spider monitoring made easy
- I joined the Real Python podcast to talk harnesses and Scrapy
- Building maintainable spiders with scrapy-poet
- Modern Scrapy for experienced developers: A new series
- A guide to Scrapy item types
- New Zyte add-ons: Agent Skills, Codex, GitHub and more updates
- Podcast Ep08 - Scrapy, Python and mushroom soup
- Five reasons to attend this year’s Extract Summit
- ▶Video · Zyte YouTube0% Hallucination? RAG + Web Scraping (Step-by-Step)March 5, 2026
- Web data collectionData is the new waterRobert Andrews·10 min read
- Article · Web scraping APIsLegal clarity comes with compliance demandsExplore how new regulations like the EU AI Act and California AB 2013 are reshaping AI data compliance in 2026. Learn why provenance, transparency, and lawful sourcing are now critical.Theresia Tanzil·5 min read
- ▶Video · Zyte YouTubeZyte API Sessions - flexible cookie management maintaining controlFebruary 6, 2026
- ▶Video · Zyte YouTubeGenerate HTML Parsing code the right way with Scrapy & Web Scraping CopilotFebruary 23, 2026
- ▶Video · Zyte YouTubeScreenshot webpages with this Claude Skill and Zyte APIMarch 6, 2026
- ▶Video · Zyte YouTubeAI generated these Scrapy projects - why I won't ship themJuly 7, 2026
- Article · Use caseWeb data for business insights in 2026: Elevate your BI function with quality dataDiscover how BI teams in 2026 use AI-powered web data to cut data wrangling, improve quality, and stay compliant. Insights from Zyte’s Web Scraping Industry Report.Theresia Tanzil·5 min read