Contact Sales Dashboard

Scraping Techniques

Practical scraping methods: TLS and HTTP/2 fingerprinting, headless stealth, parsing embedded JSON, and collecting data at scale without getting flagged.

66 articles

A cartoon tarantula climbing a wooden ladder whose three plank rungs are lettered FETCH, PROXY and RENDER, beside three rising stacks of gold coins

n8n Web Scraping: Which Node, Which Mode, and What It Costs

Aug 21, 2026 · 10 min read

A small white robot walking a data centre aisle holding up a card lettered GOOGLEBOT ID, a terminal beside it answering ID VERIFICATION SUCCESSFUL

Verified Bots: How Googlebot Proves It's Googlebot

Aug 12, 2026 · 8 min read

A mole in a yellow hard hat leaning on the railing of an iron scaffold gallery high on a stone wall, a dark navy plate fixed to the railing beside it lettered HTTP/2 in cream and a second plate on the gallery below lettered TLS, with a coil of rope on the walkway and a wrench and chain hanging at the left.

HTTP/2 and HTTP/3 Fingerprinting: The Layer Above TLS

Jun 24, 2026 · 8 min read

A green chameleon on a dark wooden dresser top reaching up to a large cream card propped against the wall, the card carrying one black inked handprint with JA3 hand-lettered beneath it in dark brown, with a shallow wooden ink tray and a folded cloth on the dresser and a brass hand bell and a bowl of walnuts at the right.

How TLS Fingerprinting Works: JA3, JA4 & Why Your Requests Get Flagged

Jun 15, 2026 · 8 min read

A small round pale blue robot turning a small brass handwheel whose rod runs across to a brass bell crank pinned to an oak post, a thick frayed rope from the other arm of the same crank hanging slack away to a heavy wooden hand lever standing idle at the right, and a rod from the crank working a flat brass paddle that has lifted the top leaf of a thick pad of blank cream sheets on the bench, in a timber workshop with a mallet, a bow saw and a coil of flex on the boarded wall.

CDP vs. BiDi: Browser Automation Protocol Internals for Scrapers

May 22, 2026 · 7 min read

A single framed search-result card, its page showing a blue heading bar, a green line and grey rules, standing upright on courthouse steps between two boards and pulled towards each of them by a taut rope: the board on the left carries the four-colour Google G and the board on the right is lettered SERP. A brown owl in round spectacles stands on the steps below the card holding a wooden gavel, between stone columns and brass handrails.

Google vs. SerpAPI: The Legal Battle Over Who Owns the Search Result

Mar 25, 2026 · 5 min read

A cartoon spider on a wooden loft beam with a dark blindfold pushed up clear of its eyes onto its head, holding a lit brass lantern up high on one raised leg in front of a wooden board of six round white gauges in two rows of three, five of their needles plainly readable in the light and the sixth face partly hidden behind the lantern itself, with a coil of rope and a rack of spanners on the plank wall at the left and a stacked crate, a mug and a checked cloth at the right.

Why Your Scrapers Are Flying Blind (And How to Fix That)

Feb 21, 2026 · 6 min read

Three moles wearing overalls work in a dimly lit, gear-filled workshop, where one wearing a yellow hardhat inspects a small beetle on the floor with a magnifying glass, two operate mechanical paper-printing machines, and a large spider lies motionless across a wooden workbench in the background.

Beyond the Bug: Why Scrapers Die Quietly in Production

Feb 9, 2026 · 4 min read

A green snake turns a wheel crank on a metallic machine inside a stone room, which connects through four cables to a wall hatch underneath a sign reading "GITHUB", while a long strip of punched paper tape streams out of the hatch into a wooden crate next to a black and orange spider.

Scraping GitHub with Python and Proxies: A Practical Guide

Apr 30, 2025 · 6 min read

A cartoon spider stands on a wooden desk holding a small folder while using one leg to turn a brass handle beside a wall-mounted slot dispensing a strip of punched paper, as an owl wearing round glasses holds a balance scale near an open book.

Web Scraping Best Practices for 2025: An Ethical Guide

Apr 28, 2025 · 2 min read

A blue cartoon elephant stands in a wooden workshop beside a set of three steps, where three orange cords are plugged into individual outlets while a spider on top pulls a printed paper strip from a browser-window frame near a circular sign displaying the letters "PHP".

PHP Web Scraping with Proxies: A 3-Step Guide

Apr 28, 2025 · 5 min read

A small white and blue robot stands inside an open wooden garden gate next to a wooden sign with the text "ROBOTS.TXT", looking toward a large orange-and-black striped spider on a dirt path beside a locked fence gate secured with a padlock.

Robots.txt for Web Scraping: A Practical Proxy Guide

Apr 28, 2025 · 6 min read

A black-and-orange cartoon spider pulls punched paper tape from a wooden WHOIS lectern holding an open register, beside a neat stack of cards in a lamplit archive whose panelled wall has four closed wooden shutters and several exposed brass record plates.

Private WHOIS Domain Data Scraping for Efficient Results

Apr 27, 2025 · 4 min read

A robot with a C# badge operates a console labeled “Puppeteer Sharp” as a selector marked “//article/h2” pulls data cards from a browser-shaped filing cabinet connected through a wall relay labeled “PROXY”.

Puppeteer Sharp, XPath & Proxies for Advanced Web Scraping

Apr 21, 2025 · 4 min read

A cartoon spider sits by a wooden workbench sorting photographic prints into a crate with a plaque reading "PYTHON", while a yellow and blue spotted snake slithers beneath the table among tools like wrenches and magnifying glasses, inside a stone room featuring three arched stone doorways fitted with large wall plugs.

Python Image Download & Scraping: Tools and Proxy Solutions

Apr 21, 2025 · 6 min read

A cartoon spider wearing a visor sits on a wooden stool and weaves a glowing blue web on a small frame resting over an open binder labeled "Google Sheets", guiding blue and yellow threads onto the grid rows of the spreadsheet set on a wooden desk surrounded by tools.

Simplify Web Scraping with Google Sheets – No Proxy Worries

Apr 19, 2025 · 4 min read

A cartoon spider mascot wearing a green visor uses a wooden spatula to scrape a grid table on a desk, accompanied by a yellow and blue Python snake, a glowing brass lamp, a large framed HTML table on the wood-paneled wall, and a wooden stamp printed with the text "read_html".

Scrape HTML Tables in Python with Pandas read_html

Apr 18, 2025 · 3 min read

A large spider mascot turns a wooden thread spool attached to a brass canister labeled SELENIUM, pulling a line guided by a green python snake through three rectangular glass prisms into a framed browser window prop dispensing a printed paper scroll.

Dynamic Web Scraping with Selenium, Python & Proxies

Apr 17, 2025 · 2 min read

A cartoon spider wearing a cap stands on a wooden workbench next to a lit lamp, pulling travel postcards from a brass rotating display rack featuring an attached wooden tag labeled "Agoda" and a mechanical hand crank with gears, dropping the cards into a woven basket.

Scrape Agoda & Travel Aggregators: A No-Code Guide

Apr 15, 2025 · 5 min read

A fuzzy spider mascot sits on a wooden crate labeled "axios", operating a hand winch to lower a glowing glass flask on a line, while three cracked glass flasks marked with red X's sit in a puddle on the cobblestone floor below.

Axios Retry for Failed Requests: Scraping & Examples

Apr 14, 2025 · 6 min read

A spider mascot wearing a sun hat uses wooden tweezers to pluck a small extracted data card from a web browser frame prop and place it into an open green ledger book featuring exact lettering 'VBA' on a wooden garden bench.

Master Excel VBA Web Scraping for Data Extraction

Apr 13, 2025 · 6 min read

A friendly black and orange spider stands on a cobblestone path, holding a glowing web strand that routes around a large stone block to a framed browser window screen, connected through a box on a tripod near a wooden crate holding a red gemstone with a small sign labeled "RUBY".

Ruby Web Scraping: Avoid Blocks with Proxies

Apr 11, 2025 · 2 min read

A cartoon spider in goggles handles paper review tags with brass tongs from behind a framed sheet of clear glass mounted upright on a counter, five tags marked with yellow stars laid out on the wood in front of it.

Scraping Reviews Safely: A Proxy-Focused Beginner’s Guide

Apr 7, 2025 · 5 min read

A cartoon spider on a workshop bench draws a brass comb down a bright yellow square plaque lettered JS, lifting strands of glowing web silk off it, with a wooden marionette hanging from a crossed control bar above and a green hexagon plaque lettered node on the wall behind.

Scraping JavaScript Sites: Puppeteer, Node.js & Proxies

Apr 6, 2025 · 6 min read

A striped cartoon cat reclines against a stack of ledgers with one paw resting on a small brass crank while a ribbon of punched paper tape feeds out of a wide red YouTube play mark on the counter and coils into a basket.

Effortless YouTube Data Scraping: Tools, Proxies, and Tips

Apr 6, 2025 · 2 min read

A cartoon spider on a workbench draws a brass comb through a stretched web of glowing silk strands, beside a heavy iron cogwheel with a capital R at its centre leaning against the bench and a wall rack of spanners, files and pliers.

Rust Web Scraping in 2025: Steps, Tools & Proxies

Apr 5, 2025 · 2 min read

A cartoon spider picks printed pages off a stretched silk web and drops them into a woven basket in a lamplit panelled hall, with a small brass mechanical crawler walking the strands above and a grey oval ring holding a blue capital R propped on the counter.

R Web Scraping in 2025: Rvest, Rcrawler & Proxy Tips

Apr 2, 2025 · 4 min read

A shopkeeper in a dark apron pulls down the single long lever of a large brass and oak machine with both hands, punched paper tape and printed sheets streaming out of its chute into a wooden tray, beside a slate of chalked code struck through with one thick red cross.

No-Code Web Scrapers: Streamline Data with Proxies

Apr 1, 2025 · 5 min read

A brass robot turns the crank of a hand-operated machine lettered cURL in a lamplit workshop, pulling printed pages off a stretched silk web into the machine and stacking them in its tray, with a junction box of switches and gauges beside it linked by copper cords.

Scrape Websites With cURL and Proxies (Live Examples)

Mar 27, 2025 · 5 min read

A cartoon spider holding a brass ladle dips printed pages into a painted tureen of steaming garnished broth on a lace cloth, with a plaque of two interlocking blue and yellow snakes propped on the counter beside it.

Python Web Scraping with Beautiful Soup & Proxy Tips

Mar 26, 2025 · 6 min read

A cartoon spider pulls a printed page off a web frame onto a stack of paper in a lamplit panelled hall, while a trolley loaded with pages rolls through the single open gap in a barred iron barrier, a plaque of a white steaming coffee cup propped on the counter.

Java Web Scraping in 2025: Proxies & Anti-Block Strategies

Mar 25, 2025 · 3 min read

A brass robot works a small control desk wired to a wooden browser-window prop with pages flicking past inside its frame, a dark iron cogwheel bearing a capital R leaning against the bench and a green glass flask labelled Se standing beside it.

Rust & Selenium: High-Speed Web Scraping with Proxies

Mar 24, 2025 · 4 min read

A striped cartoon cat in a waistcoat draws a long strip of printed tickets from a slot in a wooden travel kiosk lettered Expedia at dusk, a plaque of two interlocking blue and yellow snakes propped against the kiosk.

Expedia Scraping with Python & Proxies: A Guide

Mar 23, 2025 · 5 min read

A brass robot works a rod-puppet mid-stride on the boards of a small wooden theatre stage with its curtains drawn back and a large quill pen lying on the apron, a purple plaque lettered C# mounted on the front of the stage.

C# Web Scraping with Playwright & Proxies: A Guide

Mar 21, 2025 · 4 min read

A vertical wooden beam splits a room into two side-by-side compartments, featuring a mechanical brass spider crawling across a web on the left and a fluffy cartoon spider scraping small papers off a web with a comb into a basket on the right amidst books and lanterns.

Web Crawling vs. Web Scraping: Differences & Use Cases

Mar 19, 2025 · 4 min read

A light blue gopher and a small golden robot stand at a wooden workbench inside a rustic workshop, where the robot collects a long stack of paper sheets cascading from a miniature puppet stage with red curtains into a woven basket near a large feather quill.

Build a Golang Web Scraper with Playwright & Proxies

Mar 18, 2025 · 5 min read

A tabby cat wearing a brown vest stands behind a wooden desk in a book-lined study, attaching sheets of paper to a large spiderweb stretched between posts beside copper piping, surrounded by glowing oil lamps, rolled scrolls, and a quill.

Essential Playwright Web Scraping & Proxy Strategies (2025)

Mar 18, 2025 · 3 min read

A tabby cat wearing a dark hooded cloak walks through a stone room at night, carrying a woven basket filled with papers under one arm and holding a small glowing lantern in its paw past a wooden stool, folding screen, and a brass telescope beside a window.

Stealth Web Scraping Strategies: Avoiding Detection Online

Mar 13, 2025 · 6 min read

A cartoon spider reaches toward a paper tray on a wooden desk next to a brass machine labeled "Scrapy" that prints documents, positioned beside a plaque featuring a blue and yellow Python snake mark while a mechanical spider hangs on a cobweb frame in a room filled with bookshelves and lit oil lamps.

Python Web Crawling with Scrapy and Proxies: A Guide

Mar 12, 2025 · 5 min read

A golden robot stands at a wooden workbench inside a workshop holding a printed paper sheet just clear of the delivery tray of a brass machine lettered cURL, with a smaller brass junction box on the left of the bench joined to the machine by two copper pipes and a lit desk lamp on the right.

Performing cURL GET Requests: A Proxy-Focused Overview

Mar 11, 2025 · 4 min read

A bronze robot stands behind a web strung between two wooden posts on a workbench, using a wooden rake to comb paper sheets out of the webbing into a woven basket below, while connected by copper cables to a machine with a screen displaying the symbol >-.

PowerShell Web Scraping in 2025: A Proxy-Focused Guide

Mar 10, 2025 · 2 min read

Web Scraping with JavaScript & Node.js: A Practical Guide

Mar 9, 2025 · 4 min read

A smiling cartoon spider holding a small comb scrapes blank pinned papers off a framed corkboard, causing them to drop into a woven basket on a wooden desk alongside a brass electronic control panel connected to copper pipes and surrounded by lit oil lamps.

Job Posting Scraping: Effective Methods & Proxy Tactics

Mar 5, 2025 · 2 min read

Build a Facebook & Amazon Scraper: Proxy & Safe Methods

Mar 4, 2025 · 2 min read

Python Web Scraping in 2025: Tools, Tips & Proxies

Mar 3, 2025 · 4 min read

Scrape with Node.js & Axios: Safeguard Your IP with Proxies

Mar 2, 2025 · 3 min read

A small cartoon spider on a wooden desk holds a comb to a web suspended between two posts, pulling a printed paper scroll into a woven basket next to a framed orange alien face icon, while a gold plaque displaying two intertwined blue and yellow snakes hangs on the wall of a cozy library.

Scrape Reddit with Python: Powering Data with Proxies

Feb 28, 2025 · 2 min read

A cute cartoon spider sits atop a wooden box labeled "EVOMI" and uses a comb to pull paper pages down into a basket on a wooden desk featuring a framed door outline plaque, an intertwined blue and yellow snake emblem, glowing oil lamps, and stacks of books.

Effortless Glassdoor Scraping with Python & Evomi Proxies

Feb 26, 2025 · 4 min read

A cartoon spider stands behind a wooden market stall under a hanging sign reading "eBay", using a wooden comb to scrape across a piece of paper near a spiderweb, beside a framed plaque depicting two intertwined blue and yellow snakes.

Scrape eBay with Python & Proxies: A Complete Guide

Feb 26, 2025 · 4 min read

A friendly cartoon bug with black and orange stripes stands on a wooden workbench, pulling a long white strip of paper out from a slot in a wooden display screen, which connects via wires to a small relay box on the desk.

How to Pull Data From Any Website: A Practical Guide

Feb 25, 2025 · 6 min read

A headless suit of armor stands in a library room near a wooden desk containing a frame shaped like a web browser window, inside of which white papers float, connected by copper pipes to a gear-covered control box alongside a golden robot.

Headless Browsers: How They Work and When to Use Them

Feb 19, 2025 · 4 min read

Python cURL: Web Scraping with PycURL and Proxies

Feb 19, 2025 · 5 min read

A friendly cartoon spider sits on a wooden workbench in a workshop, holding a golden comb against a long stack of white paper emerging from a large wooden monitor, surrounded by a wooden toolbox, hanging hand tools, and connected copper pipes.

Screen Scraping: Key Methods, Tools, and Proxy Insights

Feb 18, 2025 · 6 min read

Python POST Requests and Proxies: Elevate Your Web Scraping

Feb 16, 2025 · 2 min read

An orange fox curled around a globe sits on a wooden table beside a headless suit of armor, a glass flask labeled "Se", and a spider next to a cobweb holding paper pages that fall into a woven basket below.

Headless Firefox & Python Selenium for Proxy Scraping

Feb 13, 2025 · 5 min read

A small spider stands on a wooden crate labeled "aiohttp" beside three spider webs mounted on posts, showing paper sheets stuck to the webs and falling into three woven baskets placed on the floor beneath each web in a room lit by lanterns.

Async Web Scraping with Aiohttp & Proxies: A Guide

Feb 12, 2025 · 11 min read

A cat wearing glasses and a vest stands at a market stall beneath a sign reading "Expedia", pressing one of four large buttons on a wooden board next to travel tickets while a large spiderweb catches falling paper documents into a basket.

Scrape Expedia Deals: No Code & Smart Proxy Tips

Feb 11, 2025 · 5 min read

A cartoon spider on a workbench feeding one small blank card into an open wooden drawer in the side of a wooden machine, while a jointed brass arm on top of the machine holds a pen and writes line after line across a long paper strip that spills out and folds over the bench, a large pale plate on the machine front hand-lettered GPT, with a lit desk lamp, hanging tools and a jar of pencils around it.

Supercharge Web Scraping with ChatGPT & Proxy Tools

Feb 9, 2025 · 4 min read

A ginger tabby cat reaching a paw up to a large upright screen showing two blank entry fields above a dark button lettered LOGIN, on a table in a blue-plastered room with a lit desk lamp behind.

Scraping Login-Only Sites with Python: Methods & Tips

Feb 8, 2025 · 3 min read

A large cardboard carton hand-lettered amazon in plain dark letters on its front, a long ruled paper receipt strip spilling from the open top, standing in a cobbled loading yard with a hoist beam and a hand truck.

Scraping Amazon Data at Scale With Proxies

Feb 7, 2025 · 2 min read

A small round robot drawing a tangled skein of cord through the teeth of a wooden heckling comb, the cord coming out the other side as smooth parallel strands down the bench, in a green glazed-brick workroom.

Data Parsing for Web Scraping: A Practical Guide

Feb 2, 2025 · 2 min read

A small round robot standing at a workbench holding up a large folding knife with four blades open, over a long paper strip covered in fine ink marks that spills off the bench, with a lit brass lamp and coils of cord on the green boarded wall behind and a tray of tools at the right.

Multi-Language Automated Web Scraping with Smart Proxies

Jan 28, 2025 · 6 min read

A small round robot in a brick-vaulted cellar holding a brass mouthpiece on a ribbed flexible tube up to its face with one hand, while with the other it presses a large brass stencil plate flat against a sheet pinned to a timber board so that one block of the sheet's dashed marks shows through the stencil's rectangular window, with a lit brass lantern, a rack of tools and a tray of blank plates around it.

Using ChatGPT for Web Scraping: A Practical Guide

Jun 21, 2024 · 3 min read

A brown spider standing on a scrubbed pale pine workbench hauling a knot tight in a single line made of three different materials joined end to end, thick dark tarred rope on the left, fine cream twine in the middle and a flat brown leather lace on the right, the line drawn taut straight across the frame above the bench, with coils of rope, a mallet and tools hanging on a rail on the limewashed wall behind and shavings on the floor.

Master Automated Scraping in Any Programming Language

May 8, 2024 · 2 min read

A cartoon spider standing between two wooden crates on a scrubbed workbench, drawing a punched paper tape up out of each of them, the left crate painted with a blue rounded square carrying a white lowercase f and the right crate painted with the word amazon and a curved arrow beneath it, the right-hand tape running on through a small brass press and coiling on the bench, with a stone sink, a coil of twine and a box of tools around them.

Building Facebook & Amazon Data Extractors: A Guide

Apr 23, 2024 · 2 min read

Ten honey-coloured stone pillars with square caps standing in one row along a low step in a red brick courtyard, set out as two groups of five with a wider gap between the groups, each pillar throwing its own long shadow across the brick, with a dark clipped hedge behind them, a watering can and a coiled hose at the left and a brass switchboard of amber cords lying open on a bench at the right.

10 Best Practices in Proxy Implementation

Apr 17, 2024 · 2 min read

Other topics

Proxy Fundamentals Setup Guides Access Challenges Data Management Security Concepts Use Cases Tool Guides Network Performance Error Resolution Coding Tutorials Ethical Practices

Get Started with Swiss Quality Proxies

Try for Free View Pricing

Explore Our Proxy BlogTips on residential proxies, web scraping & security Frequently Asked QuestionsRead if you have any questions regarding proxies Read about EthicsOur Ethical Standards in the residential proxy market