Web Scraper API
Any public page as HTML, rendered in a browser when you ask.
Overview
What teams build with the Web Scraper API
Sites with no API
Read pricing pages, docs, changelogs, and directories that publish no feed, with your own parser on the HTML.
Pages that block plain requests
Get the page when a direct request comes back as a bot check or an error, without running your own browsers or proxies.
JavaScript-built pages
render=true loads the page in a browser and returns the DOM after load, for single-page apps that send an empty shell.
No official API
Do I need a scraper to read a page?
Not always. Many pages answer a plain HTTP GET, and those need no service. This API is for the pages that do not.
If a page answers your own request with the content you want, fetch it yourself: it is free. Pages that answer with a bot check, block datacenter addresses, or build their content in JavaScript need a browser and an unblocking network, which is what this API runs.
Clair tries a direct fetch first and moves to the browser only when that fails, so simple pages come back fast. Clair does not parse the page: you get its HTML, final URL, and status.
Read from these pages on October 27, 2026.
Data samples
From the page to JSON
The page the Web Scraper API reads, and the response it returns for the same query.
url
https://news.ycombinator.com/
https://news.ycombinator.com/

{
"url": "https://news.ycombinator.com/",
"final_url": "https://news.ycombinator.com/",
"status": 200,
"rendered": false,
"title": "Hacker News",
"html": "<html lang=\"en\" op=\"news\"><head><meta name=\"referrer\" content=\"origin\"><meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0\"><link rel=\"icon\" href=\"y18.svg\"><link rel=\"stylesheet\" type=\"text/css\" href=\"news.css?EieZrD3Ae1qf3cIQQaRb\"><link rel=\"alternate\" type=\"application/rss+xml\" title=\"RSS\" href=\"rss\"><title>Hacker News</title></head><body><center><table id=\"hnmain\" border=\"0\" cellpadding=\"0\" cellspacing=\"0\" width=\"85%\" bgcolor=\"#f6f6ef\"><tr><td bgcolor=\"#ff6600\"><table border=\"0\" cellpadding=\"0\" cellspacing=\"0\" width=\"100%\" style=\"padding:2px\"><tr><td style=\"width:18px;padding-right:4px\"><a href=\"https://news.ycombinator.com\"><img src=\"y18.svg\" width=\"18\" height=\"18\" style=\"border:1px white solid; display:block\"></a></td><td style=\"line-height:12pt; height:10px;\"><span class=\"pagetop\"><b class=\"hnname\"><a href=\"news\">Hacker News</a></b><a href=\"newest\">new</a> | <a href=\"front\">past</a> | <a href=\"newcomments\">comments</a> | <a href=\"ask\">ask</a> | <a href=\"show\">show</a> | <a href=\"jobs\">jobs</a> | <a href=\"submit\" rel=\"nofollow\">submit</a></span></td><td style=\"text-align:right;padding-right:4px;\"><span class=\"pagetop\"><a href=\"login?goto=news\">login</a></span></td></tr></table></td></tr><tr style='height:10px'/><tr id=\"bigbox\"><td><table border=\"0\" cellpadding=\"0\" cellspacing=\"0\"><tr class=\"athing submission\" id=\"50248371\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">1.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50248371' href='vote?id=50248371&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://github.com/microsoft/pylance-release/blob/main/docs/tsp/type-server-protocol.md\">Type Server Protocol</a><span class=\"sitebit comhead\"> (<a href=\"from?site=github.com/microsoft\"><span class=\"sitestr\">github.com/microsoft</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50248371\">139 points</span> by <a href=\"user?id=adamnemecek\" class=\"hnuser\">adamnemecek</a> <span class=\"age\" title=\"2026-10-26T18:14:49\"><a href=\"item?id=50248371\">3 hours ago</a></span> <span id=\"unv_50248371\"></span> | <a href=\"hide?id=50248371&goto=news\">hide</a> | <a href=\"item?id=50248371\">99 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50245138\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">2.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50245138' href='vote?id=50245138&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://magazine.sebastianraschka.com/p/building-reasoning-models\">Sebastian Raschka's from-scratch video course on building reasoning models</a><span class=\"sitebit comhead\"> (<a href=\"from?site=sebastianraschka.com\"><span class=\"sitestr\">sebastianraschka.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50245138\">470 points</span> by <a href=\"user?id=sgiannopoulos\" class=\"hnuser\">sgiannopoulos</a> <span class=\"age\" title=\"2026-10-26T15:11:59\"><a href=\"item?id=50245138\">6 hours ago</a></span> <span id=\"unv_50245138\"></span> | <a href=\"hide?id=50245138&goto=news\">hide</a> | <a href=\"item?id=50245138\">65 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50245831\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">3.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50245831' href='vote?id=50245831&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://css-tricks.com/css-tricks-has-a-new-owner/\">CSS-Tricks has a new owner</a><span class=\"sitebit comhead\"> (<a href=\"from?site=css-tricks.com\"><span class=\"sitestr\">css-tricks.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50245831\">312 points</span> by <a href=\"user?id=edent\" class=\"hnuser\">edent</a> <span class=\"age\" title=\"2026-10-26T15:51:23\"><a href=\"item?id=50245831\">5 hours ago</a></span> <span id=\"unv_50245831\"></span> | <a href=\"hide?id=50245831&goto=news\">hide</a> | <a href=\"item?id=50245831\">69 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50248055\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">4.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50248055' href='vote?id=50248055&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://blog.enlyth.com/posts/oldest-windows-gui-app-win-11/\">Oldest GUI application that still runs on Windows 11</a><span class=\"sitebit comhead\"> (<a href=\"from?site=enlyth.com\"><span class=\"sitestr\">enlyth.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50248055\">172 points</span> by <a href=\"user?id=enlyth\" class=\"hnuser\">enlyth</a> <span class=\"age\" title=\"2026-10-26T17:56:55\"><a href=\"item?id=50248055\">3 hours ago</a></span> <span id=\"unv_50248055\"></span> | <a href=\"hide?id=50248055&goto=news\">hide</a> | <a href=\"item?id=50248055\">91 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50247493\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">5.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50247493' href='vote?id=50247493&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://github.com/DilawarShafiq/nietzschian-debugger\">Nietzschian Debugger</a><span class=\"sitebit comhead\"> (<a href=\"from?site=github.com/dilawarshafiq\"><span class=\"sitestr\">github.com/dilawarshafiq</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50247493\">99 points</span> by <a href=\"user?id=dilawargopang\" class=\"hnuser\">dilawargopang</a> <span class=\"age\" title=\"2026-10-26T17:25:30\"><a href=\"item?id=50247493\">3 hours ago</a></span> <span id=\"unv_50247493\"></span> | <a href=\"hide?id=50247493&goto=news\">hide</a> | <a href=\"item?id=50247493\">30 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50248124\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">6.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50248124' href='vote?id=50248124&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://openai.com/index/introducing-gpt-6-1-terra/\">GPT-6.1 Terra</a><span class=\"sitebit comhead\"> (<a href=\"from?site=openai.com\"><span class=\"sitestr\">openai.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50248124\">376 points</span> by <a href=\"user?id=meetpateltech\" class=\"hnuser\">meetpateltech</a> <span class=\"age\" title=\"2026-10-26T18:01:17\"><a href=\"item?id=50248124\">3 hours ago</a></span> <span id=\"unv_50248124\"></span> | <a href=\"hide?id=50248124&goto=news\">hide</a> | <a href=\"item?id=50248124\">228 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50249275\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">7.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50249275' href='vote?id=50249275&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.motherjones.com/environment/2026/10/epa-online-archive-deletion-zeldin-camp-lejeune-trump-clean-power/\">The EPA Is Quietly Killing Its Web Archive</a><span class=\"sitebit comhead\"> (<a href=\"from?site=motherjones.com\"><span class=\"sitestr\">motherjones.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50249275\">150 points</span> by <a href=\"user?id=robtherobber\" class=\"hnuser\">robtherobber</a> <span class=\"age\" title=\"2026-10-26T19:05:41\"><a href=\"item?id=50249275\">2 hours ago</a></span> <span id=\"unv_50249275\"></span> | <a href=\"hide?id=50249275&goto=news\">hide</a> | <a href=\"item?id=50249275\">21 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50247928\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">8.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50247928' href='vote?id=50247928&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"http://muratbuffalo.blogspot.com/2026/10/the-man-from-future-why-johnny-cant.html\">A Man from the Future: Why Johnny Can't Stop Abstracting</a><span class=\"sitebit comhead\"> (<a href=\"from?site=muratbuffalo.blogspot.com\"><span class=\"sitestr\">muratbuffalo.blogspot.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50247928\">64 points</span> by <a href=\"user?id=aray07\" class=\"hnuser\">aray07</a> <span class=\"age\" title=\"2026-10-26T17:49:55\"><a href=\"item?id=50247928\">3 hours ago</a></span> <span id=\"unv_50247928\"></span> | <a href=\"hide?id=50247928&goto=news\">hide</a> | <a href=\"item?id=50247928\">32 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50242939\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">9.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50242939' href='vote?id=50242939&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.sec.gov/Archives/edgar/data/2130357/000162828026067168/anthropicpbc-sx1.htm\">Anthropic S-1</a><span class=\"sitebit comhead\"> (<a href=\"from?site=sec.gov\"><span class=\"sitestr\">sec.gov</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50242939\">1337 points</span> by <a href=\"user?id=SiNTEx\" class=\"hnuser\">SiNTEx</a> <span class=\"age\" title=\"2026-10-26T13:04:50\"><a href=\"item?id=50242939\">8 hours ago</a></span> <span id=\"unv_50242939\"></span> | <a href=\"hide?id=50242939&goto=news\">hide</a> | <a href=\"item?id=50242939\">1321 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50236681\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">10.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50236681' href='vote?id=50236681&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://shraiwi.com/blog/simd-fast-esp32s3/\">SIMD-accelerated computer vision on a $2 microcontroller</a><span class=\"sitebit comhead\"> (<a href=\"from?site=shraiwi.com\"><span class=\"sitestr\">shraiwi.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50236681\">146 points</span> by <a href=\"user?id=zdw\" class=\"hnuser\">zdw</a> <span class=\"age\" title=\"2026-10-25T22:29:47\"><a href=\"item?id=50236681\">6 hours ago</a></span> <span id=\"unv_50236681\"></span> | <a href=\"hide?id=50236681&goto=news\">hide</a> | <a href=\"item?id=50236681\">47 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50209525\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">11.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50209525' href='vote?id=50209525&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.df.com/diamond-transistor\">Diamond Transistor</a><span class=\"sitebit comhead\"> (<a href=\"from?site=df.com\"><span class=\"sitestr\">df.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50209525\">98 points</span> by <a href=\"user?id=Gravityloss\" class=\"hnuser\">Gravityloss</a> <span class=\"age\" title=\"2026-10-23T14:20:15\"><a href=\"item?id=50209525\">5 hours ago</a></span> <span id=\"unv_50209525\"></span> | <a href=\"hide?id=50209525&goto=news\">hide</a> | <a href=\"item?id=50209525\">53 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50211780\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">12.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50211780' href='vote?id=50211780&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://petapixel.com/2026/10/22/sigma-says-the-compact-modular-fp2-is-the-ultimate-hybrid-camera/\">Sigma Says the Compact, Modular FP2 Is the Ultimate Hybrid Camera</a><span class=\"sitebit comhead\"> (<a href=\"from?site=petapixel.com\"><span class=\"sitestr\">petapixel.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50211780\">27 points</span> by <a href=\"user?id=thm\" class=\"hnuser\">thm</a> <span class=\"age\" title=\"2026-10-23T16:41:41\"><a href=\"item?id=50211780\">2 hours ago</a></span> <span id=\"unv_50211780\"></span> | <a href=\"hide?id=50211780&goto=news\">hide</a> | <a href=\"item?id=50211780\">17 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50246238\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">13.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50246238' href='vote?id=50246238&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://github.com/FrigadeHQ/hob\">Show HN: Hob - Open-source, on device alternative to Claude Cowork and ChatGPT</a><span class=\"sitebit comhead\"> (<a href=\"from?site=github.com/frigadehq\"><span class=\"sitestr\">github.com/frigadehq</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50246238\">35 points</span> by <a href=\"user?id=pancomplex\" class=\"hnuser\">pancomplex</a> <span class=\"age\" title=\"2026-10-26T16:12:29\"><a href=\"item?id=50246238\">2 hours ago</a></span> <span id=\"unv_50246238\"></span> | <a href=\"hide?id=50246238&goto=news\">hide</a> | <a href=\"item?id=50246238\">14 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50200152\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">14.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50200152' href='vote?id=50200152&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://humantransit.org/2024/12/one-of-the-greatest-inventions-in-the-history-of-human-transport.html\">Blaise Pascal invented fixed route public transport (2024)</a><span class=\"sitebit comhead\"> (<a href=\"from?site=humantransit.org\"><span class=\"sitestr\">humantransit.org</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50200152\">242 points</span> by <a href=\"user?id=skadamat\" class=\"hnuser\">skadamat</a> <span class=\"age\" title=\"2026-10-22T19:52:50\"><a href=\"item?id=50200152\">11 hours ago</a></span> <span id=\"unv_50200152\"></span> | <a href=\"hide?id=50200152&goto=news\">hide</a> | <a href=\"item?id=50200152\">126 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50248665\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">15.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50248665' href='vote?id=50248665&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://apnews.com/article/energy-critical-materials-minerals-helium-43da160adc1bad389fba0b9ffbd14c3c\">US designates helium as a critical material</a><span class=\"sitebit comhead\"> (<a href=\"from?site=apnews.com\"><span class=\"sitestr\">apnews.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50248665\">123 points</span> by <a href=\"user?id=rbanffy\" class=\"hnuser\">rbanffy</a> <span class=\"age\" title=\"2026-10-26T18:31:39\"><a href=\"item?id=50248665\">2 hours ago</a></span> <span id=\"unv_50248665\"></span> | <a href=\"hide?id=50248665&goto=news\">hide</a> | <a href=\"item?id=50248665\">63 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50215997\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">16.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50215997' href='vote?id=50215997&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.bbc.com/future/article/20261019-birdwatching-rewires-the-brain-and-slows-cognitive-decline\">Birdwatching rewires the brain and slows cognitive decline</a><span class=\"sitebit comhead\"> (<a href=\"from?site=bbc.com\"><span class=\"sitestr\">bbc.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50215997\">471 points</span> by <a href=\"user?id=cisc\" class=\"hnuser\">cisc</a> <span class=\"age\" title=\"2026-10-23T22:04:55\"><a href=\"item?id=50215997\">15 hours ago</a></span> <span id=\"unv_50215997\"></span> | <a href=\"hide?id=50215997&goto=news\">hide</a> | <a href=\"item?id=50215997\">182 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50241925\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">17.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50241925' href='vote?id=50241925&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://pharo.org/news/2026-10-26-Pharo14Release.html\">Pharo 14</a><span class=\"sitebit comhead\"> (<a href=\"from?site=pharo.org\"><span class=\"sitestr\">pharo.org</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50241925\">214 points</span> by <a href=\"user?id=xkriva11\" class=\"hnuser\">xkriva11</a> <span class=\"age\" title=\"2026-10-26T11:15:50\"><a href=\"item?id=50241925\">10 hours ago</a></span> <span id=\"unv_50241925\"></span> | <a href=\"hide?id=50241925&goto=news\">hide</a> | <a href=\"item?id=50241925\">52 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50248005\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">18.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50248005' href='vote?id=50248005&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.404media.co/in-leaked-audio-flock-ceo-tells-cops-backlash-to-the-company-isnt-real/\">In Leaked Audio, Flock CEO Tells Cops Backlash to the Company Isn't Real</a><span class=\"sitebit comhead\"> (<a href=\"from?site=404media.co\"><span class=\"sitestr\">404media.co</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50248005\">177 points</span> by <a href=\"user?id=Frieren\" class=\"hnuser\">Frieren</a> <span class=\"age\" title=\"2026-10-26T17:54:00\"><a href=\"item?id=50248005\">3 hours ago</a></span> <span id=\"unv_50248005\"></span> | <a href=\"hide?id=50248005&goto=news\">hide</a> | <a href=\"item?id=50248005\">98 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50250937\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">19.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50250937' href='vote?id=50250937&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.kuow.org/technology/2026-10-26/microsoft-offers-voluntary-buyouts-to-a-quarter-of-its-workforce\">Microsoft offers voluntary buyouts to a quarter of its workforce</a><span class=\"sitebit comhead\"> (<a href=\"from?site=kuow.org\"><span class=\"sitestr\">kuow.org</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50250937\">24 points</span> by <a href=\"user?id=mooreds\" class=\"hnuser\">mooreds</a> <span class=\"age\" title=\"2026-10-26T21:05:15\"><a href=\"item?id=50250937\">19 minutes ago</a></span> <span id=\"unv_50250937\"></span> | <a href=\"hide?id=50250937&goto=news\">hide</a> | <a href=\"item?id=50250937\">3 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50237019\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">20.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50237019' href='vote?id=50237019&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://dbohdan.github.io/glider/\">Show HN: Glider 4.0 Unofficial Web Edition (Mac game port)</a><span class=\"sitebit comhead\"> (<a href=\"from?site=dbohdan.github.io\"><span class=\"sitestr\">dbohdan.github.io</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50237019\">18 points</span> by <a href=\"user?id=networked\" class=\"hnuser\">networked</a> <span class=\"age\" title=\"2026-10-25T23:18:42\"><a href=\"item?id=50237019\">2 hours ago</a></span> <span id=\"unv_50237019\"></span> | <a href=\"hide?id=50237019&goto=news\">hide</a> | <a href=\"item?id=50237019\">3 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50246658\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">21.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50246658' href='vote?id=50246658&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://cohere.com/blog/concerning-behaviour-popular-open-weight-ai-model\">Concerning behavior from a popular open-weight AI model</a><span class=\"sitebit comhead\"> (<a href=\"from?site=cohere.com\"><span class=\"sitestr\">cohere.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50246658\">206 points</span> by <a href=\"user?id=matthieu_bl\" class=\"hnuser\">matthieu_bl</a> <span class=\"age\" title=\"2026-10-26T16:35:44\"><a href=\"item?id=50246658\">4 hours ago</a></span> <span id=\"unv_50246658\"></span> | <a href=\"hide?id=50246658&goto=news\">hide</a> | <a href=\"item?id=50246658\">76 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50212764\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">22.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50212764' href='vote?id=50212764&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://qwac.com/blog/who-killed-the-ev-cert\" rel=\"nofollow\">Who killed the EV cert? A browser whodunit for Halloween</a><span class=\"sitebit comhead\"> (<a href=\"from?site=qwac.com\"><span class=\"sitestr\">qwac.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50212764\">5 points</span> by <a href=\"user?id=roddylindsay\" class=\"hnuser\">roddylindsay</a> <span class=\"age\" title=\"2026-10-23T17:46:33\"><a href=\"item?id=50212764\">1 hour ago</a></span> <span id=\"unv_50212764\"></span> | <a href=\"hide?id=50212764&goto=news\">hide</a> | <a href=\"item?id=50212764\">7 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50242870\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">23.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50242870' href='vote?id=50242870&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.ubicloud.com/blog/fixing-tool-call-accuracy-in-vllm\">Fixing Tool-Call Accuracy in vLLM</a><span class=\"sitebit comhead\"> (<a href=\"from?site=ubicloud.com\"><span class=\"sitestr\">ubicloud.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50242870\">138 points</span> by <a href=\"user?id=coffeemug\" class=\"hnuser\">coffeemug</a> <span class=\"age\" title=\"2026-10-26T12:59:48\"><a href=\"item?id=50242870\">8 hours ago</a></span> <span id=\"unv_50242870\"></span> | <a href=\"hide?id=50242870&goto=news\">hide</a> | <a href=\"item?id=50242870\">64 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50250016\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">24.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50250016' href='vote?id=50250016&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://notes.npilk.com/stop-the-spam-texts\">Somebody please stop the spam texts</a><span class=\"sitebit comhead\"> (<a href=\"from?site=npilk.com\"><span class=\"sitestr\">npilk.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50250016\">92 points</span> by <a href=\"user?id=npilk\" class=\"hnuser\">npilk</a> <span class=\"age\" title=\"2026-10-26T19:57:32\"><a href=\"item?id=50250016\">1 hour ago</a></span> <span id=\"unv_50250016\"></span> | <a href=\"hide?id=50250016&goto=news\">hide</a> | <a href=\"item?id=50250016\">97 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50240922\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">25.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50240922' href='vote?id=50240922&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://blocks.manifold3d.ch/\">Switzerland. Block by block. At 1:1 scale</a><span class=\"sitebit comhead\"> (<a href=\"from?site=manifold3d.ch\"><span class=\"sitestr\">manifold3d.ch</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50240922\">438 points</span> by <a href=\"user?id=theanonymousone\" class=\"hnuser\">theanonymousone</a> <span class=\"age\" title=\"2026-10-26T08:46:09\"><a href=\"item?id=50240922\">12 hours ago</a></span> <span id=\"unv_50240922\"></span> | <a href=\"hide?id=50240922&goto=news\">hide</a> | <a href=\"item?id=50240922\">209 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50222794\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">26.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50222794' href='vote?id=50222794&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://dl.acm.org/doi/10.1145/3830440.3832304\">An incremental approach to JIT construction</a><span class=\"sitebit comhead\"> (<a href=\"from?site=acm.org\"><span class=\"sitestr\">acm.org</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50222794\">30 points</span> by <a href=\"user?id=andsoitis\" class=\"hnuser\">andsoitis</a> <span class=\"age\" title=\"2026-10-24T16:27:18\"><a href=\"item?id=50222794\">4 hours ago</a></span> <span id=\"unv_50222794\"></span> | <a href=\"hide?id=50222794&goto=news\">hide</a> | <a href=\"item?id=50222794\">1 comment</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50247559\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">27.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50247559' href='vote?id=50247559&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://blog.ericgoldman.org/archives/2026/10/should-police-wipe-a-criminals-cellphone-before-returning-it-u-s-v-stathas.htm\">Should Police Wipe a Criminal's Cellphone Before Returning It?–U.S. vs. Stathas</a><span class=\"sitebit comhead\"> (<a href=\"from?site=ericgoldman.org\"><span class=\"sitestr\">ericgoldman.org</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50247559\">35 points</span> by <a href=\"user?id=hn_acker\" class=\"hnuser\">hn_acker</a> <span class=\"age\" title=\"2026-10-26T17:28:26\"><a href=\"item?id=50247559\">3 hours ago</a></span> <span id=\"unv_50247559\"></span> | <a href=\"hide?id=50247559&goto=news\">hide</a> | <a href=\"item?id=50247559\">31 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50247630\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">28.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50247630' href='vote?id=50247630&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.404media.co/chatgpt-keeps-telling-people-404-media-can-solve-their-tech-support-problems/\">ChatGPT Keeps Telling People 404 Media Can Solve Their Tech Support Problems</a><span class=\"sitebit comhead\"> (<a href=\"from?site=404media.co\"><span class=\"sitestr\">404media.co</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50247630\">175 points</span> by <a href=\"user?id=cdrnsf\" class=\"hnuser\">cdrnsf</a> <span class=\"age\" title=\"2026-10-26T17:32:16\"><a href=\"item?id=50247630\">3 hours ago</a></span> <span id=\"unv_50247630\"></span> | <a href=\"hide?id=50247630&goto=news\">hide</a> | <a href=\"item?id=50247630\">57 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50214967\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">29.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50214967' href='vote?id=50214967&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://www.militaryaviationmuseum.org/our-collection/\">World Wars I and II Military Aviation Museum Collection</a><span class=\"sitebit comhead\"> (<a href=\"from?site=militaryaviationmuseum.org\"><span class=\"sitestr\">militaryaviationmuseum.org</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50214967\">21 points</span> by <a href=\"user?id=NaOH\" class=\"hnuser\">NaOH</a> <span class=\"age\" title=\"2026-10-23T20:35:40\"><a href=\"item?id=50214967\">3 hours ago</a></span> <span id=\"unv_50214967\"></span> | <a href=\"hide?id=50214967&goto=news\">hide</a> | <a href=\"item?id=50214967\">9 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"athing submission\" id=\"50249116\"><td align=\"right\" valign=\"top\" class=\"title\"><span class=\"rank\">30.</span></td><td valign=\"top\" class=\"votelinks\"><center><a id='up_50249116' href='vote?id=50249116&how=up&goto=news'><div class='votearrow' title='upvote'></div></a></center></td><td class=\"title\"><span class=\"titleline\"><a href=\"https://variety.com/2026/film/news/skydance-voluntary-buyouts-layoffs-5-days-per-week-in-office-policy-1236931402/\">Skydance offers buyouts, orders return to office</a><span class=\"sitebit comhead\"> (<a href=\"from?site=variety.com\"><span class=\"sitestr\">variety.com</span></a>)</span></span></td></tr><tr><td colspan=\"2\"></td><td class=\"subtext\"><span class=\"subline\"><span class=\"score\" id=\"score_50249116\">61 points</span> by <a href=\"user?id=metabagel\" class=\"hnuser\">metabagel</a> <span class=\"age\" title=\"2026-10-26T18:56:03\"><a href=\"item?id=50249116\">2 hours ago</a></span> <span id=\"unv_50249116\"></span> | <a href=\"hide?id=50249116&goto=news\">hide</a> | <a href=\"item?id=50249116\">13 comments</a></span></td></tr><tr class=\"spacer\" style=\"height:5px\"></tr><tr class=\"morespace\" style=\"height:10px\"></tr><tr><td colspan=\"2\"></td><td class='title'><a href='?p=2' class='morelink' rel='next'>More</a></td></tr></table></td></tr><tr><td><img src=\"s.gif\" height=\"10\" width=\"0\"><table width=\"100%\" cellspacing=\"0\" cellpadding=\"1\"><tr><td bgcolor=\"#ff6600\"></td></tr></table><br>\n<center><a href=\"https://www.ycombinator.com/apply/\">Consider applying for YC's Winter 2027 batch! <u>Applications</u> are open till November 2.</a></center><br>\n<center><span class=\"yclinks\"><a href=\"newsguidelines.html\">Guidelines</a> | <a href=\"newsfaq.html\">FAQ</a> | <a href=\"lists\">Lists</a> | <a href=\"https://github.com/HackerNews/API\">API</a> | <a href=\"security.html\">Security</a> | <a href=\"https://www.ycombinator.com/legal/\">Legal</a> | <a href=\"https://www.ycombinator.com/apply/\">Apply to YC</a> | <a href=\"mailto:hn@ycombinator.com\">Contact</a></span><br><br>\n<form method=\"get\" action=\"//hn.algolia.com/\">Search: <input type=\"text\" name=\"q\" size=\"17\" autocorrect=\"off\" spellcheck=\"false\" autocapitalize=\"off\" autocomplete=\"off\"></form></center></td></tr></table></center></body><script type=\"text/javascript\" src=\"hn.js?EieZrD3Ae1qf3cIQQaRb\"></script></html>"
}Source page captured separately from the recorded response, so live values can differ.
Code
Integrate in minutes
One host, one Bearer key for every Clair API. Each call returns JSON with the same envelope, so a second API is a new path, not a new client.
curl -G "https://api.clair.im/v1/scrape?url=https%3A%2F%2Fnews.ycombinator.com%2F" \ -H "Authorization: Bearer YOUR_API_KEY"
Reference
Query and response fields
http and https URLs on public hostnames. A direct fetch first, then a browser that gets past bot checks. rendered says which one served the page; status is the code the page answered with.
GET /v1/scrape
Authorizationheader · stringrequired
- Bearer <api_key>. Create keys under API keys.
urlstringrequired
- The page, with
http://orhttps://. Public hostnames only: IP addresses, localhost, custom ports, and URLs with a username or password are rejected. renderstring
trueto load the page in a browser first, for content built in JavaScript. Defaultfalse.
Pricing
One subscription. Every API. | |||||
|---|---|---|---|---|---|
| Web Scraper | $11.50/1K requests Up to 86 requests | $10.00/1K requests Up to 3K requests | $9.00/1K requests Up to 11.1K requests | $8.00/1K requests Up to 37.5K requests | Custom rate Volume pricing |
Paid plans run at 10 requests a second. Need more? Email us and we will raise your limit.
Which URLs can I send?
http and https URLs on public hostnames. IP addresses, localhost, custom ports, and URLs with a username or password are rejected with 400.
When should I set render=true?
When the HTML you get without it lacks the content you see in a browser, because the page fills it in with JavaScript. Pages that block direct requests go to the browser on their own.
What if the page answers 404?
You get the page and its status, 404, in a 200 response. A page we could not load at all is a 502 and is not charged.
Does it parse the page?
No. It returns the title and the HTML. For structured results from Google, Amazon, Glassdoor, and the other sites in the catalog, use their APIs.
What does the Web Scraper API return?
Give it a URL and get the page back. A direct fetch goes first; a page that blocks it or answers an error goes to a browser that gets past bot checks, and render=true sends it there for pages that build their content in JavaScript. You are charged only for a page we return.
How is a request counted?
Each call is one request, and each extra page is a new call. A malformed request (400) is not counted, and a request that fails on our side (5xx) is refunded.
Is there a free tier?
Yes. The free tier is $1 of usage a month across every Clair API, with no card: about 86 Web Scraper API requests if it all goes here. It resets monthly, and calls stop when the balance runs out.
What happens when I use up my plan's balance?
The API returns 429 until the next period, on every plan, and nothing is billed past the balance. An upgrade starts a new month at once, and the unused balance carries over.
Does my plan cover other Clair APIs?
Yes. One plan and one key cover every Clair API, and every call spends from the same monthly balance. Your first call starts the free tier.
Guides
Learn more about the Web Scraper API
One plan, every API.
Your plan's price is your monthly usage balance, spent across every Clair API. Start free, no card.

Glassdoor API
Crunchbase API
Bloomberg API
Associated Press API