Web Data Examples · Example 1 of 6

Everything about developer.mozilla.org in one call: technologies, meta tags, HTML, visible text, links, scripts, favicons, robots.txt and headers.

Param
url

Asks for the web data of https://developer.mozilla.org/en-US/ (MDN Web Docs) with the defaults.

A tour of the response: technology.stacks lists six technologies, Varnish, RequireJS, Google App Engine, Google Cloud, Choices and Google Cloud Storage; this is the same detection as the Technology lookup, and RequireJS and Choices do not appear in the page's HTML. html.meta has the title (MDN Web Docs), the description, the language en-US, the canonical URL and the Open Graph tags (og). html.source_code is the HTML (72,316 characters in full) and html.content the visible text (4,681 characters).

html.internal_links_fqdns names four Mozilla host names (developer.mozilla.org, www.mozilla.org, support.mozilla.org and hacks.mozilla.org), html.external_links_domains five outside domains (scrimba.com, github.com, bsky.app, x.com and mastodon.social) and html.script_links the five script files of the page. favicon lists three icons with a hash of each, robots_txt the file with its three Disallow paths (/api/, /*/files/ and /media) and http.headers the response headers. The page sets no cookie and has no tracking ID, so http.cookies and html.trackers are empty.

Request

What this example sends. Every parameter is documented on Web Data; the exact request is in the code panel.

ParameterValue
urlqueryhttps://developer.mozilla.org/en-US/

Reference updated