Most popular dataset

The complete list of websites and their technologies

The full list of websites and their technologies, 285,059,425 sites fingerprinted for the CMS, e-commerce platform, analytics, framework, CDN and payment stack each one runs. One file, daily fresh export, no API limits, and no per-lookup metering. What BuiltWith-style tools rent by the month, you get for €159.

✓ Daily fresh export  ·  ✓ No API limits  ·  ✓ Free 10K sample

285.1M Domains with detected stack
3,049 Technologies tracked
239 Countries (by IP)
14 Columns

Inside the Technologies dataset: a live data sample

Five real rows from the live database, the exact 14-column schema you download, nothing mocked up.

webatla-technologies.jsonl.zst · 285.1M rows · 9.8 GB · 14 columns Daily fresh export · Exported 19 Jul 2026
DomainTLD suffixTLDDomain typeHTTP statusIP addressCountry by IPSocial networksTechnologies last data checkedTechnologiesPR valueHarmonic valueDomain creation dateDomain expiration date
instagram.comcomcomICANNHTTP 20057.144.248.34DE{"facebook":["https://developers.facebook.com/docs/instagram","https://facebook.com/help/instagram/261704639352628","https://facebook.com/help/cancelcontracts?source=instagram.com"],"instagram":["https://instagram.com/data/manifest.json","https://instagram.com/accounts/password/reset","https://instagram.com/accounts/emailsignup?next="]}2026-05-14PWA, HSTS, HTTP/3, DigiCert, Open Graph0.006295726,877,1642004-06-042034-06-04
cloudflare.comcomcomICANNHTTP 200104.16.132.229US{"discord":["https://discord.com/invite/cloudflaredev"],"youtube":["https://youtube.com/cloudflare"],"facebook":["https://facebook.com/Cloudflare"],"linkedin":["https://linkedin.com/company/cloudflare"],"instagram":["https://instagram.com/cloudflare"],"x-twitter":["https://x.com/Cloudflare"]}2026-05-03HSTS, HTTP/3, Stripe, Zendesk, OneTrust, MailChimp, Cloudflare, Open Graph, Salesforce, Facebook Pixel0.0059065822,443,2202009-02-172033-02-17
youtube.comcomcomICANNHTTP 200142.251.13.136US{"youtube":["https://youtube.com/static/favicon.ico","https://youtube.com/s/_/ytmweb/_/ss/k=ytmweb.c3_base_cow_tracing.Osf9qbBmtjs.L.X.O/am=AAAAAIABQQBsGA/d=0/rs=ABnK5FLnOCL0J6Hr-MypqOa20PTL6dTSDQ"]}2026-07-18HSTS, HTTP/3, Favicon, YouTube, Open Graph, Priority Hints, Google Site Verification, Facebook Domain Verification0.0048381825,770,1582005-02-152027-02-15
linkedin.comcomcomICANNHTTP 200150.171.22.12US{"linkedin":["https://linkedin.com/legal/cookie-policy","https://linkedin.com/mypreferences/g/guest-cookies","https://linkedin.com/legal/user-agreement"]}2026-05-18HSTS, Java, Azure, HTTP/3, DigiCert, DocuSign, Cloudflare, Open Graph, Naver Analytics, Cloudflare Bot Management0.0038051624,467,4862002-11-022026-11-02
wordpress.orgorgorgICANNHTTP 20066.6.42.252US{"tiktok":["https://tiktok.com/@wordpress"],"bluesky":["https://bsky.app/profile/wordpress.org"],"threads":["https://threads.net/@wordpress"],"youtube":["https://youtube.com/wordpress"],"facebook":["https://facebook.com/WordPress"],"linkedin":["https://linkedin.com/company/wordpress"],"instagram":["https://instagram.com/wordpress"],"x-twitter":["https://x.com/WordPress"]}2026-07-08PHP, RSS, HSTS, MySQL, Nginx, HTTP/2, Favicon, hreflang, Gutenberg 23.5.0, WordPress 7.10.0019172921,394,3342003-03-282035-03-28

Live values straight from the dataset, not placeholders. ↓ Free 10K preview

A website and everything it runs, on one row

cloudflare.com
CloudflareNginxHTTP/3HSTSStripeSalesforceZendeskOpen Graph

Every row in the list of websites and their technologies pairs a site with the full stack we detected on it, from CMS and framework to CDN, analytics and payment provider.

What we detect on every site

3,049 technologies, grouped into the categories teams filter by most. These are a handful of examples from each.

CMS and site builders

WordPressDrupalWixSquarespace

E-commerce

ShopifyWooCommerceMagento

Frameworks and libraries

ReactVue.jsAngularNext.jsjQuery

CDN, hosting and servers

CloudflareAkamaiFastlyNginxGoDaddy

Analytics and marketing

Google AnalyticsSegmentHubSpotKlaviyo

Payments and security

StripePayPalHSTS

Fourteen columns on every website

The domain spine and ranking columns, plus the technology fingerprint payload.

domain
The registrable website address, your join key.
cloudflare.com
suffix
The public suffix, the registry the name sits under.
com · co.uk
tld
The top-level label on its own.
com
type
Whether the suffix is ICANN or PRIVATE.
ICANN · PRIVATE
techs
The detected technology stack, as an array of names.
["Shopify", ...]
techsAt
The date the technologies were last checked.
2026-05-03
httpStatus
The HTTP status the site returned.
HTTP 200
ip
The address the site resolves to.
104.16.132.229
country
The country the site is served from, by IP.
DE · US
social
Social profile links found on the site.
x · linkedin
pr
PageRank, link-graph authority.
0.0059
harmonic
Harmonic Centrality, a spam-robust importance score.
22,443,220
created
Domain creation date.
2009-02-17
expires
Domain expiration date.
2033-02-17

How every site gets fingerprinted, daily

The detection runs on our side, so the stack lands in your copy already matched.

1

Crawl

Sweep the web for live sites.

2

Fetch

Pull each page, its headers and scripts.

3

Fingerprint

Match 3,049 technology signatures.

4

Enrich

Add rank, country, IP, social and dates.

5

Export

Ship one JSONL file.

Who works from the list of websites and their technologies

One daily-refreshed file, many teams. Here is how different buyers turn it into an advantage.

Outbound and growth

Build ideal-fit account lists

Filter to Shopify stores in Germany or React apps in the US, then export the list straight into your CRM.

Market research

Measure platform market share

Count sites by technology across the whole web and diff the daily exports to plot how a platform gains or loses share.

Competitive intel

See a competitor's whole stack

Look up any domain to read the CMS, analytics, payments and hosting it runs, at web scale rather than one lookup at a time.

Security and threat intel

Find exposed software

Spot every site running an end-of-life CMS or library across the web the same day, straight from the technologies field.

Ad-tech and partnerships

Qualify inventory by stack

Weight or exclude sites by the tools they run, from payment providers to tag managers, joined against your own list.

Investors and analysts

Track adoption curves

Follow how many sites run a given technology over time to size a market or test a thesis across 239 countries.

Per-lookup tech-intel tools, or one file

The usual per-lookup tools

  • A subscription is required, often a few hundred to a few thousand a month.
  • Lookups are capped per month, and bulk export costs extra.
  • The web UI is the product, so scripting against it stays fragile.
  • Refresh is weekly or monthly, and country coverage is thin.

The Technologies dataset

  • €159, with no per-lookup cap.
  • The full 285.1M-row file, ready to query offline.
  • Loads straight into Postgres, BigQuery, Snowflake or DuckDB.
  • Daily fresh export across 239 countries and 1,435 TLDs.

Drop the list into your stack

The technologies field is a plain array, so the queries you want are one line each. It loads into Postgres, BigQuery, Snowflake or DuckDB with no preprocessing.

Postgres BigQuery Snowflake DuckDB
every Shopify store in Germany
SELECT domain FROM 'technologies.jsonl.zst'
WHERE list_contains(techs, 'Shopify') AND country = 'DE'

Sites on a given platform

WHERE list_contains(techs, 'Magento')

An instant list of every site on a tool you support or target.

Two tools together

WHERE list_contains(techs, 'Stripe') AND list_contains(techs, 'React')

Sites that pair two technologies, for integrations or partnerships.

Platform share by country

SELECT country, count(*) WHERE list_contains(techs, 'WordPress') GROUP BY country

Where a platform is strongest, in one query.

Whole market share

SELECT tech, count(*) FROM t, unnest(techs) tech GROUP BY tech

Rank every technology by the number of sites that run it.

Fingerprints you can trust

Read from the real page

Every stack is fingerprinted from the live site's own HTML, headers and scripts, not guessed and not resold from a third party.

Live sites only

A site is fetched and verified before it earns a row, so you match real, reachable properties.

Rebuilt daily

Fingerprints are re-checked continuously and the whole list is re-exported each day, so the stack never goes stale.

Spanning 1,435 TLDs and 239 countries

webatla tracks domains across every TLD and country. The largest by domain count, each linking to its full profile.

Subscription, freshness, licensing & refunds

How big is the list of websites and their technologies?

The current export holds 285,059,425 active websites, each with the technologies detected on it, across 239 countries and 1,435 TLDs. It refreshes every day.

How many technologies do you detect?

3,049 technologies across CMS, e-commerce, analytics, frameworks, CDNs, payments, security and more. Every one is browsable at webatla.com/technology.

How do you detect a website's technologies?

We fetch each live site and fingerprint it from its HTML, headers, scripts and cookies, the same signals a browser extension reads, then attach the matches to that row.

How is the technologies field stored?

As an array of technology names on every row, so a single unnest or array-contains clause filters the list down to any stack you care about, with no preprocessing.

How is this different from Websites and Ranking?

Websites and Ranking gives you every site with country and rank. Technologies keeps the sites we could fingerprint and adds the detected stack, HTTP status, IP and social links on top.

How fresh is the data?

Technology fingerprints are re-checked continuously and the full dataset is re-exported every day. Inside your access window you can re-download whenever you want.

What format does it come in?

JSON Lines, zstandard-compressed (9.8 GB), one documented schema. It loads into Postgres, BigQuery, Snowflake or DuckDB with no preprocessing.

Is this GDPR-compliant?

Yes. It uses only public HTTP-fingerprint, DNS and WHOIS signals, with no personal contact information.

How do I get the data after I pay?

The moment your payment clears, the dataset appears in your account downloads. You can re-download the latest daily export as often as you like for your whole one-month access window.

Can I use the data commercially?

Yes. Commercial use inside your organisation is covered by the webatla data licence (see the Terms). For redistribution, reselling or multi-year licensing, contact us first.

Do you offer refunds?

Datasets are digital products, so all sales are final, which is exactly why every dataset has a free 10K-row preview to check the schema before you buy. The one exception is a material defect such as a broken file, the wrong schema, or more than 5% missing rows. Email support within 72 hours and we'll re-issue or refund.

Get the full list of websites and their technologies.

285.1M sites · 3,049 technologies · daily fresh export · €159 for a month.