API Documentation (beta)

What data does DomainStats currently have?

Domainstats is crawling the home page and the internal pages linked from the home page of most of the important domains names on the internet (around 6 million domains right now). SEO metrics has been collected for around 1,5 million of those (mainly .se och .nu). At the moment around 550 million dofollow backlinks has been saved.

Credentials

You are not logged in. You can test the api with the secret_token test. Register a free account on this page to raise your limits.

Limits and costs (beta)

When using the test secret_token the limit is currently 10 units per hour, 100 units per hour using another free valid secret_token and 500 units per hour using a paid secret_token.

Only the paid API secret_token can request domain details for a .se domain or a .nu domain that is scheduled to expire.

Calls which don't return data costs 1 unit.

Don't make make more than 5 calls per second.

You are not allowed to use several accounts/API keys at the same time.

The paid secret_token costs 2900 USD per year during the beta, contact us.

Attribution

Please give correct attribution if you publicly display numbers from this API.

The domain_lookup call

Example: http://api.domainstats.io/seo-guide.se?secret_token=test

Cost: 1 unit.

Displays all data collected for a domain.

Few notes:

domain_marked_as_adultValue of true means that the site probably has xxx. Value false means either no data or that it could be free from xxx.
domain_countryFor .se domains this will display se for Sweden. For generic top level domains such as .nu or .com DomainStats will determine the country based on factors such as country of the IP of the website, language of the website and country information from Alexa. If there are insufficcient data to determine the country false will be returned.
ip_blacklists_times_listedGo to http://domainstats.io/seo-guide.se to see which blacklists is being checked.
crawl_time_to_fetchThe time in seconds it took to retrieve the home page from Germany including following any redirects.
homepage_linking_to_domainsTo save database space the following often linked domains are not included: facebook.com, twitter.com, youtube.com, plus.google.com, instagram.com, linkedin.com and wordpress.org
homepage_urlThe most linked to URL of the home page based on top pages data from Ahrefs. With or without the subdomain www and with or without the https protocol. Might not be what is currently used as homepage URL for the website.
alexa_countryWe save the country with the most % of the page views.
twitter_homepageOn the 2015-11-20 Twitter removed the ability to retrive the share count (Info here). This field name has thereafter been replaced with google_plus_homepage instead for any collections after 2015-11-20.
urlblacklistdotcom_blacklistedThe only categories we care about from this list are the following: adult, aggressive, drugs, malware, porn, spyware, violence, virusinfected. Other categories are ignored.
domain_idFor internal use.

DomainStats cannot calculate the homepage_url without top pages data from Ahrefs and without homepage_url DomainStats cannot fetch data from Moz, Majestic, PageRank and so forth.

The following field names are all based on the homepage_url:
moz_page_authority, majestic_citationflow, pagerank_of_homepage, domainstats_number_of_spam_flags, twitter_homepage, google_plus_homepage and google_safe_browsing_not_safe.

Please note that the first SEO metric being collected is the Domain Rating from Ahrefs. If that number is very low then the domain is considered not to have any important backlinks and no further SEO metrics will be collected.

If you request domain data for a domain that is not currently in the database it will cost 1 unit and you will get an error saying that the domain is new and data will be collected. After 30 minutes or so there will be crawl data and some other data about the domain when you request it again (it will cost 1 unit again). Note that currently there is no collecting of SEO metrics for new domains.

The links_to call

Example: http://api.domainstats.io/links_to/charity.todaysweb.se?secret_token=test

Cost: 5 units or 1 if no links are found.

Displays external dofollow links with related data to specified domain name. Currently limited to the first 1000 and maximum 3 from each domain. Grouped by url_to.

The links_from call

Example: http://api.domainstats.io/links_from/charity.todaysweb.se?secret_token=test

Cost: 3 units or 1 if no links are found.

Displays external dofollow links with crawl data from specified domain name. Grouped by url_from.

The ip_lookup call

Example: http://api.domainstats.io/178.236.76.54?secret_token=test

Cost: 1 unit.

Displays data about the IP if existing and a list of domains using that IP. The date on the domain signifies when the IP was checked.

For ip_blacklists_times_listed it means the blacklists that are listed here: http://domainstats.io/178.236.76.54.

The analytics_id_lookup call

Example: http://api.domainstats.io/UA-17773035?secret_token=test

Cost: 1 unit.

Displays a list of domains using the specified analytics id. The date on the domain signifies the time of crawl.

The adsense_id_lookup call

Example: http://api.domainstats.io/pub-7401609936942992?secret_token=test

Cost: 1 unit.

Displays a list of domains using the specified adsense id. The date on the domain signifies the time of crawl.

Additional field name information

All field names ending with *_time_checked will always be displayed and either display a date or false if the data has not been checked.

All dates are displayed as YYYY-MM-DD according to the international date standard (ISO 8601) and using the timezone UTC 0.

All URLs are URL encoded.

If you see the http code 998 in this API it means "blocked by robots.txt".

Public usage of this API

Some examples:

Contact info

Contact us on this page.

Copyright

DomainStats and DomainStats API was built by Jim Westergren and is owned by and © TodaysWeb Ltda.