last data update: 2011/10/20, 10:06

Website loading time

during the test: 0.59 s

cable connection (average): 0.6 s

DSL connection (average): 0.62 s

modem (average): 1.29 s

HTTP headers

Information about DNS servers

scrapy.orgA190.0.137.206IN3600
scrapy.orgMX10ASPMX.L.GOOGLE.comIN3600
scrapy.orgMX20ALT1.ASPMX.L.GOOGLE.comIN3600
scrapy.orgMX20ALT2.ASPMX.L.GOOGLE.comIN3600
scrapy.orgMX30ASPMX2.GOOGLEMAIL.comIN3600
scrapy.orgMX30ASPMX3.GOOGLEMAIL.comIN3600
scrapy.orgMX30ASPMX4.GOOGLEMAIL.comIN3600
scrapy.orgMX30ASPMX5.GOOGLEMAIL.comIN3600
scrapy.orgTXTgoogle-site-verification=1lGiEBhe_DZHEjWMHHZVKWwyhRZAoQxdpg-BOxQl_xkArrayIN43200
scrapy.orgSOAns1.insophia.comhostmaster.insophia.com201109160110800 3600 604800 3600 IN 43200
scrapy.orgNSns2.insophia.comIN43200
scrapy.orgNSns1.insophia.comIN43200

Received from the first DNS server

Request to the server "scrapy.org"
You used the following DNS server:
DNS Name: ns2.insophia.com
DNS Server Address: 72.14.189.143#53
DNS server aliases:

HEADER opcode: REQUEST, status: NOERROR, id: 44617
flag: qr aa rd ra REQUEST: 1, ANSWER: 12, AUTHORITY: 0, ADDITIONAL: 3

REQUEST SECTION:
scrapy.org. IN ANY

ANSWER SECTION:
scrapy.org. 86400 IN SOA ns1.insophia.com. hostmaster.insophia.com. 2011091601 10800 3600 604800 3600
scrapy.org. 3600 IN A 190.0.137.206
scrapy.org. 3600 IN MX 20 ALT2.ASPMX.L.GOOGLE.com.
scrapy.org. 3600 IN MX 30 ASPMX2.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 30 ASPMX3.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 30 ASPMX4.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 30 ASPMX5.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 10 ASPMX.L.GOOGLE.com.
scrapy.org. 3600 IN MX 20 ALT1.ASPMX.L.GOOGLE.com.
scrapy.org. 86400 IN TXT "google-site-verification=1lGiEBhe_DZHEjWMHHZVKWwyhRZAoQxdpg-BOxQl_xk"
scrapy.org. 86400 IN NS ns2.insophia.com.
scrapy.org. 86400 IN NS ns1.insophia.com.

SECTION NOTES:
ALT1.ASPMX.L.GOOGLE.com. 35 IN A 74.125.113.27
ns1.insophia.com. 3600 IN A 190.0.137.196
ns2.insophia.com. 3600 IN A 72.14.189.143

Received 444 bytes from address 72.14.189.143#53 in 45 ms

Received from the second DNS server

Request to the server "scrapy.org"
You used the following DNS server:
DNS Name: ns1.insophia.com
DNS Server Address: 190.0.137.196#53
DNS server aliases:

HEADER opcode: REQUEST, status: NOERROR, id: 35247
flag: qr aa rd ra REQUEST: 1, ANSWER: 12, AUTHORITY: 0, ADDITIONAL: 5

REQUEST SECTION:
scrapy.org. IN ANY

ANSWER SECTION:
scrapy.org. 86400 IN SOA ns1.insophia.com. hostmaster.insophia.com. 2011091601 10800 3600 604800 3600
scrapy.org. 86400 IN NS ns2.insophia.com.
scrapy.org. 86400 IN NS ns1.insophia.com.
scrapy.org. 86400 IN TXT "google-site-verification=1lGiEBhe_DZHEjWMHHZVKWwyhRZAoQxdpg-BOxQl_xk"
scrapy.org. 3600 IN MX 20 ALT2.ASPMX.L.GOOGLE.com.
scrapy.org. 3600 IN MX 30 ASPMX2.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 30 ASPMX3.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 30 ASPMX4.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 30 ASPMX5.GOOGLEMAIL.com.
scrapy.org. 3600 IN MX 10 ASPMX.L.GOOGLE.com.
scrapy.org. 3600 IN MX 20 ALT1.ASPMX.L.GOOGLE.com.
scrapy.org. 3600 IN A 190.0.137.206

SECTION NOTES:
ns1.insophia.com. 3600 IN A 190.0.137.196
ns2.insophia.com. 3600 IN A 72.14.189.143
ASPMX2.GOOGLEMAIL.com. 2454 IN A 74.125.43.27
ASPMX3.GOOGLEMAIL.com. 354 IN A 74.125.127.27
ASPMX4.GOOGLEMAIL.com. 2454 IN A 209.85.229.27

Received 476 bytes from address 190.0.137.196#53 in 200 ms

Subdomains (the first 50)

Typos (misspells)

acrapy.org
zcrapy.org
xcrapy.org
dcrapy.org
ecrapy.org
wcrapy.org
sxrapy.org
svrapy.org
sfrapy.org
sdrapy.org
sceapy.org
scdapy.org
scfapy.org
sctapy.org
sc5apy.org
sc4apy.org
scrzpy.org
scrspy.org
scrwpy.org
scrqpy.org
scraoy.org
scraly.org
scra-y.org
scra0y.org
scrapt.org
scrapg.org
scraph.org
scrapu.org
scrap7.org
scrap6.org
crapy.org
srapy.org
scapy.org
scrpy.org
scray.org
scrap.org
csrapy.org
srcapy.org
scarpy.org
scrpay.org
scrayp.org
sscrapy.org
sccrapy.org
scrrapy.org
scraapy.org
scrappy.org
scrapyy.org

Location

IP: 190.0.137.206

continent: SA, country: Uruguay (URY), city: Montevideo

Website value

rank in the traffic statistics:

There is not enough data to estimate website value.

Basic information

website build using CSS

code weight: 4.92 KB

text per all code ratio: 45 %

title: Scrapy | An open source web scraping framework for Python

description:

keywords:

encoding: utf-8

language: en

Website code analysis

one word phrases repeated minimum three times

PhraseQuantity
Scrapy24
to11
and9
in7
is6
the6
released!5
web4
used4
code3
crawl3
from3
data3
with3
of3
for3

two word phrases repeated minimum three times

PhraseQuantity
Scrapy is5

three word phrases repeated minimum three times

B tags

U tags

I tags

images

file namealternative text
Scrapy

headers

H1

H2

Welcome to Scrapy

H3

Welcome to Scrapy

H4

H5

H6

internal links

addressanchor text
Scrapy
Home
Download
Documentation
Blog
Community
Support
Donate
Scrapy Blog
Scrapy Snippets
See older news
very good code coverage
Scrapy at a glance
download Scrapy
Tutorial

external links

addressanchor text
Source code
moved to Github!
Insophia