v4.9.0.1 – 22nd October 2019

Bug fixes: On the Crawler Results page, when exporting results to CSV, the Domain Keyword filter was being ignored. This has now been resolved.

Backend – 6th October 2019

Enhancement: Updated domain availability configuration, providing better support for Czechoslovak TLD (.CZ domains).

v4.9.0.0 – 3rd October 2019

New feature: The Bulk Keyword Search feature was added, allowing users to add hundreds of keywords to be crawled in one batch. See the introduction video on YouTube. The Bulk Keyword Search – easily add hundreds of keywords, mix-and-match your search location and year, and create crawl jobs en...
Domains supported by the Expired Domain Crawler

Domains supported by the Expired Domain Crawler

A vital step of the process when crawling for expired domains, is validating domain availability, so I can be 100% certain that it’s available right now for hand-registration with any domain registrar. See the the complete list of 1200+ domains supported by the domain crawler below. Last updated: 17th January 2017. Supported Domains: Domains with the following TLDs are supported: .abbvie .abogado .abudhabi .ac .ac.cn .ac.il .ac.in .ac.jp .ac.nz .ac.th .ac.uk .academy .accountants .aco .active .actor .ad .adac .adm.br .ads .adult .adv.br .ae .aeg .aero .af .afl .ag .agakhan .agency .agro.pl .ah.cn .aid.pl .airbus .airforce .airtel .akdn .allfinanz .ally .alsace .alstom .am .am.br .amsterdam .android .anquan .anz .apartments .app .apple .aq .aquarelle .archi .army .arpa .arq.br .art .art.br .arte .arts.ro .as .asia .asso.fr .asso.mc .associates .at .atm.pl .attorney .au .auction .audi .audio .auto .auto.pl .autos .avianca .aw .baidu .band .bank .bar .barcelona .barclaycard .barefoot .bargains .bauhaus .bbc .bbs.tr .bbva .bcg .bcn .be .beats .beer .bentley .berlin .best .bet .bg .bi .bid .bike .bingo .bio .bio.br .biz .biz.fj .biz.pl .biz.tt .bj .bj.cn .black .blackfriday .blanco .blog .blue .bms .bn .bnl .bnpparibas .boats .boehringer .bom .bond .boo .boots .bosch .bostik .boutique .br .br.com .broker .brother .brussels .bugatti .build .builders .business .buy .buzz .bw .by .bz .bzh .ca .cab .cafe .cal .cam .camera .camp .cancerresearch .canon .capetown .capital .car .cards .care .career .careers .cars .casa .cash .casino .cat .catering .cba .cc .cd .ceb .center .ceo .cern .cf .cfa .cfd .cg .ch .chanel .channel .chat .cheap .chintai .christmas .chrome .church .ci .cipriani .city .cityeats .cl .claims .cleaning .click .clinic .clinique .clothing .cloud .club .clubmed .cm .cn .cn.com .cng.br .cnt.br .co .co.ac .co.com .co.gy .co.il .co.in .co.lc...
4 Things to Avoid as You Crawl for Expired Domains

4 Things to Avoid as You Crawl for Expired Domains

This post highlights some of the pitfalls you can run into while crawling for domains, whether you’re using PBN Lab’s expired domain crawler, or any other domain crawler out there.   Domain crawling is easy…right? “Isn’t there a magic list of sites out there I can crawl, that will just land me hundreds of amazing expired domains?” Sadly, no. Thankfully nobody has actually asked me that question at all, but I’m sure everyone is hoping that’s the case. If there is a magic list, I’d love to know about it! Using the keyword search built in to PBN Lab, you’ll find that crawling seems almost too easy to start with. You simply throw in keyword or two, and wollah! You’ve got a hundred expired domains in your list, and you excitedly analyze each and every one of them. And more than likely amongst the list there are 1 or 2 keepers. But unfortunately the initial buzz of easily finding your very own expired domains can quickly wear off – if you don’t continue to see great results from your crawls. And where I see most people go wrong is that they’re not crawling in a systematic fashion, and it can easily lead you down the path of constantly crawling the same sites, or the same network of sites. This results in finding “more of the same” types of domains, with very similar metrics. Or worse still, you’ll keep getting duplicate domains. FYI: PBN Lab’s expired domain crawler will determine that you’ve already discovered an expired domain, and will flag it as a duplicate. This means you can quickly avoid wasting time and energy, simply by filtering duplicate domains...