How to exclude or remove traffic from semalt.com in Google Analytics using a simple filter
Many web analytics peeps will be seeing a strange referrer at the top of Google Analytics reports for their sites.
Semalt.com is a piece of software that tracks a sites position in search engines and it works by sending out a crawler to your site to gather information about your site and its pages.
These crawlers are then being logged as referral traffic in Google Analytics which is not a nice thing to happen. It’s not how other software providers do things – some say it’s a clever marketing stunt in order to get the attention of web masters.
The quickest way of excluding this traffic from semalt.com is by creating a custom filter in Google Analytics and I’ve produced a short video below to help you set it up.
SEE UPDATE BELOW THE VIDEO FOR MORE INFO
UPDATE (14th August 2014)
Many people have left comments stating they are now seeing the following in their referral reports:
Now, since applying the above filter in the video I haven’t seen these domains or referrals in my reports – I might just have been lucky. So I can’t really advise how to exclude it as the first method has worked for me.
Maybe someone who had done so can leave a comment below.
Automatically Exclude Known Bots in Google Analytics
It’s also worth remembering that Google Analytics has now introduced a new feature in the settings area where you can automatically filter out known bots.
Hopefully Google Analytics has introduced this to remove the likes of Semalt and See Your Website (another site similar to Semalt) from Google Analytics data.
Digital Marketing Consultant (Freelance) specialising in the Construction sector. I help marketing departments set objectives, discover goals, set KPI's, plan and develop campaigns to exceed set objectives.
I also provide training on Digital Marketing Strategy Planning and Google Analytics.
Marcy
March 31, 2014, 4:03 pm
Does excluding semalt\.com also exclude referrals from semalt.crawler?
Thank you for your video and sharing your knowledge on semalt, helped a lot
Pritesh Patel
April 1, 2014, 8:07 pm
Hi Marcy
I’ve not come across semalt.crawler but I guess if it’s showing up in your referral report then yes, you can use the same method.
Russ
April 1, 2014, 8:38 pm
You’ve made it more complicated than need be. It isn’t necessary to setup a custom filter. A standard filter works fine.
New filter / fill in filter name / enter semalt.com in the From ISP Domain box / click save.
Pritesh Patel
April 2, 2014, 9:32 am
Hi Russ,
Thanks for sharing that method also. Agree, neither are really that laborious though.
Graeme Benge
April 2, 2014, 9:30 am
Hi both
I’ve started to see crawler.semalt.com making an appearance. Have been using an segment to get rid of it from historic data. Not hit a sampling snag yet but time will tell! Here’s the segment:
https://www.google.com/analytics/web/template?uid=ytFXneUrTp2qc4dBErmk8Q
Pritesh Patel
April 2, 2014, 9:33 am
Yes, another comment left earlier mentioned crawler.semalt.com.
Wish they’d just stop it and sending out messages asking owners to submit their sites to an exclusion list. Annoying.
Thanks for sharing the segment Graeme.
Marcy
April 2, 2014, 3:29 pm
So I need to set up an additional filter for semalt.crawler?
Yeah this site is annoying, would be nice if it would go away!
Pritesh Patel
April 7, 2014, 10:15 am
I’ve not come across this crawler since adding the above so unable to tell. Sorry. Worth a try (or any of the other methods).
Yvonne
April 11, 2014, 2:44 pm
Thanks for the helpful video, Pritesh! I was wondering if this works as a sort of “base” filter for when I use my custom segments? In other words, when I’m looking at my Audience Overview and use a segment, will it already have filtered out the semalt referrals?
Pritesh Patel
April 11, 2014, 2:55 pm
Thanks for the comment Yvonne.
This filter will exclude the data from Google Analytics from the date you set it up. So if you set it up today and viewed the data for the last 30 days then you’d still see Semalt in your reports.
However, you could apply an advanced segment to remove semalt from the last 30 days BUT in 30 days time you won’t need to use the segment anymore.
So in other words – a segment will remove it from the data. A filter will exclude the traffic from being logged and reduce the need to keep applying the segment each time you run reports.
I really hope this helps and answers your question. If not please do tell me. Happy to help.
Bette Bennett
April 14, 2014, 7:02 pm
Thanks for sharing! Very helpful, was wondering where this was coming from and what it was, thanks again for sharing.
Lora
April 20, 2014, 12:20 am
I thought the emphasis of the semalt.semalt website was to help people get more referrals to their website from different countries rather than being seen locally.
John
April 20, 2014, 1:46 pm
Semalt is now using semalt.semalt.com first noticed on my site 17/04/2014
Pritesh Patel
April 20, 2014, 7:55 pm
Thanks for the heads up! I’m not seeing anything from semalt anymore. Wonder if it’s possible to set up an alert in Google Analytics to let you know when traffic from any referrer with the word ‘semalt’ is greater than 1? May well be worth a try.
Teresa Acosta
April 25, 2014, 2:23 am
I posted this link on my twitter account and Alex from Semalt.com ( https://twitter.com/AlexAndrianov1) replied to me saying, “@AcostaAgency Dear Teresa, you can easily remove your site from our database: http://bit.ly/1fvTnty … Since I already had followed your filter suggestions and this looked like signing up to be removed (??) … I was a bit confused anyway. But I’m posting it here for anyone interested.
Poco
April 25, 2014, 3:19 pm
I’m also noticing referrer traffic from semalt.semalt.com after I put an .htaccess block on semalt.com. When will they stop?!
Sanne
April 29, 2014, 3:05 pm
Thank you Pritesh and thank you Graeme for the segment.
Shae McKean
May 3, 2014, 4:22 pm
Thank you so much! Started to see this appear and when I was going to check it out my antivirus lit up my screen and told me not to visit. Then once I saw what it was that was skewing my results wanted it out. Appreciate your help!
Shae McKean
May 3, 2014, 4:25 pm
The .htaccess exclusion doesn’t work any longer. Unless you exlude by IP addy.
karen
May 5, 2014, 10:10 am
I am in the first month of using Google analytics and have already experienced traffic from semalt.semalt.com, so am grateful to have found your video and advice. I have also experienced referral traffic from uk.wow.com and talk talk.co.uk. Is this similar to semalt? Should I filter these too?
Pritesh Patel
May 7, 2014, 7:25 am
I think they’re smaller search engines in their own right. Talk talk is a network operator so new customers will see a talk talk homescreen on starting up a browser and then doing a search from there.
Tracy
May 6, 2014, 3:55 pm
Thank you!!!! bookmarked you! You give clear and easy to follow instructions. Thank you!
Pritesh Patel
May 7, 2014, 7:24 am
Thanks Tracy!
Kristen
May 8, 2014, 10:50 am
In the last two days I have also had semalt.semalt.com show up. I have followed your instructions above and then added an additional filter, but it just showed up again today. I don’t think I feel comfortable contacting them to remove my site from their database. Any advice?
Pritesh Patel
May 16, 2014, 6:30 pm
Unfortunately I’ve not had semalt.semalt.com show up since adding the filter in my video so can’t really advise – I wonder if anyone else who has left a comment can help?
Dan
May 11, 2014, 5:49 am
Ha! So easy! I was going to get into the access or php file, as so many others have said, but this seemed easier. So we’ll see if i have rid myself of those fellas.
Thanks.
I’ll have to keep this place book marked.
lizzie
May 13, 2014, 8:44 am
Thanks for the clear advice. Had never used admin before on anallytics!!
Jon
May 19, 2014, 7:32 am
Here’s their removal page. I added my sites and no more semalt in my analtyics http://semalt.com/project_crawler.php
Pritesh Patel
May 20, 2014, 3:13 pm
Thanks Jon.
Armans Bimatovs
May 22, 2014, 6:01 pm
At first I saw Semalt, and I got all excited because I saw a large number of new users. But thanks for the how-to!
Leila Mortaz
May 25, 2014, 6:03 am
Hi Pritesh,
Thanks for your helpful video. I created “referral” filter as your video suggested but then realized that our Google Analytics is showing the referral traffic coming from “semalt.semalt.com”!
Wouldn’t it be safer then to set up a domain level filter to block everything? I think someone suggested it as well. I am thinking it would eliminate the guess work since they could create another referral name which would defeat the referral filter.
What do you think?
Pritesh Patel
May 26, 2014, 2:49 pm
Hi Leila
You’re quite right. Unfortunately my video walkthrough was produced when only semalt.com was used, I guess they then used other alternatives. Since creating the one in the video I haven’t seen semalt.semalt.com in any of the sites I manage hence can’t say what method would be most appropriate but setting it at domain level makes a lot of sense.
Virginia
May 31, 2014, 11:43 pm
Great info, thank you
Martin Oxby
June 4, 2014, 10:33 am
Definitely useful – we get questions about this and are keeping our eyes on the filters for this. They refuse to change the classification of the traffic and instead insist on harvesting domains. They should classify their crawler as a bot, just like Google or Bing and then it only hits server logs and obeys robots.txt declarations.
If they’d done it right in the first place, they might not have had half as much backlash and negative publicity.
Thanks for sharing.
Alison Higgins
June 5, 2014, 3:26 pm
Hi..When I click on ‘Filters’ I dont have an ‘Add Filter’ button. I just have 3 columns where i cant seem to type anything into.
Any ideas? Thanks
Pritesh Patel
June 13, 2014, 6:32 am
Are you sure you have Admin access to the account/profile?
Soph
June 7, 2014, 6:58 am
Thank you for that quick how-to video. Super simple and easy to follow.
Paul
June 8, 2014, 10:26 am
Thanks very much, Pritesh. That’s very helpful
joey bolohan
June 16, 2014, 6:31 am
Here you can be taken off the list of bots that hit your site.
http://semalt.com/project_crawler.php
Enter you site name / names to be removed from there list.
Pritesh Patel
June 17, 2014, 11:03 am
Cheers Joey!
Ellie Hurst
June 30, 2014, 10:36 am
Thanks, Pritesh. This was helpful.
Pritesh Patel
July 1, 2014, 9:31 am
No problem Ellie. Hope all is well.
Kerry lucasse
July 8, 2014, 3:40 pm
Thanks so much for all the tips! My site has been hit with semalt, semalt.semalt and semalt.crawler within weeks of launching the site, so it’s incredibly frustrating. I’ve requested that my site be removed from their crawler 2x and it will stop for about a week and start over again.
I’m very concerned about the bounce rate on my new site and I Hope this isn’t a silly question, but if we remove semalt from our google analytics reports, will google still factor in the high bounce rate when ranking a site?
Sergey Nesterov
July 9, 2014, 6:58 pm
Thank you very much! Simple and clear explanation!!! Just created those filters and looking forward to see it clean of crowlers.
J.T.
July 11, 2014, 1:27 pm
Thanks for this. Tired of constantly seeing this in my analytics.
Peter
August 12, 2014, 11:00 pm
Thanks, that’s great. I have stopped semalt.com and semalt.semalt.com. I also get variations with a prefix number from 1 to 100 i.e. 4.semalt.com, 29.semalt.com, 81.semalt.com etc. Can I create a general filter that will block any word or number ??.semalt.com or do I need to enter all of them as individual filters 1.semalt.com, 2.semalt.com, 3.semalt.com etc.
Pritesh Patel
August 14, 2014, 8:26 pm
Hi Peter,
I have updated the post above, you could try ticking the box in the settings to exclude known bots. This is a new feature in Google Analytics.
Let me know if this worked.
Laurean Vincent
August 16, 2014, 8:10 pm
Hey Pritesh,
Thanks for sharing! I did both, so hopefully this works… It may be helpful to add where exactly to find this setting. It’s not in the filter section, it’s over in:
Account > Property > View > View Settings (near the bottom under your currency setting).
Again, this is for going forward only. For look-back and report clean up, may be a different story!
Robert Baer, Manager Oil 4 Less LLC
September 12, 2014, 3:10 am
The info given SOUNDS useful, BUT……
….you will hate this, but….
This is NOT a solution.
So, the _reports_ do not show any semalt garbage.
However, be advised, nobody has said that semalts faked referrals themselves are suppressed.
The king still has no clothes.
Robert Baer, Manager Oil 4 Less LLC
September 12, 2014, 9:08 pm
So, this trick makes the naked king (semalt) invisible to GA, but he still has no clothes.
What is needed, is a way to either make him civilized (put clothes on him, ie: be honest and forthright), OR banish him.
Nataliya
March 3, 2015, 8:30 am
If our bots bother you, please, use Semalt Crawler to remove your site from the list of web resources we visit. Please, make sure you have specified the subdomains of your sites as well. http:// is required. You can add the list of your sites into Semalt Crawler – each in a new line.
http://semalt.com/project_crawler.php
steve
March 4, 2015, 10:45 am
But . . . if you dig into Seamalt you’ll find amongst other features it’s a paid competitor analysis tool i.e. it’s recording and reporting your search terms and useage statistics to your competition.
Their removal tool sates that domain extensions (e.g. yoursite.com/product36) are treated as separate sites so unrealistic to block it for all but the smallest of sites.
Only solution I know of to fix would be to run your site through a firewall from the likes of Securi or similar.