URL Is Not On Google | HTTP 403 Forbidden Topic is solved

Discuss Search Engine Optimization in relation to Joomla! 3.x. This forum will also have discussions on SEF/SEO Joomla! 3.x extensions.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Windows Defender SmartScreen Issues <-- please read this if using Windows 10.
Post Reply
88joomlaforum
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Mon Aug 13, 2018 1:52 am

URL Is Not On Google | HTTP 403 Forbidden

Post by 88joomlaforum » Sat Aug 29, 2020 12:41 pm

hi, good day.
Our website is https://www.pinnacle-travel.com/

Our website has 125 main pages URLs (exclude sub-sub pages).
Out of 125 URLs, 99 are indexed but 26 are "URL Is Not On Google" as reported in Google Search Console - Coverage - URL inspection. (attached Excel file)

2 Examples of "URL Is Not On Google":
https://www.pinnacle-travel.com/holiday ... es/turkey/
https://www.pinnacle-travel.com/golf-packages/

2 Examples of Indexed URL:
https://www.pinnacle-travel.com/holiday ... es/croatia
https://www.pinnacle-travel.com/golf-pa ... pe/ireland

We resubmitted revised sitemap (attached XML file), the status is "success" with 527 discovered URLs.
We have read the Coverage guidelines and articles in Google Search Console including the crawl, excluded, duplicate and so forth but could not found any significant advice on how to solve the issue.
We searched and followed what is taught online, in FTP we changed the permission to 755 for directories and 644 for files.
We further checked in details our Joomla articles to make sure the settings, permissions, options and so forth are identical comparing the indexed pages and the not-on-google pages.
None of the above solve our 26 URLs the "URL Is Not On Google" issue.

We posted for help in Google Site Product/Webmasters Help Community, a good man advised the issue is caused by 403 Forbidden Header Response. He used an extension that check
http://tools.seobook.com/server-header- ... rotocol=11
He advised the pages can seem to load normally and viewing well, but with the 403 response Googlebot will not complete the crawling until the 403 response is fixed and the pages return a 200 found response.

We sincerely seek your help to kindly advise us, how to solve the "URL is not on Google" for our 26 URLs?
Your kind assistance will be greatly appreciated and remembered.
Thank you very much.

[ redacted ]
You do not have the required permissions to view the files attached to this post.
Last edited by toivo on Sat Aug 29, 2020 2:20 pm, edited 1 time in total.
Reason: mod note: manual signature removed, please observe the forum rules!

mohit9953
Joomla! Apprentice
Joomla! Apprentice
Posts: 19
Joined: Sun Apr 26, 2020 9:52 am

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by mohit9953 » Sun Aug 30, 2020 1:30 pm

Hey.. Try submitting these non indexed URL's manually on google search console. If the index coverage status "URL is unknown to Google" appears, it means that Google hasn't indexed the URL either because it hasn't seen the URL before, or because it has found it as a properly marked alternate page, but it can't be crawled..Wait for 3 or 4 days after manual submission and post me here is the same problem persists. Will be happy to help.

88joomlaforum
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Mon Aug 13, 2018 1:52 am

URL Is Not On Google | HTTP 403 Forbidden

Post by 88joomlaforum » Tue Sep 01, 2020 1:11 pm

hi, thanks for your reply.
as advised, we submitted one by one in Google Search Console, out of the 125 URLs, 99 are indexed and 26 are "URL Is Not On Google"
it's not the matter of we can wait for 3 or 4 days, it is this problem has already been months regardless how many times had tried.
the most concern here is not whether the 26 pages are indexed, the key issue here is these pages cannot appear on Google search at all.
do you have any idea how to solve the HTTP 403 Forbidden issue in Joomla?
Thanks!
Ms Cass

User avatar
Per Yngve Berg
Joomla! Master
Joomla! Master
Posts: 27205
Joined: Mon Oct 27, 2008 9:27 pm
Location: Romerike, Norway

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by Per Yngve Berg » Tue Sep 01, 2020 3:01 pm

Why do the URLs that does not show in Google have a trailing slash?

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1672
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by darb » Wed Sep 02, 2020 11:27 am

With this requirements of site I would prefer to use Jsitemap and make the Google submission professionally by Jsitemap. Then you have better control and functions there https://extensions.joomla.org/extension/jsitemap/

88joomlaforum
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Mon Aug 13, 2018 1:52 am

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by 88joomlaforum » Wed Sep 02, 2020 1:27 pm

Per Yngve Berg wrote:
Tue Sep 01, 2020 3:01 pm
Why do the URLs that does not show in Google have a trailing slash?
Dear #Per Yngve Berg, you are brilliant!
I didn't realised that where it's so obvious.
We are working on it and will update whether the issue can solve.
Thank you so much.
[ redacted ]
Last edited by toivo on Fri Sep 04, 2020 1:18 pm, edited 1 time in total.
Reason: mod note: manual signature not allowed - forum rules available from https://forum.joomla.org/viewtopic.php?f=8&t=65

88joomlaforum
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Mon Aug 13, 2018 1:52 am

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by 88joomlaforum » Wed Sep 02, 2020 1:30 pm

darb wrote:
Wed Sep 02, 2020 11:27 am
With this requirements of site I would prefer to use Jsitemap and make the Google submission professionally by Jsitemap. Then you have better control and functions there https://extensions.joomla.org/extension/jsitemap/
Thank you #darb for your advice.
After we settled the trailing slash, will do new sitemap as per your advice.
[ redacted ]
Last edited by toivo on Fri Sep 04, 2020 1:23 pm, edited 1 time in total.
Reason: mod note: manual signature not allowed - forum rules available from https://forum.joomla.org/viewtopic.php?f=8&t=65

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1672
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by darb » Thu Sep 03, 2020 1:47 pm

88joomlaforum wrote:
Wed Sep 02, 2020 1:30 pm
darb wrote:
Wed Sep 02, 2020 11:27 am
With this requirements of site I would prefer to use Jsitemap and make the Google submission professionally by Jsitemap. Then you have better control and functions there https://extensions.joomla.org/extension/jsitemap/
Thank you #darb for your advice.
After we settled the trailing slash, will do new sitemap as per your advice.
[ redacted ]
Best of luck!
Last edited by imanickam on Sat Sep 05, 2020 6:14 am, edited 1 time in total.
Reason: Removed the manual signature in the Quoted text

88joomlaforum
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Mon Aug 13, 2018 1:52 am

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by 88joomlaforum » Tue Sep 22, 2020 1:24 pm

hi #Per Yngve Berg,
I'm back with good news!

At first we changed whole website URLs to "with trailing slash" but it didn't work. Then we changed all the URLs to "without trailing slash" and it works! The previous 26 URLs with issue "Not on Google", 24 are solved submitted and indexed except for below 2 URLs cannot be indexed, we are still checking what is the problem.
https://www.pinnacle-travel.com/golf-packages
https://www.pinnacle-travel.com/holiday ... es/myanmar

In the change progress, we discovered URL with # also cannot be indexed. We have these 9 URLs with # and still trying to solve the problem
https://www.pinnacle-travel.com/golf-packages#africa
https://www.pinnacle-travel.com/golf-packages#europe
https://www.pinnacle-travel.com/golf-packages#indochina
https://www.pinnacle-travel.com/golf-packages#northasia
https://www.pinnacle-travel.com/golf-pa ... theastasia
https://www.pinnacle-travel.com/golf-pa ... thwestasia
https://www.pinnacle-travel.com/holiday ... by-country
https://www.pinnacle-travel.com/holiday ... p-duration
https://www.pinnacle-travel.com/holiday ... p-interest

I would like to thank you sincerely for your advice, we truly appreciated the "Not On Google" issue are solved with your help.
Many big thanks and stay well.
Cass

88joomlaforum
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Mon Aug 13, 2018 1:52 am

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by 88joomlaforum » Tue Sep 22, 2020 1:26 pm

hi #darb,
we have purchased and installed Jsitemap. this is really good especially for SEO. once again, thank you for your advice. stay well.
Cass

Surovi879
Joomla! Fledgling
Joomla! Fledgling
Posts: 1
Joined: Sun Sep 27, 2020 8:06 am

Re: URL Is Not On Google | HTTP 403 Forbidden

Post by Surovi879 » Sun Sep 27, 2020 8:56 pm

Try Try! Sometimes, URLs are not shown in google. You can either wait or try to make the URL visible for Google.


Post Reply

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 3.x”