Hello,
I put my site online and the google robots put this error on YOUR site : ERROR 5XXX
I obviously allowed the google robot to index my site via Wordpresss and Yoast.
I also put a robots text file like this :
This reply has been marked as private.
Well these 500 error are coming from units .
You do not want the units to allow for indexing on google as they contain paid content , therefore we do not allow access to it if you are not a student .
You need to remove unit from xml mapping to resolve this .
I would still like google index these pages. How I can do that ?
I put in my unit, google can index these page.
Thank you.
IF you want this then all units will be available for student to see for free . ARe you ok with that?
No I don't want the student see it for free. But I want google see this like a normal page.
How I can do that ?
Well that wont be possible right now .
So, when will it be possible?
Thank you
Well in order to do this you will need to allow access to all to your units .
Only then bots will brawl the page .
You have to expose the unit content/
I will not do this, I will either remove it from the sitemap or find a solution.
if you can get google to read the title and be able to index the page without seeing the content would be great.
Thank you.
We can restrict the content on the unit pages , but the user will see the some part of the content .The excerpt part we can show to visitors and user which are not logged in .
But I will still strongly recommend not to index the the units for the overall seo of the site and remove the unit post type from sitemap xml .