https://www.deepcrawl.com/blog/best-practice/noindex-disallow-nofollow/
In October 2019, Google announced a new policy.
You need to include noindex in the meta tags of login, admin, profile, member/home. That way, you won't be exposed to search engines.
<meta name="robots" content="noindex">
Be especially careful with private areas, private pages, and admin pages.
robot.txt google project
https://github.com/google/robotstxt