# AI Crawler & Agent Directives User-agent: * Allow: / Crawl-delay: 1 # Site Index for AI Models & Search Agents Sitemap: https://sidharthsteel.com/sitemap.xml Knowledge-Base: https://sidharthsteel.com/llms.txt Full-Knowledge-Base: https://sidharthsteel.com/llms-full.txt