Enter your website URL to start discovering accessible content.
Help visitors find the right pages and get answers from your website content, with source links they can verify. Answer quality and speed vary by AI model. Free to try. No credit card required.
Question 01
What is CrawlBrain? Is it a chatbot?
CrawlBrain is an AI search engine for websites, not a traditional chatbot. It combines relevant page results with direct answers from your indexed content, including source links visitors can check. Visitors can search, ask questions, and follow up within the same search experience.
As visitors type, CrawlBrain displays relevant pages. When they submit a question, it generates an AI answer from the indexed content and shows source links alongside the search results.
Semantic search helps connect a visitor’s wording to the information on your website. AI answers help visitors get that information directly, while source links let them check the details.
CrawlBrain combines page search and question answering in one search experience. You can use an existing search bar or choose another widget placement.
Semantic search
CrawlBrain uses semantic search to help visitors find relevant content when they use synonyms, make typos, change word forms, or leave out accents. For example, “cell phone” can match a smartphone page, and “cancion” can match “canción”. Visitors do not need to know the exact wording on your website.
Multilingual answers
Visitors can ask in their own language and receive answers based on your indexed content. For example, a question in Portuguese can receive a Portuguese answer using an English source page. The widget interface is available in 20 languages; this is separate from the language of AI answers.
Widget placement
Replace your existing search bar, place CrawlBrain alongside it, or use a floating widget. Choose the placement that fits your layout and how visitors already use your website.
Streaming answers
CrawlBrain displays answers progressively as they are generated. Visitors can begin reading while the rest of the response is still being written.
Keep searching
Visitors can continue the conversation with a follow-up question instead of repeating the original request. CrawlBrain uses conversation context to help connect the new question to what was asked before.
Starter questions
CrawlBrain can show suggested questions based on your website content before visitors type. These prompts give visitors a starting point and help them explore what they can ask.
AI model selection · Pro
Free uses Balanced. With Pro, choose Cost-optimized, Balanced, or Premium for each website. Your choice affects answer quality, speed, and credit usage. AI answers, semantic search, and indexing use credit on both plans.
Question 02
Can it make things up in front of my customers?
AI-generated answers can contain errors. CrawlBrain bases its answers on your indexed content and provides source links so visitors can check the original information. If it cannot find information to answer a question, it does not generate an answer.
Source links
CrawlBrain includes links to the pages used to generate an answer. Visitors can open the original content to check details, read conditions, and decide whether the answer meets their needs.
Your indexed content
CrawlBrain uses the content indexed for your website, including pages and any documents or snippets you add. This helps visitors get answers relevant to your products, services, and policies.
Content-based answers
If CrawlBrain cannot find information in your indexed content to answer a question, it does not generate an answer. This prevents it from generating a response when it has no information to support one.
When visitors ask about returns, shipping, or product details, they need information they can check. CrawlBrain finds relevant content in your website’s index and uses it to generate an answer with links to the source pages.
Visitors can open those links to read the original information and any conditions that apply. If CrawlBrain cannot find information to answer the question, it does not generate an answer. Keeping your indexed content accurate and up to date gives CrawlBrain a better basis for answering visitors’ questions.
Items can be returned within 30 days of purchase in their original condition. Refunds go back to the payment method you used.
Gifts can be returned without a receipt within 30 days. You receive store credit for the item's value. Bring the gift to any store or send it with the prepaid label.
Used in the answerAn answer visitors can check. CrawlBrain answers from your pages and links to the exact page it used.
What happens when CrawlBrain cannot find an answer?
If CrawlBrain cannot find information to answer a question, it does not generate an answer and records the question for review. You can use these unanswered questions to identify missing information and add content that helps future visitors.
Content gap analytics
CrawlBrain records unanswered questions and ranks them by frequency. See what visitors are asking, identify missing information, and decide which content to create or update first.
Add a short piece of information directly in CrawlBrain to make it available for AI answers. Custom snippets let you fill content gaps without publishing a new website page. You can also upload multiple snippets by CSV.
Weekly unanswered-question report · Pro
With Pro, receive a weekly email report of unanswered questions, ranked by frequency. Use it to prioritize content updates based on what visitors actually ask.
Unanswered questions show where visitors need information your indexed content does not yet provide. Review what they ask and how often, then prioritize the content that would help them most.
You can update an existing page or add a custom snippet in CrawlBrain without creating a new website page. With Pro, a weekly email report helps you keep track of unanswered questions.
Conversations, Unanswered tab. The questions your pages did not cover, with who asked and when.
Question 04
Can CrawlBrain index my website?
Yes, if your website’s content is publicly accessible and allows crawling. CrawlBrain discovers and indexes pages within your plan’s limits, with filters to control what is included. Daily sync checks for updates while sufficient credit is available.
Start with your website URL. CrawlBrain automatically identifies whether your site is an online store, blog, business website, documentation site, or knowledge base, and adapts its search accordingly. It discovers accessible pages, and you can choose which sections to include so visitors find the content that matters.
If a page cannot be indexed, review the available crawl details to investigate the problem. Daily sync checks for new or changed pages, helping keep the indexed information current without rebuilding the entire index.
Automatic crawling and indexing
Enter your website URL to start discovering and indexing accessible pages. You do not need to upload each page manually, making it easier to turn existing website content into searchable information.
Sitemap and link discovery
CrawlBrain uses your sitemap and website links to discover pages for indexing. This helps make content beyond your main navigation searchable, subject to accessibility, your filters, and your plan’s page limit.
JavaScript-aware indexing
CrawlBrain supports indexing content rendered by JavaScript, helping visitors find information that is not present in the initial page HTML. The content must remain accessible to the crawler.
Daily content sync
Daily sync checks for new or changed pages while sufficient credit is available. Indexing these pages uses credit; unchanged pages are not indexed again. This helps keep searchable content aligned with updates to your website.
Indexing filters
Include or exclude website sections by URL path. Keep the index focused on useful content, such as product pages, FAQs, and documentation, while excluding pages you do not want used in search or AI answers.
Crawl diagnostics
When indexing fails, review the available crawl details to investigate access errors, redirects, or bot challenges. Use this information to identify what needs attention before trying again.
Sync History. Every page CrawlBrain read, with its status code and the reason a page did not make it in.
WordPress, Shopify, Joomla, PrestaShop, Drupal, OpenCart and Magento 2 have a plugin. Everything else takes one line of JavaScript, including plain HTML.
Do I need a developer to install CrawlBrain?
For a standard setup, no. Connect your website, then install a supported plugin or paste the CrawlBrain JavaScript snippet into your site. You need access to your website’s settings, but you do not need to write the integration yourself.
WordPress integration
Use the WordPress plugin to connect CrawlBrain without manually adding the JavaScript snippet. Follow the setup steps to connect your website and make its indexed content available for search and AI answers.
Widget customization · Pro
With Pro, customize the widget’s branding and remove the CrawlBrain name. This helps the search experience feel consistent with the rest of your website. Free keeps CrawlBrain branding on the widget.
Team access
Invite teammates to access the CrawlBrain dashboard so the people responsible for your website content can help manage it.
Search Widget setup. Choose where search appears and check it in the live preview before visitors see it.
01
Enter your website URL to start discovering accessible content.
02
CrawlBrain indexes pages within your plan’s limits. Choose which sections to include or exclude.
03
Use a supported plugin or add the JavaScript snippet. Choose the widget placement that fits your website.
04
Try relevant searches and questions, then check the answers and source links before sharing the experience with visitors.
Connect your website and test search and AI answers with the questions your visitors actually ask.
CrawlBrain branding stays on the Free widget.
1
Websites
Up to 1,000
$5
Free has no subscription fee. AI answers, semantic search, and indexing use credit from your balance. If credit runs out, free keyword search remains available.
How does CrawlBrain help my business?
CrawlBrain helps visitors find information and get answers from your content. For your team, conversation logs and visitor feedback reveal what people ask, where information is missing, and which answers need review, helping you prioritize website improvements.
Conversation log
Review visitor questions and CrawlBrain’s answers in the conversation log. Filter by date, answer status, or rating to understand recurring needs and identify information visitors struggle to find.
Content coverage
Review unanswered questions to identify information your indexed content may be missing. Use recurring questions to decide which topics to explain more clearly or cover next.
Visitor feedback
Visitors can rate AI answers. Review negative ratings alongside the question, answer, and source content to investigate what did not help and decide whether the content or answer needs improvement.
Email notifications
Receive email alerts when your credit balance is low or reaches zero, so you know when paid features need attention. With Pro, a weekly unanswered-question report also helps you plan content updates.
Help shoppers find sizing, compatibility, shipping, and return information before deciding whether to buy.
Help customers find answers in your FAQs and documentation, giving them a way to resolve routine questions before contacting your team.
Help readers discover relevant articles using everyday questions, with source links that lead back to your indexed pages.
81 questions didn't get good answers in the last 30 days
Adding relevant content can fix this in 2 minutes.
comfortable shoes for walking all dayAnswered · 1h ago
a gift under 30 dollarsAnswered · 1h ago
Is the Black Sheath Dress machine washable?Answered · 1h ago
do you have swimwear?Unanswered · 3h ago
What is the cheapest watch you sell?Answered · 4h ago
Overview. Answers given, questions answered and the questions that still need content, over the last 30 days.
Question 07
Question 08
Public REST API and OAuth 2.0
Content export
llms.txtSite outline only, page links and descriptions
llms-full.txtRecommendedSingle file with all content, AI-ready
Markdown bundleZIP of one .md file per page (for Notion, Obsidian, docs sites)
CSVSpreadsheet with metadata (for Excel, scripts)
JSONDeveloper-friendly, machine-readable
Export pages. Download what CrawlBrain indexed. llms.txt is free, the other formats come with Pro.
Question 09
Multi-LLM fallback
Sync history
Soft-delete with recovery window
Two plans
Pay for what visitors use
Credit you keep
Unused credit stays in your balance. Top up from $5 to $500 when you need more.
No sales call