LLMSTXT.NEW

Generate llms.txt files for LLM training.

Pricing: free — Free to use until deprecation date · Visit website

LLMSTXT.NEW is a tool that generates consolidated text files from websites for Large Language Model (LLM) training and inference. It uses Firecrawl API to fetch content, but the endpoint will be deprecated after June 30, 2025. For better support, use their main endpoints.

Pros

Generates LLMs.txt files
Powered by Firecrawl for robust data fetching
Free to use

Cons

Endpoint will be deprecated soon
No longer maintained after June 30, 2025

FAQ

Is this tool free?

Yes, it is free to use.

When will the endpoint be deprecated?

After June 30, 2025.

What should I do after June 30, 2025?

Use their main endpoints for continued support.

Last updated: 2026-06-21