feat: update llms.txt (#1443)

After discussion with @vystrcild we decided to merge both apify.com and
docs.apify.com `/llms.txt` files into one, so we can submit only one
link to public `/llms.txt` directories instead of two for both the
homepage and the docs.

Author: MQ37

static/llms.txt

@@ -1,5 +1,56 @@
 # docs.apify.com
 
+> Cloud platform for web scraping, browser automation, and data for AI. Use 3,000+ ready-made tools, code templates, or order a custom solution.
+
+## Your full‑stack platform for web scraping
+
+- [Apify Store](https://apify.com/store): Ready-to-use web scraping tools for popular websites and automation software for any use case. Plus marketplace for developers to earn from coding.
+- [Apify Actors](https://apify.com/actors): Need to scrape at scale? Try Apify Actors, the easy serverless way to create and deploy web scraping and automation tools.
+- [Careers at Apify](https://apify.com/jobs): Join the Apify team and help us make the web more programmable!
+- [Apify integrations](https://apify.com/integrations): Connect Apify Actors and tasks with your favorite web apps and cloud services and bring your workflow automation to a whole new level.
+- [Flexible platform—flexible pricing](https://apify.com/pricing): Extract value from the web with Apify. Flexible platform — flexible pricing. Free plan available, no credit card required.
+- [Apify Storage](https://apify.com/storage): Scalable and reliable cloud data storage designed for web scraping and automation workloads.
+- [Contact Sales](https://apify.com/contact-sales): Apify has all the tools you need for large-scale web scraping and automation. What are you looking for?
+- [Scrape the web without getting blocked](https://apify.com/anti-blocking): Use Apify’s combined anti-blocking solutions to extract data reliably, even from sites with advanced anti-scraping protections.
+- [Apify Proxy](https://apify.com/proxy): Apify Proxy allows you to change your IP address when web scraping to reduce the chance of being blocked because of your geographical location.
+- [Apify for Enterprise](https://apify.com/enterprise): Accurate, reliable, and compliant web data for your business. From any website. At any scale.
+- [Fast, reliable data for ChatGPT and LLMs](https://apify.com/data-for-generative-ai): Get the data to train ChatGPT API and Large Language Models, fast.
+- [Use cases](https://apify.com/use-cases): Learn how web scraping and browser automation with Apify can help grow your business.
+- [Apify Professional Services](https://apify.com/professional-services): Premium, customized professional services for web scraping and automation projects.
+- [Apify Partners](https://apify.com/partners): Find certified partners to help you build or set up web scraping and automation solutions.
+- [Web scraping code templates](https://apify.com/templates): Actor templates help you quickly set up your web scraping projects, saving you development time and giving you immediate access to all the features the Apify platform has to offer.
+- [Actor and integration ideas](https://apify.com/ideas): Our community is always looking for new web scraping and automation Actors and integrations to connect them with. Upvote the ideas below or submit your own!
+- [Changelog](https://apify.com/change-log): Keep up to date with the latest releases, fixes, and features from Apify.
+- [Customer stories](https://apify.com/success-stories): Get inspired by these awesome projects. Find out how Apify can make your work more efficient, profitable, useful, and add value to everything you do.
+- [About Apify](https://apify.com/about): We’re building the world’s best cloud platform for developing and running web scraping solutions.
+- [Contact us](https://apify.com/contact): Company contact and legal information. Let us know what you would like Apify to do for you!
+
+## Apify Partners
+
+- [Monetize your code](https://apify.com/partners/actor-developers): Publish your code on the Apify platform, attract people who need your solution, and get paid!
+- [Apify Affiliate Program](https://apify.com/partners/affiliate): Join Apify Affiliate program and earn up to 30% recurring commission by referring customers and leads.
+
+## Apify Support Programs
+
+- [Apify for startups](https://apify.com/resources/startups): Apify believes in encouraging startups to grow by making use of online data at scale. So we're extending a special 30% discount on our Scale plan exclusively for entrepreneurs and teams just starting out.
+- [Apify for universities](https://apify.com/resources/universities): We hope to see future generations take advantage of the vast amount of data available online. That’s why we’re offering a 50% discount on our paid plans to students.
+- [Apify for nonprofits](https://apify.com/resources/nonprofits): We believe that online data can help your organization have more impact, so we're offering a substantial discount from our plans to nonprofits and NGOs.
+
+## Web scraping code templates
+
+- [Crawlee + Playwright + Chrome](https://apify.com/templates/ts-crawlee-playwright-chrome): Web scraper example with Crawlee, Playwright and headless Chrome. Playwright is more modern, user-friendly and harder to block than Puppeteer.
+- [Crawlee + Puppeteer + Chrome](https://apify.com/templates/ts-crawlee-puppeteer-chrome): Example of a Puppeteer and headless Chrome web scraper. Headless browsers render JavaScript and are harder to block, but they're slower than plain HTTP.
+- [Crawlee + Cheerio](https://apify.com/templates/ts-crawlee-cheerio): A scraper example that uses Cheerio to parse HTML. It's fast, but it can't run the website's JavaScript or pass JS anti-scraping challenges.
+- [Selenium + Chrome](https://apify.com/templates/python-selenium): Scraper example built with Selenium and headless Chrome browser to scrape a website and save the results to storage. A popular alternative to Playwright.
+- [Scrapy](https://apify.com/templates/python-scrapy): This example Scrapy spider scrapes page titles from URLs defined in input parameter. It shows how to use Apify SDK for Python and Scrapy pipelines to save results.
+- [Crawlee + BeautifulSoup](https://apify.com/templates/python-crawlee-beautifulsoup): Crawl and scrape websites using Crawlee and BeautifulSoup. Start from a given start URLs, and store results to Apify dataset.
+
+## Use cases
+
+- [Lead generation](https://apify.com/use-cases/lead-generation): A reliable and versatile solution for data extraction that will take your lead generation to the next level.
+- [Market research](https://apify.com/use-cases/market-research): Use web scraping to uncover deep insights from reviews, social media, comments, and forums. Find out what real customers are saying about you and your competitors.
+- [Sentiment analysis](https://apify.com/use-cases/sentiment-analysis): Fuel your sentiment analysis projects with automated data collection be it product reviews, news articles, or social media.
+
 ## Apify Documentation
 
 - [Web Scraping Academy](https://docs.apify.com/academy): Learn everything about web scraping and automation with our free courses that will turn you into an expert scraper developer.
@@ -45,4 +96,3 @@
 
 - [Apify SDK for JavaScript and Node.js](https://docs.apify.com/sdk/js/)
 - [Apify SDK for Python is a toolkit for building Actors](https://docs.apify.com/sdk/python/)
-