[Docs] Revamp documentation (#1010)

2023-12-15 05:14:17 +05:30
parent b7a44ef472
commit d54cdc5b00
81 changed files with 1223 additions and 378 deletions
--- a/docs/components/data-sources/sitemap.mdx
+++ b/docs/components/data-sources/sitemap.mdx
@@ -0,0 +1,13 @@
+---
+title: '🗺️ Sitemap'
+---
+
+Add all web pages from an xml-sitemap. Filters non-text files. Use the data_type as `sitemap`. Eg:
+
+```python
+from embedchain import Pipeline as App
+
+app = App()
+
+app.add('https://example.com/sitemap.xml', data_type='sitemap')
+```