Commit Graph

18 Commits

Author SHA1 Message Date
Deshraj Yadav
6c12bc9044 [Improvements] Improve the default prompt and data loader util functions (#1272) 2024-02-18 14:06:32 -08:00
Deven Patel
b210723de1 [Improvement] add default user-agent header in webpage loader (#1219) 2024-01-26 11:04:25 +05:30
Sandra Serrano
2496ed133e [Bug fix] Fix typos, static methods and other sanity improvements in the package (#1129) 2024-01-09 00:17:46 +05:30
Deshraj Yadav
5c1f78879f [Misc] Minor fixes and refactor utils code (#1117) 2024-01-05 14:01:56 +05:30
Deshraj Yadav
f6b80e01a1 [Feature] Add support for custom streaming callback (#971) 2023-11-22 01:06:33 -08:00
Deshraj Yadav
e0b73e6a5a [Loaders] Improve web page and sitemap loader usability (#961) 2023-11-16 16:01:43 -08:00
Sidharth Mohanty
413b107b9a Update dependencies for fast installation (#811) 2023-10-17 08:21:30 -07:00
Sidharth Mohanty
b91d922600 Improve tests (#780) 2023-10-09 11:26:21 -07:00
cachho
03146946fa chore: linting (#597) 2023-09-12 21:34:38 +05:30
Taranjeet Singh
2bd6881361 feat: Add embedding manager (#570) 2023-09-12 12:13:53 +05:30
Deshraj Yadav
79f5a1d052 [chore]: Rename modules for better readability and maintainability (#587) 2023-09-11 07:01:40 +05:30
cachho
0d4ad07d7b Feat/serialize deserialize (#508)
Co-authored-by: Taranjeet Singh <reachtotj@gmail.com>
2023-09-04 01:20:18 +05:30
cachho
55bfd7cafe refactor: loader chunker typing (#324) 2023-07-26 23:14:57 +05:30
Taranjeet Singh
e8b3d53faf fix: Handle divide by zero error when original size is 0 (#290) 2023-07-17 07:19:47 +05:30
cachho
addf1c0666 feat: exclude by class, id in web_page data type and add logging (#273) 2023-07-16 00:51:25 +05:30
Deshraj Yadav
9ca836520f Resolve conflicts (#208) 2023-07-11 10:20:05 +05:30
aaishikdutta
6936d6983d Added documentation (#219) 2023-07-11 08:31:42 +05:30
Taranjeet Singh
08f155a551 Update website to web page
This commit renames the website loader, chunker
to web page, as it is loading and chunking a single
url than the complete website.
2023-06-20 16:50:57 +05:30