cachho
f5f5e7edd1
feat: add local text ( #44 )
...
This commits extends the "add_local" function. It
adds support to take text and index/embed it.
2023-06-25 23:13:41 +05:30
Taranjeet Singh
3413dbf5e0
bug: Make vectordb a module
...
Add missing __init__ file in vectordb directory
2023-06-24 09:44:32 +05:30
cachho
3720ded80f
docs: add clean_string() doc string ( #43 )
2023-06-23 22:44:51 +05:30
cachho
cf99dce940
Refactor query endpoint into 3 parts ( #42 )
...
Query endpoint now consists of 3 sub functions
- get data from db
- get prompt
- get answer from the data retrieved above by passing to LLM
2023-06-23 22:17:52 +05:30
cachho
2d35ade7aa
refactor: local indicator in file and class name, renamed
2023-06-23 19:53:57 +05:30
cachho
e60f1680a0
chore: removed markdown to plaintext function
2023-06-23 19:53:57 +05:30
cachho
feec5e4a09
refactor: empty line added
2023-06-23 19:53:57 +05:30
cachho
ff2d5ce7fa
feat: add local qna pair
2023-06-23 19:53:57 +05:30
cachho
df7614d349
feat: add markdown to plaintext
2023-06-23 19:53:57 +05:30
Taranjeet Singh
e40f1e5061
Skip creating embedding if it already exists
...
This commit adds support to skip generating embedding
for chunks which are already present in vector db.
2023-06-23 17:08:49 +05:30
Taranjeet Singh
cff244b894
Add default db loader, fix import
...
This commits builds on DumoeDss's PR. It
- adds a default db directory name.
- adds a default db instance (Chroma).
Both points offers flexibility for users who
want to use default and users who want to
customize
Lastly, it fixes an import
2023-06-23 11:51:51 +05:30
Sayo
85a6a0c161
[feat] Refactor VectorDB class hierarchy for flexibility
2023-06-22 12:15:26 +08:00
Taranjeet Singh
63bd18056f
Revert "Rename query endpoint to qna"
...
This reverts commit 6bc7e9b7a7
2023-06-21 16:06:51 +05:30
Taranjeet Singh
6bc7e9b7a7
Rename query endpoint to qna
...
Query endpoint takes a query and returns an answer
on the basis of retrieved similar docs.
Thought about the name and realized that qna makes
much more sense than query, as it takes a query
and returns an answer
2023-06-21 12:35:38 +05:30
Taranjeet Singh
8582613940
Add doc strings
...
Adds doc string for functions in embedchain/embedchain.py
2023-06-20 21:37:21 +05:30
Taranjeet Singh
ac0ec0bf8f
Update log statement, doc and package dependency version
2023-06-20 21:04:33 +05:30
Taranjeet Singh
08f155a551
Update website to web page
...
This commit renames the website loader, chunker
to web page, as it is loading and chunking a single
url than the complete website.
2023-06-20 16:50:57 +05:30
Taranjeet Singh
4329caa17c
Chunkers: Refactor each chunker & add base class
...
Adds a base chunker from which any chunker can inherit.
Existing chunkers are refactored to inherit from this base
chunker.
2023-06-20 16:30:23 +05:30
Taranjeet Singh
d2da80f5bc
Add import in embedchain init file
2023-06-20 14:50:56 +05:30
Taranjeet Singh
468db83337
Add simple app functionality
...
This commit enables anyone to create a app and add 3 types of data
sources:
* pdf file
* youtube video
* website
It exposes a function called query which first gets similar docs from
vector db and then passes it to LLM to get the final answer.
2023-06-20 14:42:55 +05:30
