Commit Graph
49 Commits
Author SHA1 Message Date
Kirill Bulatov ea187d3576 Slightly tidy up vector_db code
Avoid panicking when truncating code with special chars
2023-07-18 14:06:57 +03:00
Alex ViscreanuandMikayla Maki ef7952c045 feat(workspace): allow alternative actions to open files and symbols in split
Co-authored-by: Mikayla Maki <mikayla@zed.dev>
2023-07-14 21:49:15 +02:00
KCaverly 0eb22a87b4 added test registration for project settings 2023-07-11 20:12:43 -04:00
KCaverly 0192c5232e updated vector store settings to remove batch embeddings size 2023-07-11 19:54:03 -04:00
Max Brunsfeld bf50af123b Define semantic search action regardless of whether the feature is enabled 2023-07-11 15:02:43 -07:00
Max BrunsfeldandKyle 4a59d3a0d0 Get vector store test passing - wait for indexing
Co-authored-by: Kyle <kyle@zed.dev>
2023-07-11 14:30:11 -07:00
Max BrunsfeldandKyle c25b6914c2 Update dot product test to use larger vectors
Co-authored-by: Kyle <kyle@zed.dev>
2023-07-11 14:29:48 -07:00
KCaverlyandmaxbrunsfeld d67d7c8c72 added initial keymap for toggle semantic search
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-07-11 17:13:58 -04:00
KCaverly 6fe92b0851 cleaned up warnings and added javascript 2023-07-11 16:41:08 -04:00
KCaverly 5e11825ef3 expanded embeddable context to accomodate for struct context and file paths 2023-07-11 15:58:33 -04:00
KCaverly 6937a77ae9 added versioning to files table 2023-07-11 14:42:03 -04:00
KCaverly d86877851a added opt-in default settings for vector store 2023-07-11 12:03:56 -04:00
KCaverly 36c689777b updated vector_store to handle for removed files 2023-07-11 10:03:53 -04:00
KCaverly 5f879286e1 updated tests to accomodate for new dot location 2023-07-10 18:19:29 -04:00
KCaverlyandmaxbrunsfeld e4e8f6cb0e Reduced redundant database connections on each worktree change.
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-07-10 17:50:19 -04:00
KCaverlyandmaxbrunsfeld 0001cf99fe Updated batching to accomodate for full flushes, and cleaned up reindexing.
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-07-10 16:33:14 -04:00
KCaverly 4a047a5625 pulled treesitter parsing to own file for ease of testing and management 2023-07-10 10:06:07 -04:00
KCaverly d72122b981 fixed bug on absolute vs relative path 2023-07-06 17:15:41 -04:00
KCaverly ebdda2aa65 updated vector_store to include extra context for semantic search modal 2023-07-06 16:33:54 -04:00
KCaverly 9a5449b801 reindexing update to appropriately accomodate for buffer delay and persistent pending files list 2023-07-06 15:26:43 -04:00
KCaverly 71dbc29334 corrected batching order and managed for open ai embedding errors 2023-07-06 11:11:39 -04:00
KCaverly f3eb426fe9 updated both embed and parsing tasks to be multi-threaded. 2023-07-05 12:39:08 -04:00
KCaverly b13a9b4750 enabled batching for embedding calls 2023-07-05 10:02:42 -04:00
KCaverly 58bbbefc75 updated vector_store to reindex on save after timed delay 2023-07-04 14:42:12 -04:00
KCaverly 0355d0230d WIP: initial reindexing logic worked out 2023-07-04 11:46:09 -04:00
KCaverlyandmaxbrunsfeld 5c0ef44a23 moved semantic search model to dev and preview only.
moved db update tasks to long lived persistent task.

Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-30 18:41:19 -04:00
KCaverlyandmaxbrunsfeld 6c5bad6a13 updated file compare in the semantic indexing engine, to work off of modified system times as opposed to file hashes
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-30 16:53:23 -04:00
KCaverlyandmaxbrunsfeld 551809b8f1 updated vector store indexing to only use languages with an embedding.scm treesitter query
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-30 16:14:11 -04:00
KCaverly a37e404c1d implemented file deletes on project indexing 2023-06-30 11:01:35 -04:00
KCaverly c0ba76babf removed sleep from directory scanning as fixes upstream appear to be scanning correctly 2023-06-30 10:17:31 -04:00
KCaverly 5e4c3bb185 updated vector_store db to leverage EMBEDDINGS_DIR path 2023-06-29 15:18:32 -04:00
KCaverly 28e2328326 updated semantic search modal to manage for duplicate queries 2023-06-29 13:50:49 -04:00
KCaverly 914f4e8956 added navigation on confirm to semantic search modal 2023-06-29 11:58:47 -04:00
Max Brunsfeld c169115759 Debounce searches in semantic search modal 2023-06-28 15:02:20 -07:00
KCaverlyandmaxbrunsfeld d30ba4a415 updated embedding database calls to maintain project consistency
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-28 16:25:05 -04:00
KCaverlyandmaxbrunsfeld 352ea20a1f updated both indexing and search method for vector store, to maintain both zed worktree ids and db worktree ids
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-28 16:21:03 -04:00
KCaverly 8a1e4bd248 WIP: Working modal, without navigation and search on every keystroke 2023-06-28 13:27:26 -04:00
KCaverly affb2074ad updated vector_store to remove parsing module 2023-06-28 08:58:50 -04:00
KCaverlyandmaxbrunsfeld 3805698999 Added a dummy action for testing the semantic search functionality in the command palette.
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-27 15:53:07 -04:00
KCaverlyandmaxbrunsfeld e113054fdc Working incremental index engine, with streaming similarity search!
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-27 15:31:21 -04:00
KCaverlyandmaxbrunsfeld 7f3fc8e1f7 WIP: Got the streaming matrix multiplication working, and started work on file hashing.
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-26 19:01:19 -04:00
KCaverlyandmaxbrunsfeld 104dc6f4c1 Updated database calls to share single connection, and simplified top_k_search sorting.
Co-authored-by: maxbrunsfeld <max@zed.dev>
2023-06-26 14:57:57 -04:00
KCaverly a5714e0d27 added file metadata retrieval from db 2023-06-26 10:35:56 -04:00
KCaverly cbbdef62f3 added brute force search and VectorSearch trait 2023-06-26 10:34:12 -04:00
KCaverly 65376d4827 added proper blob serialization for embeddings and vector search trait 2023-06-25 20:02:56 -04:00
KCaverly 2ea38bff5d removed tokio and sqlx dependency, added dummy embeddings provider to save on open ai costs when testing 2023-06-23 10:25:12 -04:00
KCaverly 4dcf44433d open ai indexing on open for rust files 2023-06-22 16:50:07 -04:00
KCaverly 7e76785b61 WIP: started DB creating and naive inserts 2023-06-22 13:25:33 -04:00
KCaverly aa6f51c03d WIP: started work on vector store db, by walking project worktrees.\n\nCo-Authored-By: Max <max@zed.dev> 2023-06-21 14:53:08 -04:00