956 Commits

Author	SHA1	Message	Date
dal	65840319fa	ok get metric has permissions on it now	2025-03-19 16:56:54 -06:00
dal	b1a01c5d5e	refactored	2025-03-19 16:54:08 -06:00
dal	ed60e7ebd9	ok api project is completed	2025-03-19 16:42:01 -06:00
dal	4000e8409f	fix on compiler	2025-03-19 16:35:18 -06:00
dal	c98060e59c	removed the prds for sharing	2025-03-19 16:19:44 -06:00
dal	6358771ec6	merging api_chats_sharing_update.md	2025-03-19 16:05:28 -06:00
dal	4b4b5033f6	fix on lint errors on test	2025-03-19 16:04:31 -06:00
dal	dc3c3de2ae	create api chats sharing update	2025-03-19 16:01:30 -06:00
dal	e9114ec47c	update sharing handler fix	2025-03-19 15:41:24 -06:00
dal	f95f67ac47	merging api_collections_update	2025-03-19 15:41:01 -06:00
dal	e551d86e45	create api collections update	2025-03-19 15:40:16 -06:00
dal	1c2808c5ad	merging api_dashboards_update	2025-03-19 15:36:05 -06:00
dal	dc00381bec	created api dashboards sharing update	2025-03-19 15:35:48 -06:00
dal	e4a8957d72	fix on the mod	2025-03-19 15:34:01 -06:00
dal	b4b2e5d6b0	fix merge conflicts and push	2025-03-19 15:31:20 -06:00
dal	1236ea04c3	Implemented chat sharing create endpoint ... - Added handler for creating chat sharing permissions - Created REST endpoint for POST /chats/:id/sharing - Added fixtures and test setup for chats - Created integration tests for the sharing endpoint - Updated PRD to mark implementation as complete 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-03-19 15:28:34 -06:00
dal	6051512a24	merging api_chats_sharing_delete	2025-03-19 15:21:35 -06:00
dal	d4ed618ffd	api chats sharing delete created	2025-03-19 15:19:07 -06:00
dal	98ef45a0f2	merging api_chats_sharing_list	2025-03-19 15:16:05 -06:00
dal	f189c75b49	created api_chats_sharing_list	2025-03-19 15:15:57 -06:00
dal	d3851b1755	merging api_collections_sharing_delete	2025-03-19 15:15:35 -06:00
dal	40c969c7eb	created metrics sharing update	2025-03-19 15:15:28 -06:00
dal	952f81aaa4	owner associations on chats and dashboards	2025-03-19 15:12:32 -06:00
dal	31cf5beb36	merging api_collections_sharing_create	2025-03-19 15:00:15 -06:00
dal	d5aa6cae00	sharing_list_permissions	2025-03-19 15:00:04 -06:00
dal	5b8280d429	updated mods	2025-03-19 14:59:34 -06:00
dal	cbd52d51bb	merging api_dashboards_sharing_delete	2025-03-19 14:59:31 -06:00
dal	6f4d08152f	created api dashboards_sharing_delete	2025-03-19 14:56:44 -06:00
dal	03714fc130	merging api_dashboards_sharing_create	2025-03-19 14:56:20 -06:00
dal	5b542f2194	created api_dashboards_sharing_create	2025-03-19 14:56:13 -06:00
dal	998237ce46	merging api_metrics_sharing_update	2025-03-19 14:54:51 -06:00
dal	09675f0705	created metrics sharing update	2025-03-19 14:54:42 -06:00
dal	f7b9e685f0	create metrics associating the user	2025-03-19 14:53:59 -06:00
dal	85a91b855f	merging api_collections_sharing_list	2025-03-19 14:34:03 -06:00
dal	c938b14f1b	Create colelctions sharing list	2025-03-19 14:33:30 -06:00
dal	77e8ee3456	docs and fix dashboard list sharing	2025-03-19 14:32:16 -06:00
dal	20af7909db	merging api_dashboards_list	2025-03-19 14:22:34 -06:00
dal	baa3796ff4	Created sharing create permissions	2025-03-19 14:22:24 -06:00
dal	709cff0483	sharing work	2025-03-19 14:22:05 -06:00
dal	ff8a443e42	fixed the created at and the ordering on the get	2025-03-19 14:03:59 -06:00
dal	da170c28a3	Update metrics handler to apply differences	2025-03-19 13:51:43 -06:00
dal	8c5f7c867d	Mark progress in PRD after implementing user lookup functionality	2025-03-19 13:47:05 -06:00
dal	af047a75de	json data on response	2025-03-19 13:46:27 -06:00
dal	09b94fe4ee	merging api_metrics_sharing_create	2025-03-19 13:45:37 -06:00
dal	6afc57ba5b	Implement API metrics sharing creation functionality	2025-03-19 13:44:40 -06:00
dal	10d28a57b8	fix list sharing on the metric itself	2025-03-19 13:42:39 -06:00
dal	f3c902e0c1	merging api_metrics_sharing_list_1	2025-03-19 13:31:35 -06:00
dal	d87130a8d1	merging api_metrics_sharing_list_1	2025-03-19 13:31:26 -06:00
dal	dcbe170842	commit the 1 second version history	2025-03-19 13:24:13 -06:00
dal	0c2d809d83	get metric and update metric tool	2025-03-19 13:23:04 -06:00
dal	48cda206c3	commit up all the prds	2025-03-19 13:23:04 -06:00
dal	fcf02f27dc	commit up all the prds	2025-03-19 12:51:45 -06:00
dal	7c9bbbff68	merging sharing_user_lookup	2025-03-19 11:46:48 -06:00
dal	1f7580290f	merging sharing_remove_permissions	2025-03-19 11:46:25 -06:00
dal	fa89c4eef1	raw llm response being handled appropriately	2025-03-19 11:45:00 -06:00
dal	dcb124bd1d	Mark completion in sharing_remove_permissions PRD ... - Updated implementation plan with completion status - Marked success criteria as completed 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-03-19 10:52:03 -06:00
dal	bfd9599f19	Implement user lookup by email functionality ... - Enhanced user_lookup.rs with better error handling and documentation - Added comprehensive tests for different scenarios - Updated the PRD with implementation progress 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-03-19 10:51:41 -06:00
dal	f503c730d1	Add permission check to remove_share_by_email function ... - Implemented permission validation to ensure caller has Owner or FullAccess role - Added documentation for the permission requirements - Improved test structure with comments for potential integration tests - Completed requirements in sharing_remove_permissions PRD 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>	2025-03-19 10:51:27 -06:00
dal	a9699c627d	merging get_metric_handler_version_query_param	2025-03-19 10:49:56 -06:00
dal	60ebcf79cd	created get_metric_handler_version_query_param	2025-03-19 10:49:56 -06:00
dal	2ef5ad1139	integration test fixes	2025-03-19 10:42:36 -06:00
dal	92caf4b7d4	I think this is working properly now	2025-03-19 10:34:43 -06:00
dal	75f7a8af49	Fix test assertions and disabled database-dependent tests	2025-03-19 10:17:05 -06:00
dal	5377a367dd	Add type annotation to fix compilation error	2025-03-19 10:16:01 -06:00
dal	d871818435	Fix tests module naming conflicts and unused variable warnings	2025-03-19 10:15:46 -06:00
dal	e264889c72	Fix extra closing brace in types.rs	2025-03-19 10:11:54 -06:00
dal	5ebfe64136	Fix extra closing brace in errors.rs	2025-03-19 10:11:37 -06:00
dal	e84e30286f	Merge branch 'sharing_list_permissions' into evals ... Resolved merge conflicts in sharing library: - Combined error types from both branches - Integrated the improved list permissions implementation - Updated the AssetPermissionWithUser structure - Added serializable permission types - Maintained backward compatibility with existing code	2025-03-19 10:11:13 -06:00
dal	95926e5fd1	Merge branch 'sharing_check_permissions' into evals ... Resolved merge conflicts in sharing module: - Combined the enhanced permission checking logic - Kept the comprehensive role checks from sharing_check_permissions - Included both the entry-based bulk permission checking - Maintained the full API exports from both branches - Integrated tests directory structure	2025-03-19 10:06:58 -06:00
dal	53de3fe677	sharing_list_permissions	2025-03-19 10:04:36 -06:00
dal	f5afea4501	sharing_check_permissions	2025-03-19 10:03:41 -06:00
dal	7b58464fb4	bring back search data catalog back down to low	2025-03-19 09:59:40 -06:00
dal	cc5cbc7afa	merging sharing_access_controls	2025-03-19 09:48:56 -06:00
dal	cc21f8b2ad	create sharing_access_controls	2025-03-19 09:41:29 -06:00
dal	85b0bd1502	Merge branch 'sharing_create_permissions' into evals	2025-03-19 09:37:31 -06:00
dal	7a63b97e35	Created sharing create permissions	2025-03-19 09:35:56 -06:00
dal	ad99ed0aa0	adjust data catalog prompt	2025-03-19 09:25:26 -06:00
dal	e9e9fbc6ce	catalog search	2025-03-19 09:23:17 -06:00
dal	2058b0551f	post chat handler improvement	2025-03-19 08:57:20 -06:00
dal	99e1947ae3	get rid of print on message stream	2025-03-19 00:20:45 -06:00
dal	2a33977a4e	added in some tests and such for dashboard_ymls and metric_handlers	2025-03-19 00:09:43 -06:00
dal	42f8226b2e	ok lets try removing the debug logs on litellm	2025-03-19 00:04:52 -06:00
dal	32ca9ad422	Merge branch 'testing-improvements' into evals	2025-03-18 23:55:25 -06:00
dal	e8106d9989	Updated documentation and created testing utils	2025-03-18 23:53:38 -06:00
dal	c53177d3ee	dashboard and testing stuff	2025-03-18 23:51:52 -06:00
dal	cef57963f7	start to implement camelCase on dashboard drop debugs in prod	2025-03-18 23:17:28 -06:00
dal	9dd4355380	sorry wrong	2025-03-18 22:55:51 -06:00
dal	800279b21e	tweak dockerfile	2025-03-18 22:55:38 -06:00
dal	1f6b2e4508	docker optimizations	2025-03-18 22:41:33 -06:00
dal	c66aaf42ee	try and see if litellm is the issue	2025-03-18 22:25:27 -06:00
dal	e1f60494a2	metrics endpoints and optimizations for evals	2025-03-18 21:13:47 -06:00
dal	7e1ef9bbae	concurrency fixes	2025-03-18 17:41:52 -06:00
dal	98c159fbe7	non blocking agent code now	2025-03-18 16:23:39 -06:00
dal	603c95e3eb	seems good	2025-03-18 16:23:39 -06:00
dal	bfeabb1c11	braintrust final logs	2025-03-18 14:37:58 -06:00
dal	1255cc2277	tracking convo history and such is in decent base state	2025-03-18 14:30:33 -06:00
dal	2c9e1e0508	ready logs	2025-03-18 14:20:41 -06:00
dal	0b5ed94770	agent with braintrust logs	2025-03-18 12:26:38 -06:00
dal	3a9c9dbf84	added logging to agent	2025-03-18 12:16:24 -06:00
dal	c1ca69966c	prompts	2025-03-18 10:57:04 -06:00
dal	a02c05cb58	new descritpions from braintrust	2025-03-18 10:39:13 -06:00
dal	54ef8971af	added dashboard check and started on braintrust prompt injection	2025-03-18 09:46:54 -06:00
dal	bd2cbf781c	start of collections endpoints	2025-03-18 08:14:29 -06:00
dal	256691f9c0	rename files	2025-03-17 16:33:47 -06:00
dal	d6539e8078	middleware cache env variables	2025-03-17 13:26:09 -06:00
dal	84e13dc58c	integration	2025-03-17 12:21:26 -06:00
dal	02f2ff9bd1	raw llm	2025-03-14 13:50:25 -06:00
dal	9324307302	ok integration tests are working. About to implement with actual agent.	2025-03-14 13:20:48 -06:00
dal	0a9f17fa42	agent with gpt-4o-mini	2025-03-14 12:50:12 -06:00
dal	b08ab936cf	added braintrust to agent. need to tweak a few more things	2025-03-14 08:56:21 -06:00
dal	a9cd975a0b	moved off gemini and added braintrust client for better tracing.	2025-03-14 08:56:21 -06:00
dal	ebc050995b	modify dashboard functionality	2025-03-14 08:56:20 -06:00
dal	c91aa46185	raw_llm_message endpoint for evals	2025-03-13 15:29:19 -06:00
dal	8579aafd0a	asset type	2025-03-13 14:30:38 -06:00
dal	3430b8c273	favorite changes	2025-03-13 14:09:13 -06:00
dal	0fd0af1742	exclude category	2025-03-13 13:09:48 -06:00
dal	e917dacafe	ok reverting to old commit will have to come back to streaming problems later.	2025-03-13 12:36:21 -06:00
dal	254b5c72c0	category fix	2025-03-12 17:04:42 -06:00
dal	459b396006	everything is function with a renamce	2025-03-12 16:04:27 -06:00
dal	8e6e2675b4	cleaned up imports	2025-03-12 15:43:07 -06:00
dal	07e316acf2	making the post_chat handler way smaller	2025-03-12 15:40:58 -06:00
dal	65c1d81eec	moved initialize chat out of post chat handler to cleanup	2025-03-12 15:30:06 -06:00
dal	c7c694516c	eliminated streaming_parser and moved everythign over in the post_chat_handler	2025-03-12 15:23:55 -06:00
dal	a48fa954fe	streaming parser shrunk drastically	2025-03-12 14:46:14 -06:00
dal	0ac0b6bf6b	moved streaming into its own lib for the optimistic parsing with each stream having its own handler	2025-03-12 14:15:17 -06:00
dal	e7d90bae03	ok hierarchy on files being sent back	2025-03-12 12:36:10 -06:00
dal	4432574086	better use of user throughout agents and tools	2025-03-12 08:27:59 -06:00
dal	9577fe99ba	added in the list metrics	2025-03-11 22:33:42 -06:00
dal	63490d60f0	dashboard handler	2025-03-11 22:21:30 -06:00
dal	c40c6ef626	dashboard handler with list endpoitns	2025-03-11 22:21:23 -06:00
dal	a8626d08d6	ok switched everything to camelcase for the chart config	2025-03-11 21:25:27 -06:00
dal	3c052367b1	some build optimizations	2025-03-11 20:00:10 -06:00
dal	98685351f6	metric and dashoard context fix	2025-03-11 19:49:00 -06:00
dal	48c3d9f14b	convert over db types to be struct	2025-03-11 19:30:46 -06:00
dal	878e36bbeb	asset check for metric	2025-03-11 16:51:08 -06:00
dal	78ac791f83	version number added to get metric object	2025-03-11 16:06:07 -06:00
dal	e9fc5cf9bb	added version history	2025-03-11 15:55:30 -06:00
dal	70121cc629	asset permissions progress	2025-03-11 15:09:19 -06:00
dal	d805c314b9	stub out and reset the sharing lib	2025-03-11 12:51:31 -06:00
dal	91a5fdb334	cargo fix	2025-03-11 12:33:37 -06:00
dal	f6b42ec9b7	list endpoints for chats and logs	2025-03-11 12:30:36 -06:00
dal	fbfea49253	added in collections routes, need to clean up	2025-03-11 12:16:28 -06:00
dal	7656e9039a	moved docs	2025-03-11 11:34:18 -06:00
dal	6227d6c316	tweak common again	2025-03-11 11:03:22 -06:00
dal	3d7673b23e	small tweaks on asset types	2025-03-11 11:00:23 -06:00
dal	182057426a	added in the user favorites endpoints	2025-03-11 10:58:17 -06:00
dal	4e97540ad3	windsurf rules	2025-03-11 10:24:19 -06:00
dal	dbf77e4b68	save state bettr	2025-03-11 09:35:44 -06:00
dal	6528741645	data handler has necessary fields	2025-03-10 13:29:22 -06:00
dal	76648cae83	added in the description on the metric yml	2025-03-10 12:30:36 -06:00
dal	165e9e91ce	no longer shaking up the order on completed event	2025-03-10 12:27:44 -06:00
dal	e7938c1a3c	files are coming back and response suddenly appeared again.	2025-03-10 12:15:03 -06:00
dal	dbb05eab4f	plan being returned better.	2025-03-10 12:02:11 -06:00
dal	090f010542	ok plan is completing	2025-03-10 11:36:30 -06:00
dal	d258b1a50d	almost working, need to work on exception for create plan	2025-03-10 11:33:31 -06:00
dal	915d71c99f	file modification logic	2025-03-10 10:20:06 -06:00
dal	d1462fed2d	update for metric routes	2025-03-10 09:41:32 -06:00
dal	1171684c14	ok create dashboard file	2025-03-10 09:07:50 -06:00
dal	87b5489e10	move to traces	2025-03-10 08:55:06 -06:00
dal	381ab5e49f	modification changes	2025-03-07 13:33:02 -07:00
dal	456f117cd7	fix the raw llm message save.	2025-03-07 11:01:48 -07:00
dal	47e1558e2e	ok all is good on the western front	2025-03-07 09:19:47 -07:00
dal	582fb9869c	need to revert chrono for evals brach	2025-03-07 08:47:56 -07:00
dal	415466aa1f	dedup reasoning message	2025-03-07 07:58:35 -07:00
dal	dc07acf9b7	quick commit	2025-03-07 07:24:27 -07:00
dal	a1f5fe6e2a	last few changes	2025-03-06 16:52:14 -07:00
dal	95e3dcfe80	added in the asset sharing permissions and adjusted the existing logic	2025-03-06 16:46:18 -07:00
dal	bcffc01061	successfully migrated to authenticated user obj	2025-03-06 16:21:26 -07:00
dal	65994d7d28	completed event making it now.	2025-03-06 11:18:55 -07:00
dal	2e61c39d0a	add in sharing lib	2025-03-05 17:52:08 -07:00
dal	7b44f395f3	completed	2025-03-05 17:18:00 -07:00
dal	c8d044f1be	id's match	2025-03-05 17:15:21 -07:00
dal	518c802fb6	completed on files	2025-03-05 16:02:01 -07:00
dal	b839e70aa9	moved around the ids so that the metrics and dashobard align across the board	2025-03-05 15:50:53 -07:00
dal	97656868d3	file unique id	2025-03-05 14:51:13 -07:00
dal	070a5c7455	Refactor message streaming and file processing logic	2025-03-05 14:03:28 -07:00
dal	c60522b383	save files without sending	2025-03-05 13:58:14 -07:00
dal	d773f85029	stream fix on the double file response	2025-03-05 13:36:02 -07:00
dal	bba0e30b67	added in the user avatar url	2025-03-05 13:22:01 -07:00
dal	b466a061c4	list is good for now, will adjust later.	2025-03-05 12:47:08 -07:00
dal	5af9a8e4eb	buffering content on stream	2025-03-05 11:21:11 -07:00
dal	6ec195be52	plan being saved effectively now	2025-03-05 10:39:18 -07:00
dal	4fab757f2d	message ids	2025-03-05 10:31:35 -07:00
dal	ce4a188e1f	Merge branch 'big-nate/bus-939-create-new-structure-for-chats' into evals	2025-03-05 10:16:55 -07:00
dal	8c4acf45e0	ok temp ids are working	2025-03-05 10:15:36 -07:00
dal	fe212cb167	ok I thinkn we got things running	2025-03-05 10:06:37 -07:00
dal	1440b6f65e	reasoning text is streaming back correctly right now.	2025-03-05 09:41:41 -07:00
dal	ef83036728	ok pills are correct now	2025-03-05 08:54:39 -07:00
dal	6a974f0114	file responses streaming perfect	2025-03-05 08:47:22 -07:00
dal	37ae21fa31	last few changes	2025-03-05 08:03:48 -07:00
dal	f2520c1b56	changes so far need two more tweaks	2025-03-05 08:03:28 -07:00
dal	8ec935bc0f	text id	2025-03-04 15:40:18 -07:00
Nate Kelley	0d90ad14fa	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 15:36:25 -07:00
dal	418f7ad86e	get chat	2025-03-04 15:24:57 -07:00
Nate Kelley	e27928f79b	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 15:23:54 -07:00
dal	ca93f9b9db	complete event	2025-03-04 15:11:48 -07:00
dal	0e95dfd4cb	updated some names and removed some bad fields	2025-03-04 15:08:07 -07:00
dal	e6aafa1d30	new chat context	2025-03-04 14:33:12 -07:00
dal	eae50d26f7	finished reasoning correctly done	2025-03-04 14:11:16 -07:00
Nate Kelley	2eb938f597	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 13:12:03 -07:00
dal	db5f674745	raw llm empty array for now	2025-03-04 13:11:42 -07:00
dal	4730b78284	commit up update user	2025-03-04 13:09:54 -07:00
dal	63eebb0039	made change for file array stream	2025-03-04 12:53:28 -07:00
Nate Kelley	11bd8eb6f3	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 12:29:04 -07:00
dal	4207d8f714	kill channel when agent finishes.	2025-03-04 12:25:26 -07:00
Nate Kelley	2b53c534d5	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 12:08:46 -07:00
dal	a1b4e083a0	new seed script	2025-03-04 12:03:42 -07:00
dal	dc0c316051	update to db and new seed.	2025-03-04 11:51:05 -07:00
Nate Kelley	813b05c18a	Merge branch 'staging' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 10:53:16 -07:00
dal	e5f25a6356	some updates to better align with types	2025-03-04 10:47:16 -07:00
dal	7e929d35ce	finished reasoning message	2025-03-04 10:19:05 -07:00
dal	c458e6070f	fix seed script	2025-03-04 09:46:26 -07:00
dal	99d9399f51	context loaders.	2025-03-04 09:40:27 -07:00
dal	8d50adce47	send up some changes to handlers	2025-03-04 07:47:53 -07:00
dal	8232f628ea	add in initialize	2025-03-03 16:43:44 -07:00
dal	d44e2f2946	some rule changes	2025-03-03 15:57:05 -07:00
dal	08bc8b2efb	lol update my cursor rules	2025-03-03 15:47:14 -07:00
dal	ebdd955533	ok we added in the delete endpoint for messages	2025-03-03 15:38:38 -07:00
dal	9671b33829	generating title.	2025-03-03 14:39:15 -07:00
dal	1f51b126dd	get metric_data_handler	2025-03-03 13:45:53 -07:00
dal	2575b61fd6	added in the data endpoint for a given metric.	2025-03-03 13:33:32 -07:00
dal	4bd6243ae6	ok response streaming well	2025-03-03 12:47:58 -07:00
dal	46ad056524	files streaming in well now.	2025-03-03 12:33:22 -07:00
dal	db619977de	separate out the processing chunks	2025-03-03 11:44:47 -07:00
dal	b2c988527f	working for the most part. final details for the stream.	2025-03-03 11:30:17 -07:00
dal	9aa1cbbab7	ok types are matched with streaam	2025-03-03 10:42:29 -07:00
dal	71ab5891a9	ok last but not least, the stream 👍🏼	2025-03-03 10:32:26 -07:00
dal	03de39ac82	ok things are working, but more tweaks needed.	2025-03-03 10:21:11 -07:00
dal	5de4a3961a	ok I think the foundation is pretty well set and close...	2025-03-03 08:57:30 -07:00
dal	5ca8e90e31	another big one.	2025-03-03 07:05:14 -07:00
dal	b31019d8cf	move post thread successfully	2025-03-03 06:47:18 -07:00
dal	46cf7d74fe	this is a big one...	2025-03-03 06:29:15 -07:00
dal	4b084cd725	moved user extension to the database lib	2025-02-28 14:28:00 -07:00
dal	fdc4f3b2f1	builds and moved things around	2025-02-28 14:22:55 -07:00
dal	794741550d	adjust the validation	2025-02-28 13:08:27 -07:00
dal	7d75a2e7fd	moved agent logic over	2025-02-28 13:06:43 -07:00
dal	8322fdb768	separated query engine out into its own lib will make life 10x easier later	2025-02-28 12:55:28 -07:00
dal	3fec82953c	switched the way we get secrets to be simpler	2025-02-28 12:45:53 -07:00
dal	0c5768f7c0	moved a lot into their own lib to make easier to use.	2025-02-28 12:32:41 -07:00
dal	ce1fb87b19	moved agent into own lib	2025-02-28 10:35:55 -07:00
dal	6604b9789e	updates for chats instead of threads	2025-02-28 09:41:44 -07:00
dal	e459861c45	data catalog o3 mini	2025-02-27 14:06:07 -07:00
dal	edbedd84ca	modifications for including subsets of data in requests.	2025-02-27 12:43:04 -07:00
dal	f013295714	adjustments to prompt	2025-02-27 10:55:19 -07:00
dal	46b8640f8e	super agent changes	2025-02-27 08:03:33 -07:00
dal	4271de634b	oh haha needed to set the arrow version as well	2025-02-26 16:14:58 -07:00
dal	add8468198	chrono set to 0.4.38	2025-02-26 16:10:49 -07:00
dal	191d86e5f4	lets try adjusting the arrow packages.	2025-02-26 15:33:33 -07:00
dal	b47a03423d	changes to the search data catalog	2025-02-26 15:13:11 -07:00
dal	65ce4769b4	changed the prompts	2025-02-26 13:44:23 -07:00
dal	a70389b4e8	bigquery support	2025-02-26 07:45:22 -07:00
dal	ca0d8704c2	Enhance database type mapping and YAML generation ... - Expand type mapping to support multiple database systems (Snowflake, PostgreSQL, BigQuery, Redshift, MySQL) - Add function to clean quotes from generated YAML - Improve type categorization for dimensions, measures, and unsupported types - Modify YAML description enhancement to remove quotes	2025-02-25 21:30:18 -07:00
dal	3bfe77339a	Enhance dataset and API error handling ... - Improve column deployment logic in dataset routes - Add more detailed error reporting in CLI generate command - Support additional Postgres credential parsing - Add debug logging for Buster API interactions	2025-02-25 21:11:06 -07:00
dal	3d5c05f89d	match redshift with postgres	2025-02-25 20:36:56 -07:00
dal	5ac7fc2dad	working	2025-02-25 20:21:50 -07:00
dal	9c7e217077	some good logging and config tracking	2025-02-25 20:11:35 -07:00
dal	1dd765432f	Merge .cursor rules from evals branch	2025-02-25 19:38:12 -07:00
dal	0da3e9f975	changed the manager prompt	2025-02-25 19:10:49 -07:00
dal	104ce7b027	add in the changes	2025-02-25 14:09:13 -07:00
dal	5e23a322b8	create plan to break down metrics a bit more	2025-02-25 13:47:26 -07:00
dal	db309ffeda	modified missing time frame and cleaned prettified the yml schemas	2025-02-25 13:12:46 -07:00
dal	71a500cacf	recursive directory structure works greate	2025-02-25 12:13:23 -07:00
dal	c1f7c0d95c	Add Redshift support for credentials and column retrieval	2025-02-25 11:46:38 -07:00
dal	0d45439173	successfully init on redshift	2025-02-25 11:17:28 -07:00
dal	114355a1f2	commit this ish	2025-02-25 08:33:45 -07:00
dal	d11996bbe0	things are working real nice	2025-02-24 14:59:59 -07:00
dal	4182d83339	Remove commented-out file modification tools and update file handling	2025-02-24 10:45:16 -07:00
dal	5c3f3acd6a	returning appropriately	2025-02-24 08:07:42 -07:00
dal	c9099d92f7	updated propmts to try and simplify...	2025-02-24 08:02:29 -07:00
dal	c0415fafe9	adjustments to prompts.	2025-02-24 07:37:53 -07:00
dal	7b013b8031	metric and dashboard agent returning effectively	2025-02-24 07:27:56 -07:00
dal	84bada0dd1	simplify agents pulling off shutdown function	2025-02-24 07:01:25 -07:00
dal	01a3915a4f	opt out working now	2025-02-24 06:59:02 -07:00
dal	d8ee830c6a	ok just need to tie up the last few things	2025-02-24 06:20:16 -07:00
dal	18413f2f24	clean up the tool isntantiation	2025-02-22 11:52:05 -07:00
dal	d25ccb39ef	ok some context changes and model changes	2025-02-22 11:02:57 -07:00
dal	27fd70e236	working	2025-02-21 19:25:42 -07:00
dal	e1c4c6ba41	ok conditional logic good	2025-02-21 16:20:19 -07:00
dal	242f648d85	added in conditional logic	2025-02-21 16:02:28 -07:00
dal	9f1d8eff7d	ok the sub agents are working!	2025-02-21 12:44:00 -07:00
dal	ddcb8c7798	added in a few more tweaks	2025-02-21 10:29:48 -07:00
dal	33718942ba	currently builds a few more tweaks	2025-02-20 14:50:59 -07:00
dal	27ee26fc0e	commiting up but broken for now	2025-02-20 12:33:48 -07:00
dal	a5902cce6d	existing agent context being passed	2025-02-20 11:45:00 -07:00
dal	fbcd0cf2c4	pre agent trait work	2025-02-20 11:03:34 -07:00
dal	afba56b5e0	made it so tools can inherit the agent attributes	2025-02-20 08:01:54 -07:00
dal	d452f4fb5f	ok adjusted the agent to handle internal memory, pass stream, etc.	2025-02-20 07:47:11 -07:00
dal	1064d5913b	added in prompts and new tools	2025-02-20 07:05:55 -07:00
dal	56d12e7da1	agents and agents as tools.	2025-02-19 15:47:14 -07:00
dal	893c4398b4	new modify tools	2025-02-19 15:15:36 -07:00
dal	57373b6f27	splitting out logic	2025-02-19 14:39:48 -07:00
dal	4d0fca47db	was missing the dataset_ids	2025-02-18 17:01:27 -07:00
dal	d4e0812af2	push up changes that are helping with	2025-02-18 16:47:47 -07:00
dal	1ca1e9c736	tweak the prompts to cover isseus with div by zero	2025-02-18 14:22:21 -07:00
dal	7182222bf0	ok capture data type from valiation	2025-02-18 14:04:29 -07:00
dal	450bd8fb67	use database on snowflake columns batch	2025-02-18 13:43:57 -07:00
dal	116677c0ab	bugfix - cli missing types and deploy	2025-02-18 13:35:07 -07:00
dal	87c28fb2bf	middle of doing work on the agent prompt	2025-02-18 13:07:50 -07:00
dal	52571357ab	fix on error messages	2025-02-18 11:36:15 -07:00
dal	bb34abcd4c	separate out functions for creation and validation	2025-02-18 11:16:43 -07:00
dal	cf45f4eddd	some changes for the sql validation	2025-02-18 11:12:29 -07:00
dal	561c31965e	get dashboards still need to tweak the metrics dashboard rel	2025-02-18 10:22:27 -07:00
dal	7ab35b7f22	here is the fix	2025-02-18 09:26:40 -07:00
dal	b03fdd7984	add up the metric get request	2025-02-18 08:52:14 -07:00
dal	7b12a536ed	change to fix datasets search stream	2025-02-18 08:20:37 -07:00
dal	81b781340c	dep db and others	2025-02-18 08:17:43 -07:00
dal	451de44532	starting testing with sampler tool	2025-02-18 07:25:13 -07:00
dal	496d2bab7e	starting to add in sample_query	2025-02-17 17:07:50 -07:00
dal	a011e2d115	changes to user prompt	2025-02-17 13:59:28 -07:00
dal	387533de5d	some more tweaks	2025-02-17 11:49:04 -07:00
dal	9b1daff0be	ok basically ready for evals, need to check one more thing	2025-02-17 11:09:57 -07:00
dal	bcf242824c	move user back into authed endpoint	2025-02-17 10:03:05 -07:00
dal	53b47291de	ok returning responses need to get full stream	2025-02-17 10:01:19 -07:00
dal	03a712ef14	api mostly there, few more tweaks	2025-02-17 09:34:20 -07:00
dal	2ee32bdb6d	merge conflict fix	2025-02-14 16:47:28 -07:00
dal	751a2da463	Merge branch 'staging' into big-nate/bus-939-create-new-structure-for-chats	2025-02-14 15:22:58 -08:00
dal	24673c3ca3	small todo	2025-02-14 16:11:22 -07:00
dal	854d26fbd2	added in the send user a message tool	2025-02-14 16:01:37 -07:00
dal	1765b20917	handler format looking good	2025-02-14 15:01:38 -07:00
dal	43a8a09796	Try moving user to non auth endpoint.	2025-02-14 14:44:23 -07:00
dal	02978e37e8	fix tests glob and get rid of litellm in the api	2025-02-14 14:23:41 -07:00
dal	b48b350381	moved litellm made another lib	2025-02-14 14:12:31 -07:00
dal	8fedcecd43	handlers lib	2025-02-14 13:44:21 -07:00
dal	a59e9a26c2	Remove redundant foreign key constraints and joinables for messages_to_files	2025-02-14 13:32:50 -07:00
dal	743c256dbc	added in some testing work and changed some rules	2025-02-14 11:32:33 -07:00
dal	e797f24e23	bug fix and prompt updates for o series	2025-02-14 09:19:43 -07:00
dal	e68353b61d	now looking for optional database field.	2025-02-14 08:49:19 -07:00
dal	9e420c3201	hide cargo for now	2025-02-14 08:32:54 -07:00
dal	51b6d00159	message fkey error still propagating.	2025-02-14 08:32:06 -07:00
dal	da8eb26931	silent on parsing errors since we will have a ton with the optimistic parsing.	2025-02-13 16:36:04 -07:00
dal	eac2529f29	ok we are on our way there...	2025-02-13 16:28:59 -07:00
dal	3bd5516486	ok thread is being inserted	2025-02-13 16:15:09 -07:00
dal	977b5eb6de	mdc	2025-02-13 15:05:10 -07:00
dal	2d47c2c539	mdc commit	2025-02-13 14:50:24 -07:00
dal	bdeaccdca8	cursor rules	2025-02-13 13:31:53 -07:00
dal	9fc5011b75	cursor rules	2025-02-13 08:38:14 -07:00
dal	5416418955	cargo optimization for faster builds	2025-02-13 08:31:14 -07:00
dal	c6d70b62dc	ddl on query	2025-02-12 11:07:59 -07:00
dal	09ab45bbb5	cli release code	2025-02-12 09:00:02 -07:00
dal	37854342da	ok now generating descriptions ayo	2025-02-12 08:41:17 -07:00
dal	0c597e7b0f	snowflake type mapping correct	2025-02-12 08:19:38 -07:00
dal	59054cfefa	tweak to the diffing bug	2025-02-12 08:14:38 -07:00
dal	422b4c5da5	some temp fixes while we prep the new chat	2025-02-12 06:12:56 -07:00
dal	361c48fade	database_identifier during creation	2025-02-12 05:27:08 -07:00
dal	ffaa373ec3	Merge remote-tracking branch 'origin/staging' into dal/simplify-deploy-endpoint	2025-02-12 05:25:09 -07:00
dal	61b6cfeffc	database mapping correct	2025-02-12 05:22:36 -07:00
dal	c7a631de40	tweak on database from modelfiles	2025-02-12 05:04:34 -07:00
dal	2805d7ed70	implemented database name for snowflake warehouse. temp fix	2025-02-12 04:52:32 -07:00
dal	45739b73f2	get rid of unused code	2025-02-11 17:04:11 -07:00
dal	89912fed59	ITS WORKING	2025-02-11 16:57:44 -07:00
dal	29900149dd	almost there	2025-02-11 16:38:46 -07:00
dal	041859ec28	change thought_pills to thoughts	2025-02-11 15:45:05 -07:00
dal	d17cb7e49a	bulk work on deploy	2025-02-11 15:43:07 -07:00
dal	e7fedd0a59	working except for bulk in the validation	2025-02-11 15:21:53 -07:00
dal	bf24b249d4	Refactor message and thread handling with explicit UUID references	2025-02-11 12:46:21 -07:00
dal	8e8140246d	Update message transformation to include chat and message IDs	2025-02-11 12:34:06 -07:00
dal	8b96ec01fb	Refactor message transformation with new container types and UUIDs	2025-02-11 11:53:06 -07:00
dal	bf05c7f06b	Add new thread events for chat generation progress tracking	2025-02-11 11:21:57 -07:00
dal	e7b96d9bd5	make a chart card	2025-02-11 10:58:25 -07:00
dal	41a7146a8d	Add initial chat response for new thread creation	2025-02-11 10:05:20 -07:00
dal	6fcfc4fba6	ids matching for stream messages	2025-02-11 09:57:19 -07:00
dal	2376153459	ids and initial message repeat handled	2025-02-11 09:36:28 -07:00
dal	973e9b41ce	ids are set	2025-02-11 09:21:08 -07:00
dal	fcc15a0e6f	fix tool name transform path	2025-02-11 08:23:58 -07:00
dal	8940fbf3b6	using name as id for file type reasoning message	2025-02-11 08:21:32 -07:00
dal	8de08323fa	consistent message id for text stream	2025-02-11 08:10:58 -07:00
dal	bcf1ac1a65	file stream is working 👍🏼 for create file.	2025-02-11 07:49:22 -07:00
dal	afb40c90be	ok restructured the transformer to get vecs back	2025-02-11 07:40:07 -07:00
dal	90931fc029	Add support for chat routes and update thread route handling	2025-02-11 07:27:56 -07:00
dal	d75931dcb0	We did it joe	2025-02-11 07:14:06 -07:00
dal	43e2cf44f4	its working, but not sure if it's how I want it...	2025-02-10 17:09:01 -07:00
dal	61153020ba	save point	2025-02-10 16:08:08 -07:00
dal	8c6c1d83ee	still working on the darn stream	2025-02-10 14:49:22 -07:00
dal	fd65408e30	clean up to try different impl	2025-02-10 14:22:13 -07:00
dal	2593536efa	So close, just a few more tweaks to clean up stream.	2025-02-10 13:35:57 -07:00
dal	118ef9c691	ok streaming it back	2025-02-10 12:29:13 -07:00
dal	8c8372b50e	ok everything sending back except create and modify	2025-02-10 12:15:21 -07:00
dal	d0400b5226	transforms for events	2025-02-10 11:53:19 -07:00
dal	233b580e1c	data catalog search transformation	2025-02-10 11:29:08 -07:00
dal	6a67931667	message transform	2025-02-10 10:47:16 -07:00
dal	93206fcf5c	added in duration and passed back req params	2025-02-10 09:21:07 -07:00
dal	9169a1c9e8	small tweaks	2025-02-10 08:26:25 -07:00
dal	c849a22b4f	added in progress on tools	2025-02-10 08:24:56 -07:00
dal	8bd14e0ee7	added in progress on stream messages	2025-02-10 08:17:14 -07:00
dal	789b22fe1e	Improve message streaming and tool call processing ... - Enhance message streaming with more precise content and tool call handling - Add logic to only send and store meaningful assistant messages and tool calls - Prevent sending empty or redundant messages during stream processing - Improve tool call and content update tracking in agent stream method - Optimize message inclusion in recursive thread generation	2025-02-10 07:30:52 -07:00
dal	641527114c	refactor(agent): Enhance LLM request handling with improved tool call processing ... - Add support for initial non-tool response and subsequent tool-enabled processing - Implement `PendingToolCall` to manage incremental tool call updates - Update `Delta` and related types to support more flexible tool call streaming - Modify agent stream processing to handle tool calls with improved state management - Add robust handling for tool call deltas and function call arguments	2025-02-10 07:17:14 -07:00
dal	373a83efea	refactor(agent): Extract agent prompt to constant and update date ... - Move hardcoded agent prompt to a constant `AGENT_PROMPT` in the `agent_thread.rs` file - Update the prompt's date from January 27, 2025 to February 7, 2025 - Simplify thread initialization by referencing the new constant - Maintain existing prompt structure and guidelines	2025-02-07 14:18:02 -07:00
dal	4b743fe5ec	feat(agent): Add recursion depth limit to prevent infinite processing ... - Implement a maximum recursion depth of 30 for agent thread processing - Add recursion depth tracking to prevent potential infinite loops - Provide user-friendly message when maximum recursion depth is reached - Update debug logging to include current recursion depth - Modify both synchronous and streaming thread processing methods	2025-02-07 11:35:13 -07:00
dal	8b51618afd	refactor(agent): Implement recursive stream processing with improved tool execution ... - Refactor agent stream processing to use a recursive approach for handling tool calls - Enhance tool execution with more robust error handling and result tracking - Improve stream chunk processing with detailed state management - Add support for recursive thread generation based on tool call results - Implement cloning for LiteLLMClient to support stream processing tasks	2025-02-07 11:22:43 -07:00
dal	bb4e4ca9d8	refactor(ai_tools): Standardize search tool response format and requirements ... - Update search data catalog and file search tools to use consistent JSON response structure - Enforce strict response format with mandatory "results" key and comprehensive field requirements - Add explicit guidelines for result composition and handling of empty result sets - Improve response predictability and parsing reliability for AI-powered search tools	2025-02-07 11:12:08 -07:00
dal	8054bedf1a	fix(ai_tools): Update LLM request parameters and improve response handling ... - Add `stream: Some(false)` to file search and data catalog tools - Make `json_schema` optional in `ResponseFormat` serialization - Enhance logging in search file tool with debug and warning messages - Improve error context when parsing LLM JSON responses	2025-02-07 11:05:39 -07:00
dal	864257bc24	refactor(agent): Improve thread-safe tool management with Arc ... - Wrap agent tools in an Arc for safe concurrent access - Modify tool addition methods to work with Arc-wrapped HashMap - Ensure thread-safe tool registration and retrieval - Update stream processing to use Arc-cloned tools reference	2025-02-07 10:53:26 -07:00
dal	2bf27a9eda	feat(agent): Enhance agent thread processing with improved debugging and user-specific streaming ... - Add comprehensive debug logging for agent thread processing - Modify agent thread to use user ID for streaming subscription - Update stream processing to include detailed tool call and content logging - Improve error handling and visibility in stream processing - Add user context to agent thread initialization - Remove redundant tool execution handling in stream processing	2025-02-07 10:39:15 -07:00
dal	a2f3433555	refactor(tools): Implement ValueToolExecutor for generic tool output conversion ... - Add `ValueToolExecutor` to convert tool outputs to `serde_json::Value` - Introduce `IntoValueTool` trait for easy value type conversion - Update agent tool addition methods to use new value conversion mechanism - Simplify tool registration by automatically converting tool outputs - Remove previous manual boxing and type conversion logic	2025-02-07 10:15:55 -07:00
dal	2090e0b7d7	refactor(post_thread): Simplify thread creation with agent-based approach ... - Remove complex AI-driven thread generation modules - Introduce a new `AgentThreadHandler` to manage thread creation - Streamline post thread logic by delegating to agent handler - Remove deprecated SQL generation and AI-related modules - Reduce code complexity and improve maintainability	2025-02-07 09:15:58 -07:00
dal	adba6d6954	feat(data_catalog): Implement AI-powered dataset search tool ... - Add comprehensive dataset search functionality using LLM for intelligent dataset matching - Implement search across datasets with relevance ranking based on YML content - Create structured search result output with dataset metadata - Add robust error handling, logging, and parsing for search operations - Include test coverage for search result validation - Enhance tool with flexible query parameter support and detailed response messages	2025-02-07 08:08:37 -07:00
dal	372694bf1f	feat(file_search): Implement advanced AI-powered file search tool ... - Add comprehensive file search functionality using LLM for intelligent file matching - Implement search across metric and dashboard files with relevance ranking - Create structured search result output with file metadata - Add robust error handling and logging for search operations - Include test coverage for search result parsing	2025-02-07 07:47:35 -07:00
dal	94c1635a34	refactor(file_tools): Enhance file modification and creation processes ... - Implement robust line-based content modification for metric and dashboard files - Add comprehensive error handling and validation for file modifications - Improve modification tracking with detailed modification results - Optimize file processing with batch insertion and validation - Add extensive test coverage for modification and validation logic	2025-02-07 01:29:49 -07:00
dal	0e9075ca2c	Added Line Number Formatting on File outputs	2025-02-07 00:29:11 -07:00
dal	900eb28a67	removed bool on create_file tool	2025-02-06 23:54:11 -07:00
dal	711bbe899a	refactor(tools): Enhance ToolExecutor trait and file-related tools ... - Add generic Output type to ToolExecutor trait - Update file tools to use strongly-typed output structs - Modify agent and tool implementations to support generic output - Improve error handling and result reporting in file-related tools - Add more detailed status messages for file operations	2025-02-06 23:45:48 -07:00
dal	4ec6e78648	refactor(database): Update metric and dashboard file models and migrations ... - Rename file type modules from `metric_file` and `dashboard_file` to `metric_yml` and `dashboard_yml` - Modify metric files migration to use a verification enum instead of boolean - Update messages_to_files junction table with UUID primary key and additional timestamp columns - Adjust database models to support new file and message structures - Refactor file creation utility to use new model structures	2025-02-06 17:07:52 -07:00
dal	b0e40007b0	Merge branch 'staging' into dal/goat-chat	2025-02-06 16:23:12 -07:00
dal	3ec059a99e	feat(prompts): Enhance SQL generation prompt with database identifier guidance ... - Add instruction about paying attention to database identifier in SQL generation prompt - Clarify potential cross-database referencing considerations - Update SQL generation guidelines to improve clarity and flexibility	2025-02-06 16:21:53 -07:00
dal	33d5990907	feat(datasets): Add database_identifier support for dataset creation and deployment ... - Extend Dataset model and schema to include optional database_identifier field - Update dataset creation and deployment routes to handle new database_identifier parameter - Modify dataset DDL generation to use database_identifier for schema resolution when available	2025-02-06 15:18:40 -07:00
dal	c7a6e2788a	Merge branch 'staging' into dal/simplify-deploy-endpoint	2025-02-06 15:00:23 -07:00
dal	2ec0b7743f	feat(snowflake): Improve timestamp handling and JSON processing ... - Add support for parsing Snowflake timestamp structs with epoch and fraction fields - Implement handling of Snowflake timestamp logical types (with and without timezone) - Enhance JSON value processing to detect and convert Snowflake timestamp objects - Add error handling and logging for timestamp parsing	2025-02-06 14:09:39 -07:00
dal	ef685d87a4	Fix x axis intervals (#105) ... * xAxisTickinerval * fix(visualization): Add x-axis time unit configuration for bar and combo charts - Extend chart configuration to support optional x-axis time unit - Update modify visualization agent to dynamically set x-axis time interval - Modify bar line and combo chart prompts to include x_axis_time_unit parameter * only use valid time units * refactor(visualization): Simplify x-axis time unit configuration - Modify modify_visualization_agent to extract and remove x-axis time unit more efficiently - Update global styling result structure for x-axis time interval - Adjust format_label_prompt comment to clarify date format default behavior --------- Co-authored-by: Nate Kelley <nate@buster.so>	2025-02-06 11:58:25 -08:00
dal	c27c27a7e8	fix: Improve column reference validation in model expression checks ... - Update column validation to use model-defined columns instead of dataset columns - Enhance error message to clarify column reference context - Refine validation logic for expression column references	2025-02-06 10:46:12 -07:00
dal	4e2e9795b6	refactor: Simplify dataset deployment and validation process ... - Restructure deploy_datasets function to separate concerns - Improve column and relationship validation in dataset deployment - Enhance error handling and validation result generation - Add support for more comprehensive column and relationship checks - Refactor validation logic to handle multiple error types	2025-02-05 23:42:51 -07:00
dal	08ecb44de1	Merge branch 'staging' into dal/simplify-deploy-endpoint	2025-02-05 21:56:45 -07:00
dal	e144377ada	Tweaked the fix sql to return a json output so we don't get parse errors.	2025-02-05 21:55:19 -07:00
dal	b872cf63a4	feat(prompts): Enhance SQL query generation and error handling instructions ... - Update failed SQL fix prompt to emphasize query output format - Add clarification to dataset selector prompt about selecting multiple datasets	2025-02-05 18:24:34 -07:00
dal	fa480f6797	feat: enhance column metadata retrieval across database sources ... - Add support for capturing source type (table, view, materialized view) - Improve column metadata queries for Postgres, MySQL, BigQuery, and Snowflake - Include more comprehensive column information during dataset import - Extend DatasetColumnRecord to include source_type field	2025-02-05 18:21:40 -07:00
dal	6e5c299389	feat: improve dataset column validation and deployment process ... - Add comprehensive column validation before dataset deployment - Validate existence of all required columns in source database - Simplify column type and nullability retrieval - Enhance error reporting for missing columns - Update deployment logic to use pre-validated column information	2025-02-05 17:20:11 -07:00
dal	f081f3e16e	feat: enhance dataset validation and deployment error handling ... - Add detailed validation error logging in CLI - Improve type compatibility checks in dataset validation - Modify deployment process to handle and report validation errors more comprehensively - Add Hash derive for Verification enum - Update API and CLI to support more informative validation results	2025-02-05 17:04:13 -07:00
dal	fb75c1f554	fix(search): Add organization_id filter to semantic and terms search queries	2025-02-05 16:23:24 -07:00
dal	7bcd7d81bc	make sure the output of fix sql is delimited	2025-02-05 16:19:23 -07:00
dal	3c82ac0774	feat: add dataset validation and improved deployment process	2025-02-05 15:00:52 -07:00
dal	2c7ef16956	fix the search value table	2025-02-05 12:30:51 -07:00
dal	d9973a13dd	bugfix(datasets): add delete dataset route ... Implement a new DELETE route for removing datasets by their ID	2025-02-05 11:58:43 -07:00
dal	2be7383656	you learn something new every day... a schema in pg can't start with a number.	2025-02-05 11:36:31 -07:00
dal	960c89ab84	fix: janky check for values	2025-02-04 17:26:57 -07:00
dal	87a6225f1d	remove the limit query bc mixing things up	2025-02-04 17:18:02 -07:00
dal	0fde90b848	refactor(snowflake_query): optimize Arrow data processing with explicit row collection (#92)	2025-02-04 15:57:35 -08:00
dal	d0ff21e10d	Merge pull request #90 from buster-so/dal/stored_values_enum_push_to_description ... feat(stored_values): enhance column value processing with enum detect…	2025-02-04 15:10:54 -08:00
dal	d4825c0ffe	bugfix(snowflake_query): add data processing helpers for query results (#88) ... - Introduce helper functions for processing string and JSON values - Implement case-insensitive string and JSON value transformations - Add robust timestamp parsing with error handling - Enhance Snowflake query result processing with consistent data normalization	2025-02-04 14:32:23 -08:00
dal	59049b5604	refactor(stored_values): improve background processing and error handling for stored column values (#85) ... - Refactor stored values processing in dataset deployment to use background task - Add `StoredValueColumn` struct to encapsulate column processing details - Implement `process_stored_values_background` for parallel and resilient value storage - Add logging for successful and failed stored value processing - Update CLI to handle optional SQL definitions and improve file processing	2025-02-04 11:30:45 -08:00
dal	ef18eff61d	Merge branch 'staging' into dal/goat-chat	2025-02-04 09:26:16 -07:00
dal	daf4ec794f	Upgrade: Updated to o3-mini models ... upgrade(ai): update OpenAI model configurations and add support for O…	2025-02-04 07:50:19 -08:00
dal	158f5ba0a9	Dal/stored values fix (#81) ... * fix: add stored values support for dataset columns This commit introduces stored values functionality for dataset columns, including: - Adding a `stored_values` flag to column deployment requests - Implementing a mechanism to store column values during dataset deployment - Updating data analyst and SQL generation agents to leverage stored values - Creating a new utility module for stored values search and management * refactor(stored_values): improve stored values implementation and schema management This commit enhances the stored values functionality with several key improvements: - Update schema and table creation to use organization ID as schema name - Modify stored values storage to include column ID - Improve value extraction and embedding generation process - Remove unnecessary distance calculation in search results - Clean up unused values_engine module	2025-02-04 07:15:34 -08:00
dal	f11bfa9941	fix(invite_users): simplify and streamline user invitation process (#78)	2025-02-03 12:41:00 -08:00
dal	2a183ca711	fix(dashboard): improve dashboard access and permission handling (#76)	2025-02-03 12:19:59 -08:00
dal	a665648308	feat: Implement file creation for metric and dashboard files ... - Added implementation for creating metric files with database insertion - Introduced `create_metric_file()` and `create_dashboard_file()` functions - Updated `CreateFilesTool` to handle different file types - Added `data_metadata` field to `MetricFile` struct - Implemented basic file type validation and creation logic	2025-02-03 12:51:55 -07:00
dal	a3ee00ff84	refactor: Enhance file creation tool with error handling and type validation ... - Added robust error handling for JSON parameter parsing in `CreateFilesTool` - Updated file type description to clarify naming conventions - Prepared for file creation logic implementation - Moved file-related types to a new `file_types` module - Removed redundant `types.rs` file	2025-01-31 10:16:35 -07:00
dal	7d153e06af	refactor: Consolidate file-related tools into a single module ... - Removed individual tool files for bulk file modifications, file creation, file opening, data catalog search, file search, and sending to user - Created a new `file_tools` module in `tools/mod.rs` to centralize file-related tool implementations - Commented out individual tool module imports in preparation for future implementation - Simplified the tools module structure for better organization and maintainability	2025-01-30 14:58:41 -07:00
dal	ec04a5e98e	refactor: Enhance Agent and Tool management with new methods and tests ... - Added environment variable-based LLM client initialization in `Agent::new()` - Introduced `add_tool()` and `add_tools()` methods for more flexible tool registration - Implemented new `get_name()` method for `ToolExecutor` trait - Added comprehensive test cases for Agent with and without tools - Updated `AgentThread` with a convenient constructor method - Temporarily commented out unused tool modules - Added debug print in LiteLLM client for response logging	2025-01-30 14:12:59 -07:00
dal	27016df995	chore: cleanup limit insertion	2025-01-28 12:50:31 -07:00
dal	6a73b59aa1	deprecated old threads and messages table	2025-01-28 12:18:59 -07:00
dal	22d75ae0b6	refactor: Update messages table schema and database references ... - Renamed existing messages table to `messages_deprecated` - Created new `messages` table with updated schema and additional indexes - Updated Diesel schema to reflect new table structure and relationships - Added new foreign key constraints for threads and users - Prepared for migration of existing message data	2025-01-28 12:03:11 -07:00
dal	d7087e8cd5	chore: snowflake warehouse specification	2025-01-28 11:45:37 -07:00
dal	48447d5bc5	Snowflake limit to prevent memory issues	2025-01-28 11:24:37 -07:00
dal	9624bc33ad	feat: Add file junction table and update database schema ... - Created `messages_to_files` junction table to link messages with dashboard and metric files - Added foreign key constraints and indexes for efficient file-message relationships - Updated Diesel schema to include new `messages_to_files`, `dashboard_files`, and `metric_files` tables - Removed unnecessary timestamp triggers from migration files	2025-01-28 11:21:51 -07:00
dal	f1879dc15c	new tables	2025-01-28 09:57:40 -07:00
dal	6271e00b70	chore: Enhance SQL agent generation with data source type context (#69) ... - Added support for retrieving and passing data source type during SQL agent generation - Updated SQL generation prompts to include data source type in system messages - Modified `generate_sql_agent` function to fetch and utilize data source type information - Improved SQL generation context by dynamically incorporating data source type details	2025-01-28 07:35:57 -08:00
dal	e190ff9a14	I apolog	2025-01-28 08:29:43 -07:00
dal	0020e6ed4a	refactor: Rename and update dataset search tool ... - Renamed `search_datasets.rs` to `search_data_catalog.rs` - Updated `mod.rs` to reflect the new module and tool name - Removed the placeholder `SearchDatasetsTool` implementation - Prepared for future implementation of data catalog search functionality	2025-01-27 14:24:10 -07:00
dal	2bc68e8599	refactor: Move ToolExecutor trait to tools module ... - Relocated `ToolExecutor` trait from `agent/types.rs` to `tools/mod.rs` - Updated import paths in `agent/agent.rs` to reflect new trait location - Simplified `types.rs` by removing unused imports and trait definition - Prepared for more comprehensive tool management in the tools module	2025-01-26 19:31:51 -07:00
dal	692f8f7a1d	refactor: Update Agent and Thread types for improved message handling ... - Renamed `Thread` to `AgentThread` for clarity - Modified `ToolExecutor` to return `serde_json::Value` instead of `String` - Updated message processing to handle new message structures - Improved content handling in streaming and tool call scenarios - Simplified message content extraction and serialization	2025-01-26 08:45:49 -07:00
dal	aeb1a02ba1	refactor: Re-enable LiteLLM client and agent modules ... - Uncommented and activated module implementations for `LiteLLMClient` and `Agent` - Updated test cases to use new message and tool call structures - Simplified test assertions for chat completion and tool call scenarios - Restored module exports in `mod.rs` files	2025-01-26 08:38:20 -07:00