600 Commits

Author	SHA1	Message	Date
dal	d1462fed2d	update for metric routes	2025-03-10 09:41:32 -06:00
dal	1171684c14	ok create dashboard file	2025-03-10 09:07:50 -06:00
dal	87b5489e10	move to traces	2025-03-10 08:55:06 -06:00
dal	381ab5e49f	modification changes	2025-03-07 13:33:02 -07:00
dal	456f117cd7	fix the raw llm message save.	2025-03-07 11:01:48 -07:00
dal	47e1558e2e	ok all is good on the western front	2025-03-07 09:19:47 -07:00
dal	582fb9869c	need to revert chrono for evals brach	2025-03-07 08:47:56 -07:00
dal	415466aa1f	dedup reasoning message	2025-03-07 07:58:35 -07:00
dal	dc07acf9b7	quick commit	2025-03-07 07:24:27 -07:00
dal	a1f5fe6e2a	last few changes	2025-03-06 16:52:14 -07:00
dal	95e3dcfe80	added in the asset sharing permissions and adjusted the existing logic	2025-03-06 16:46:18 -07:00
dal	bcffc01061	successfully migrated to authenticated user obj	2025-03-06 16:21:26 -07:00
dal	65994d7d28	completed event making it now.	2025-03-06 11:18:55 -07:00
dal	2e61c39d0a	add in sharing lib	2025-03-05 17:52:08 -07:00
dal	7b44f395f3	completed	2025-03-05 17:18:00 -07:00
dal	c8d044f1be	id's match	2025-03-05 17:15:21 -07:00
dal	518c802fb6	completed on files	2025-03-05 16:02:01 -07:00
dal	b839e70aa9	moved around the ids so that the metrics and dashobard align across the board	2025-03-05 15:50:53 -07:00
dal	97656868d3	file unique id	2025-03-05 14:51:13 -07:00
dal	070a5c7455	Refactor message streaming and file processing logic	2025-03-05 14:03:28 -07:00
dal	c60522b383	save files without sending	2025-03-05 13:58:14 -07:00
dal	d773f85029	stream fix on the double file response	2025-03-05 13:36:02 -07:00
dal	bba0e30b67	added in the user avatar url	2025-03-05 13:22:01 -07:00
dal	b466a061c4	list is good for now, will adjust later.	2025-03-05 12:47:08 -07:00
dal	5af9a8e4eb	buffering content on stream	2025-03-05 11:21:11 -07:00
dal	6ec195be52	plan being saved effectively now	2025-03-05 10:39:18 -07:00
dal	4fab757f2d	message ids	2025-03-05 10:31:35 -07:00
dal	ce4a188e1f	Merge branch 'big-nate/bus-939-create-new-structure-for-chats' into evals	2025-03-05 10:16:55 -07:00
dal	8c4acf45e0	ok temp ids are working	2025-03-05 10:15:36 -07:00
dal	fe212cb167	ok I thinkn we got things running	2025-03-05 10:06:37 -07:00
dal	1440b6f65e	reasoning text is streaming back correctly right now.	2025-03-05 09:41:41 -07:00
dal	ef83036728	ok pills are correct now	2025-03-05 08:54:39 -07:00
dal	6a974f0114	file responses streaming perfect	2025-03-05 08:47:22 -07:00
dal	37ae21fa31	last few changes	2025-03-05 08:03:48 -07:00
dal	f2520c1b56	changes so far need two more tweaks	2025-03-05 08:03:28 -07:00
dal	8ec935bc0f	text id	2025-03-04 15:40:18 -07:00
Nate Kelley	0d90ad14fa	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 15:36:25 -07:00
dal	418f7ad86e	get chat	2025-03-04 15:24:57 -07:00
Nate Kelley	e27928f79b	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 15:23:54 -07:00
dal	ca93f9b9db	complete event	2025-03-04 15:11:48 -07:00
dal	0e95dfd4cb	updated some names and removed some bad fields	2025-03-04 15:08:07 -07:00
dal	e6aafa1d30	new chat context	2025-03-04 14:33:12 -07:00
dal	eae50d26f7	finished reasoning correctly done	2025-03-04 14:11:16 -07:00
Nate Kelley	2eb938f597	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 13:12:03 -07:00
dal	db5f674745	raw llm empty array for now	2025-03-04 13:11:42 -07:00
dal	4730b78284	commit up update user	2025-03-04 13:09:54 -07:00
dal	63eebb0039	made change for file array stream	2025-03-04 12:53:28 -07:00
Nate Kelley	11bd8eb6f3	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 12:29:04 -07:00
dal	4207d8f714	kill channel when agent finishes.	2025-03-04 12:25:26 -07:00
Nate Kelley	2b53c534d5	Merge branch 'evals' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 12:08:46 -07:00
dal	a1b4e083a0	new seed script	2025-03-04 12:03:42 -07:00
dal	dc0c316051	update to db and new seed.	2025-03-04 11:51:05 -07:00
Nate Kelley	813b05c18a	Merge branch 'staging' into big-nate/bus-939-create-new-structure-for-chats	2025-03-04 10:53:16 -07:00
dal	e5f25a6356	some updates to better align with types	2025-03-04 10:47:16 -07:00
dal	7e929d35ce	finished reasoning message	2025-03-04 10:19:05 -07:00
dal	c458e6070f	fix seed script	2025-03-04 09:46:26 -07:00
dal	99d9399f51	context loaders.	2025-03-04 09:40:27 -07:00
dal	8d50adce47	send up some changes to handlers	2025-03-04 07:47:53 -07:00
dal	8232f628ea	add in initialize	2025-03-03 16:43:44 -07:00
dal	d44e2f2946	some rule changes	2025-03-03 15:57:05 -07:00
dal	08bc8b2efb	lol update my cursor rules	2025-03-03 15:47:14 -07:00
dal	ebdd955533	ok we added in the delete endpoint for messages	2025-03-03 15:38:38 -07:00
dal	9671b33829	generating title.	2025-03-03 14:39:15 -07:00
dal	1f51b126dd	get metric_data_handler	2025-03-03 13:45:53 -07:00
dal	2575b61fd6	added in the data endpoint for a given metric.	2025-03-03 13:33:32 -07:00
dal	4bd6243ae6	ok response streaming well	2025-03-03 12:47:58 -07:00
dal	46ad056524	files streaming in well now.	2025-03-03 12:33:22 -07:00
dal	db619977de	separate out the processing chunks	2025-03-03 11:44:47 -07:00
dal	b2c988527f	working for the most part. final details for the stream.	2025-03-03 11:30:17 -07:00
dal	9aa1cbbab7	ok types are matched with streaam	2025-03-03 10:42:29 -07:00
dal	71ab5891a9	ok last but not least, the stream 👍🏼	2025-03-03 10:32:26 -07:00
dal	03de39ac82	ok things are working, but more tweaks needed.	2025-03-03 10:21:11 -07:00
dal	5de4a3961a	ok I think the foundation is pretty well set and close...	2025-03-03 08:57:30 -07:00
dal	5ca8e90e31	another big one.	2025-03-03 07:05:14 -07:00
dal	b31019d8cf	move post thread successfully	2025-03-03 06:47:18 -07:00
dal	46cf7d74fe	this is a big one...	2025-03-03 06:29:15 -07:00
dal	4b084cd725	moved user extension to the database lib	2025-02-28 14:28:00 -07:00
dal	fdc4f3b2f1	builds and moved things around	2025-02-28 14:22:55 -07:00
dal	794741550d	adjust the validation	2025-02-28 13:08:27 -07:00
dal	7d75a2e7fd	moved agent logic over	2025-02-28 13:06:43 -07:00
dal	8322fdb768	separated query engine out into its own lib will make life 10x easier later	2025-02-28 12:55:28 -07:00
dal	3fec82953c	switched the way we get secrets to be simpler	2025-02-28 12:45:53 -07:00
dal	0c5768f7c0	moved a lot into their own lib to make easier to use.	2025-02-28 12:32:41 -07:00
dal	ce1fb87b19	moved agent into own lib	2025-02-28 10:35:55 -07:00
dal	6604b9789e	updates for chats instead of threads	2025-02-28 09:41:44 -07:00
dal	e459861c45	data catalog o3 mini	2025-02-27 14:06:07 -07:00
dal	edbedd84ca	modifications for including subsets of data in requests.	2025-02-27 12:43:04 -07:00
dal	f013295714	adjustments to prompt	2025-02-27 10:55:19 -07:00
dal	46b8640f8e	super agent changes	2025-02-27 08:03:33 -07:00
dal	4271de634b	oh haha needed to set the arrow version as well	2025-02-26 16:14:58 -07:00
dal	add8468198	chrono set to 0.4.38	2025-02-26 16:10:49 -07:00
dal	191d86e5f4	lets try adjusting the arrow packages.	2025-02-26 15:33:33 -07:00
dal	b47a03423d	changes to the search data catalog	2025-02-26 15:13:11 -07:00
dal	65ce4769b4	changed the prompts	2025-02-26 13:44:23 -07:00
dal	a70389b4e8	bigquery support	2025-02-26 07:45:22 -07:00
dal	ca0d8704c2	Enhance database type mapping and YAML generation ... - Expand type mapping to support multiple database systems (Snowflake, PostgreSQL, BigQuery, Redshift, MySQL) - Add function to clean quotes from generated YAML - Improve type categorization for dimensions, measures, and unsupported types - Modify YAML description enhancement to remove quotes	2025-02-25 21:30:18 -07:00
dal	3bfe77339a	Enhance dataset and API error handling ... - Improve column deployment logic in dataset routes - Add more detailed error reporting in CLI generate command - Support additional Postgres credential parsing - Add debug logging for Buster API interactions	2025-02-25 21:11:06 -07:00
dal	3d5c05f89d	match redshift with postgres	2025-02-25 20:36:56 -07:00
dal	5ac7fc2dad	working	2025-02-25 20:21:50 -07:00
dal	9c7e217077	some good logging and config tracking	2025-02-25 20:11:35 -07:00
dal	1dd765432f	Merge .cursor rules from evals branch	2025-02-25 19:38:12 -07:00
dal	0da3e9f975	changed the manager prompt	2025-02-25 19:10:49 -07:00
dal	104ce7b027	add in the changes	2025-02-25 14:09:13 -07:00
dal	5e23a322b8	create plan to break down metrics a bit more	2025-02-25 13:47:26 -07:00
dal	db309ffeda	modified missing time frame and cleaned prettified the yml schemas	2025-02-25 13:12:46 -07:00
dal	71a500cacf	recursive directory structure works greate	2025-02-25 12:13:23 -07:00
dal	c1f7c0d95c	Add Redshift support for credentials and column retrieval	2025-02-25 11:46:38 -07:00
dal	0d45439173	successfully init on redshift	2025-02-25 11:17:28 -07:00
dal	114355a1f2	commit this ish	2025-02-25 08:33:45 -07:00
dal	d11996bbe0	things are working real nice	2025-02-24 14:59:59 -07:00
dal	4182d83339	Remove commented-out file modification tools and update file handling	2025-02-24 10:45:16 -07:00
dal	5c3f3acd6a	returning appropriately	2025-02-24 08:07:42 -07:00
dal	c9099d92f7	updated propmts to try and simplify...	2025-02-24 08:02:29 -07:00
dal	c0415fafe9	adjustments to prompts.	2025-02-24 07:37:53 -07:00
dal	7b013b8031	metric and dashboard agent returning effectively	2025-02-24 07:27:56 -07:00
dal	84bada0dd1	simplify agents pulling off shutdown function	2025-02-24 07:01:25 -07:00
dal	01a3915a4f	opt out working now	2025-02-24 06:59:02 -07:00
dal	d8ee830c6a	ok just need to tie up the last few things	2025-02-24 06:20:16 -07:00
dal	18413f2f24	clean up the tool isntantiation	2025-02-22 11:52:05 -07:00
dal	d25ccb39ef	ok some context changes and model changes	2025-02-22 11:02:57 -07:00
dal	27fd70e236	working	2025-02-21 19:25:42 -07:00
dal	e1c4c6ba41	ok conditional logic good	2025-02-21 16:20:19 -07:00
dal	242f648d85	added in conditional logic	2025-02-21 16:02:28 -07:00
dal	9f1d8eff7d	ok the sub agents are working!	2025-02-21 12:44:00 -07:00
dal	ddcb8c7798	added in a few more tweaks	2025-02-21 10:29:48 -07:00
dal	33718942ba	currently builds a few more tweaks	2025-02-20 14:50:59 -07:00
dal	27ee26fc0e	commiting up but broken for now	2025-02-20 12:33:48 -07:00
dal	a5902cce6d	existing agent context being passed	2025-02-20 11:45:00 -07:00
dal	fbcd0cf2c4	pre agent trait work	2025-02-20 11:03:34 -07:00
dal	afba56b5e0	made it so tools can inherit the agent attributes	2025-02-20 08:01:54 -07:00
dal	d452f4fb5f	ok adjusted the agent to handle internal memory, pass stream, etc.	2025-02-20 07:47:11 -07:00
dal	1064d5913b	added in prompts and new tools	2025-02-20 07:05:55 -07:00
dal	56d12e7da1	agents and agents as tools.	2025-02-19 15:47:14 -07:00
dal	893c4398b4	new modify tools	2025-02-19 15:15:36 -07:00
dal	57373b6f27	splitting out logic	2025-02-19 14:39:48 -07:00
dal	4d0fca47db	was missing the dataset_ids	2025-02-18 17:01:27 -07:00
dal	d4e0812af2	push up changes that are helping with	2025-02-18 16:47:47 -07:00
dal	1ca1e9c736	tweak the prompts to cover isseus with div by zero	2025-02-18 14:22:21 -07:00
dal	7182222bf0	ok capture data type from valiation	2025-02-18 14:04:29 -07:00
dal	450bd8fb67	use database on snowflake columns batch	2025-02-18 13:43:57 -07:00
dal	116677c0ab	bugfix - cli missing types and deploy	2025-02-18 13:35:07 -07:00
dal	87c28fb2bf	middle of doing work on the agent prompt	2025-02-18 13:07:50 -07:00
dal	52571357ab	fix on error messages	2025-02-18 11:36:15 -07:00
dal	bb34abcd4c	separate out functions for creation and validation	2025-02-18 11:16:43 -07:00
dal	cf45f4eddd	some changes for the sql validation	2025-02-18 11:12:29 -07:00
dal	561c31965e	get dashboards still need to tweak the metrics dashboard rel	2025-02-18 10:22:27 -07:00
dal	7ab35b7f22	here is the fix	2025-02-18 09:26:40 -07:00
dal	b03fdd7984	add up the metric get request	2025-02-18 08:52:14 -07:00
dal	7b12a536ed	change to fix datasets search stream	2025-02-18 08:20:37 -07:00
dal	81b781340c	dep db and others	2025-02-18 08:17:43 -07:00
dal	451de44532	starting testing with sampler tool	2025-02-18 07:25:13 -07:00
dal	496d2bab7e	starting to add in sample_query	2025-02-17 17:07:50 -07:00
dal	a011e2d115	changes to user prompt	2025-02-17 13:59:28 -07:00
dal	387533de5d	some more tweaks	2025-02-17 11:49:04 -07:00
dal	9b1daff0be	ok basically ready for evals, need to check one more thing	2025-02-17 11:09:57 -07:00
dal	bcf242824c	move user back into authed endpoint	2025-02-17 10:03:05 -07:00
dal	53b47291de	ok returning responses need to get full stream	2025-02-17 10:01:19 -07:00
dal	03a712ef14	api mostly there, few more tweaks	2025-02-17 09:34:20 -07:00
dal	2ee32bdb6d	merge conflict fix	2025-02-14 16:47:28 -07:00
dal	751a2da463	Merge branch 'staging' into big-nate/bus-939-create-new-structure-for-chats	2025-02-14 15:22:58 -08:00
dal	24673c3ca3	small todo	2025-02-14 16:11:22 -07:00
dal	854d26fbd2	added in the send user a message tool	2025-02-14 16:01:37 -07:00
dal	1765b20917	handler format looking good	2025-02-14 15:01:38 -07:00
dal	43a8a09796	Try moving user to non auth endpoint.	2025-02-14 14:44:23 -07:00
dal	02978e37e8	fix tests glob and get rid of litellm in the api	2025-02-14 14:23:41 -07:00
dal	b48b350381	moved litellm made another lib	2025-02-14 14:12:31 -07:00
dal	8fedcecd43	handlers lib	2025-02-14 13:44:21 -07:00
dal	a59e9a26c2	Remove redundant foreign key constraints and joinables for messages_to_files	2025-02-14 13:32:50 -07:00
dal	743c256dbc	added in some testing work and changed some rules	2025-02-14 11:32:33 -07:00
dal	e797f24e23	bug fix and prompt updates for o series	2025-02-14 09:19:43 -07:00
dal	e68353b61d	now looking for optional database field.	2025-02-14 08:49:19 -07:00
dal	9e420c3201	hide cargo for now	2025-02-14 08:32:54 -07:00
dal	51b6d00159	message fkey error still propagating.	2025-02-14 08:32:06 -07:00
dal	da8eb26931	silent on parsing errors since we will have a ton with the optimistic parsing.	2025-02-13 16:36:04 -07:00
dal	eac2529f29	ok we are on our way there...	2025-02-13 16:28:59 -07:00
dal	3bd5516486	ok thread is being inserted	2025-02-13 16:15:09 -07:00
dal	977b5eb6de	mdc	2025-02-13 15:05:10 -07:00
dal	2d47c2c539	mdc commit	2025-02-13 14:50:24 -07:00
dal	bdeaccdca8	cursor rules	2025-02-13 13:31:53 -07:00
dal	9fc5011b75	cursor rules	2025-02-13 08:38:14 -07:00
dal	5416418955	cargo optimization for faster builds	2025-02-13 08:31:14 -07:00
dal	c6d70b62dc	ddl on query	2025-02-12 11:07:59 -07:00
dal	09ab45bbb5	cli release code	2025-02-12 09:00:02 -07:00
dal	37854342da	ok now generating descriptions ayo	2025-02-12 08:41:17 -07:00
dal	0c597e7b0f	snowflake type mapping correct	2025-02-12 08:19:38 -07:00
dal	59054cfefa	tweak to the diffing bug	2025-02-12 08:14:38 -07:00
dal	422b4c5da5	some temp fixes while we prep the new chat	2025-02-12 06:12:56 -07:00
dal	361c48fade	database_identifier during creation	2025-02-12 05:27:08 -07:00
dal	ffaa373ec3	Merge remote-tracking branch 'origin/staging' into dal/simplify-deploy-endpoint	2025-02-12 05:25:09 -07:00
dal	61b6cfeffc	database mapping correct	2025-02-12 05:22:36 -07:00
dal	c7a631de40	tweak on database from modelfiles	2025-02-12 05:04:34 -07:00
dal	2805d7ed70	implemented database name for snowflake warehouse. temp fix	2025-02-12 04:52:32 -07:00
dal	45739b73f2	get rid of unused code	2025-02-11 17:04:11 -07:00
dal	89912fed59	ITS WORKING	2025-02-11 16:57:44 -07:00
dal	29900149dd	almost there	2025-02-11 16:38:46 -07:00
dal	041859ec28	change thought_pills to thoughts	2025-02-11 15:45:05 -07:00
dal	d17cb7e49a	bulk work on deploy	2025-02-11 15:43:07 -07:00
dal	e7fedd0a59	working except for bulk in the validation	2025-02-11 15:21:53 -07:00
dal	bf24b249d4	Refactor message and thread handling with explicit UUID references	2025-02-11 12:46:21 -07:00
dal	8e8140246d	Update message transformation to include chat and message IDs	2025-02-11 12:34:06 -07:00
dal	8b96ec01fb	Refactor message transformation with new container types and UUIDs	2025-02-11 11:53:06 -07:00
dal	bf05c7f06b	Add new thread events for chat generation progress tracking	2025-02-11 11:21:57 -07:00
dal	e7b96d9bd5	make a chart card	2025-02-11 10:58:25 -07:00
dal	41a7146a8d	Add initial chat response for new thread creation	2025-02-11 10:05:20 -07:00
dal	6fcfc4fba6	ids matching for stream messages	2025-02-11 09:57:19 -07:00
dal	2376153459	ids and initial message repeat handled	2025-02-11 09:36:28 -07:00
dal	973e9b41ce	ids are set	2025-02-11 09:21:08 -07:00
dal	fcc15a0e6f	fix tool name transform path	2025-02-11 08:23:58 -07:00
dal	8940fbf3b6	using name as id for file type reasoning message	2025-02-11 08:21:32 -07:00
dal	8de08323fa	consistent message id for text stream	2025-02-11 08:10:58 -07:00
dal	bcf1ac1a65	file stream is working 👍🏼 for create file.	2025-02-11 07:49:22 -07:00
dal	afb40c90be	ok restructured the transformer to get vecs back	2025-02-11 07:40:07 -07:00
dal	90931fc029	Add support for chat routes and update thread route handling	2025-02-11 07:27:56 -07:00
dal	d75931dcb0	We did it joe	2025-02-11 07:14:06 -07:00
dal	43e2cf44f4	its working, but not sure if it's how I want it...	2025-02-10 17:09:01 -07:00
dal	61153020ba	save point	2025-02-10 16:08:08 -07:00
dal	8c6c1d83ee	still working on the darn stream	2025-02-10 14:49:22 -07:00
dal	fd65408e30	clean up to try different impl	2025-02-10 14:22:13 -07:00
dal	2593536efa	So close, just a few more tweaks to clean up stream.	2025-02-10 13:35:57 -07:00
dal	118ef9c691	ok streaming it back	2025-02-10 12:29:13 -07:00
dal	8c8372b50e	ok everything sending back except create and modify	2025-02-10 12:15:21 -07:00
dal	d0400b5226	transforms for events	2025-02-10 11:53:19 -07:00
dal	233b580e1c	data catalog search transformation	2025-02-10 11:29:08 -07:00
dal	6a67931667	message transform	2025-02-10 10:47:16 -07:00
dal	93206fcf5c	added in duration and passed back req params	2025-02-10 09:21:07 -07:00
dal	9169a1c9e8	small tweaks	2025-02-10 08:26:25 -07:00
dal	c849a22b4f	added in progress on tools	2025-02-10 08:24:56 -07:00
dal	8bd14e0ee7	added in progress on stream messages	2025-02-10 08:17:14 -07:00
dal	789b22fe1e	Improve message streaming and tool call processing ... - Enhance message streaming with more precise content and tool call handling - Add logic to only send and store meaningful assistant messages and tool calls - Prevent sending empty or redundant messages during stream processing - Improve tool call and content update tracking in agent stream method - Optimize message inclusion in recursive thread generation	2025-02-10 07:30:52 -07:00
dal	641527114c	refactor(agent): Enhance LLM request handling with improved tool call processing ... - Add support for initial non-tool response and subsequent tool-enabled processing - Implement `PendingToolCall` to manage incremental tool call updates - Update `Delta` and related types to support more flexible tool call streaming - Modify agent stream processing to handle tool calls with improved state management - Add robust handling for tool call deltas and function call arguments	2025-02-10 07:17:14 -07:00
dal	373a83efea	refactor(agent): Extract agent prompt to constant and update date ... - Move hardcoded agent prompt to a constant `AGENT_PROMPT` in the `agent_thread.rs` file - Update the prompt's date from January 27, 2025 to February 7, 2025 - Simplify thread initialization by referencing the new constant - Maintain existing prompt structure and guidelines	2025-02-07 14:18:02 -07:00
dal	4b743fe5ec	feat(agent): Add recursion depth limit to prevent infinite processing ... - Implement a maximum recursion depth of 30 for agent thread processing - Add recursion depth tracking to prevent potential infinite loops - Provide user-friendly message when maximum recursion depth is reached - Update debug logging to include current recursion depth - Modify both synchronous and streaming thread processing methods	2025-02-07 11:35:13 -07:00
dal	8b51618afd	refactor(agent): Implement recursive stream processing with improved tool execution ... - Refactor agent stream processing to use a recursive approach for handling tool calls - Enhance tool execution with more robust error handling and result tracking - Improve stream chunk processing with detailed state management - Add support for recursive thread generation based on tool call results - Implement cloning for LiteLLMClient to support stream processing tasks	2025-02-07 11:22:43 -07:00
dal	bb4e4ca9d8	refactor(ai_tools): Standardize search tool response format and requirements ... - Update search data catalog and file search tools to use consistent JSON response structure - Enforce strict response format with mandatory "results" key and comprehensive field requirements - Add explicit guidelines for result composition and handling of empty result sets - Improve response predictability and parsing reliability for AI-powered search tools	2025-02-07 11:12:08 -07:00
dal	8054bedf1a	fix(ai_tools): Update LLM request parameters and improve response handling ... - Add `stream: Some(false)` to file search and data catalog tools - Make `json_schema` optional in `ResponseFormat` serialization - Enhance logging in search file tool with debug and warning messages - Improve error context when parsing LLM JSON responses	2025-02-07 11:05:39 -07:00
dal	864257bc24	refactor(agent): Improve thread-safe tool management with Arc ... - Wrap agent tools in an Arc for safe concurrent access - Modify tool addition methods to work with Arc-wrapped HashMap - Ensure thread-safe tool registration and retrieval - Update stream processing to use Arc-cloned tools reference	2025-02-07 10:53:26 -07:00
dal	2bf27a9eda	feat(agent): Enhance agent thread processing with improved debugging and user-specific streaming ... - Add comprehensive debug logging for agent thread processing - Modify agent thread to use user ID for streaming subscription - Update stream processing to include detailed tool call and content logging - Improve error handling and visibility in stream processing - Add user context to agent thread initialization - Remove redundant tool execution handling in stream processing	2025-02-07 10:39:15 -07:00
dal	a2f3433555	refactor(tools): Implement ValueToolExecutor for generic tool output conversion ... - Add `ValueToolExecutor` to convert tool outputs to `serde_json::Value` - Introduce `IntoValueTool` trait for easy value type conversion - Update agent tool addition methods to use new value conversion mechanism - Simplify tool registration by automatically converting tool outputs - Remove previous manual boxing and type conversion logic	2025-02-07 10:15:55 -07:00
dal	2090e0b7d7	refactor(post_thread): Simplify thread creation with agent-based approach ... - Remove complex AI-driven thread generation modules - Introduce a new `AgentThreadHandler` to manage thread creation - Streamline post thread logic by delegating to agent handler - Remove deprecated SQL generation and AI-related modules - Reduce code complexity and improve maintainability	2025-02-07 09:15:58 -07:00
dal	adba6d6954	feat(data_catalog): Implement AI-powered dataset search tool ... - Add comprehensive dataset search functionality using LLM for intelligent dataset matching - Implement search across datasets with relevance ranking based on YML content - Create structured search result output with dataset metadata - Add robust error handling, logging, and parsing for search operations - Include test coverage for search result validation - Enhance tool with flexible query parameter support and detailed response messages	2025-02-07 08:08:37 -07:00
dal	372694bf1f	feat(file_search): Implement advanced AI-powered file search tool ... - Add comprehensive file search functionality using LLM for intelligent file matching - Implement search across metric and dashboard files with relevance ranking - Create structured search result output with file metadata - Add robust error handling and logging for search operations - Include test coverage for search result parsing	2025-02-07 07:47:35 -07:00
dal	94c1635a34	refactor(file_tools): Enhance file modification and creation processes ... - Implement robust line-based content modification for metric and dashboard files - Add comprehensive error handling and validation for file modifications - Improve modification tracking with detailed modification results - Optimize file processing with batch insertion and validation - Add extensive test coverage for modification and validation logic	2025-02-07 01:29:49 -07:00
dal	0e9075ca2c	Added Line Number Formatting on File outputs	2025-02-07 00:29:11 -07:00
dal	900eb28a67	removed bool on create_file tool	2025-02-06 23:54:11 -07:00
dal	711bbe899a	refactor(tools): Enhance ToolExecutor trait and file-related tools ... - Add generic Output type to ToolExecutor trait - Update file tools to use strongly-typed output structs - Modify agent and tool implementations to support generic output - Improve error handling and result reporting in file-related tools - Add more detailed status messages for file operations	2025-02-06 23:45:48 -07:00
dal	4ec6e78648	refactor(database): Update metric and dashboard file models and migrations ... - Rename file type modules from `metric_file` and `dashboard_file` to `metric_yml` and `dashboard_yml` - Modify metric files migration to use a verification enum instead of boolean - Update messages_to_files junction table with UUID primary key and additional timestamp columns - Adjust database models to support new file and message structures - Refactor file creation utility to use new model structures	2025-02-06 17:07:52 -07:00
dal	b0e40007b0	Merge branch 'staging' into dal/goat-chat	2025-02-06 16:23:12 -07:00
dal	3ec059a99e	feat(prompts): Enhance SQL generation prompt with database identifier guidance ... - Add instruction about paying attention to database identifier in SQL generation prompt - Clarify potential cross-database referencing considerations - Update SQL generation guidelines to improve clarity and flexibility	2025-02-06 16:21:53 -07:00
dal	33d5990907	feat(datasets): Add database_identifier support for dataset creation and deployment ... - Extend Dataset model and schema to include optional database_identifier field - Update dataset creation and deployment routes to handle new database_identifier parameter - Modify dataset DDL generation to use database_identifier for schema resolution when available	2025-02-06 15:18:40 -07:00
dal	c7a6e2788a	Merge branch 'staging' into dal/simplify-deploy-endpoint	2025-02-06 15:00:23 -07:00