Commit Graph

425 Commits

Author SHA1 Message Date
dal 46cf7d74fe
this is a big one... 2025-03-03 06:29:15 -07:00
dal 4b084cd725
moved user extension to the database lib 2025-02-28 14:28:00 -07:00
dal fdc4f3b2f1
builds and moved things around 2025-02-28 14:22:55 -07:00
dal 794741550d
adjust the validation 2025-02-28 13:08:27 -07:00
dal 7d75a2e7fd
moved agent logic over 2025-02-28 13:06:43 -07:00
dal 8322fdb768
separated query engine out into its own lib will make life 10x easier later 2025-02-28 12:55:28 -07:00
dal 3fec82953c
switched the way we get secrets to be simpler 2025-02-28 12:45:53 -07:00
dal 0c5768f7c0
moved a lot into their own lib to make easier to use. 2025-02-28 12:32:41 -07:00
dal ce1fb87b19
moved agent into own lib 2025-02-28 10:35:55 -07:00
dal 6604b9789e
updates for chats instead of threads 2025-02-28 09:41:44 -07:00
dal e459861c45
data catalog o3 mini 2025-02-27 14:06:07 -07:00
dal edbedd84ca
modifications for including subsets of data in requests. 2025-02-27 12:43:04 -07:00
dal f013295714
adjustments to prompt 2025-02-27 10:55:19 -07:00
dal 46b8640f8e
super agent changes 2025-02-27 08:03:33 -07:00
dal 4271de634b
oh haha needed to set the arrow version as well 2025-02-26 16:14:58 -07:00
dal add8468198
chrono set to 0.4.38 2025-02-26 16:10:49 -07:00
dal 191d86e5f4
lets try adjusting the arrow packages. 2025-02-26 15:33:33 -07:00
dal b47a03423d
changes to the search data catalog 2025-02-26 15:13:11 -07:00
dal 65ce4769b4
changed the prompts 2025-02-26 13:44:23 -07:00
dal a70389b4e8
bigquery support 2025-02-26 07:45:22 -07:00
dal ca0d8704c2
Enhance database type mapping and YAML generation
- Expand type mapping to support multiple database systems (Snowflake, PostgreSQL, BigQuery, Redshift, MySQL)
- Add function to clean quotes from generated YAML
- Improve type categorization for dimensions, measures, and unsupported types
- Modify YAML description enhancement to remove quotes
2025-02-25 21:30:18 -07:00
dal 3bfe77339a
Enhance dataset and API error handling
- Improve column deployment logic in dataset routes
- Add more detailed error reporting in CLI generate command
- Support additional Postgres credential parsing
- Add debug logging for Buster API interactions
2025-02-25 21:11:06 -07:00
dal 3d5c05f89d
match redshift with postgres 2025-02-25 20:36:56 -07:00
dal 5ac7fc2dad
working 2025-02-25 20:21:50 -07:00
dal 9c7e217077
some good logging and config tracking 2025-02-25 20:11:35 -07:00
dal 1dd765432f
Merge .cursor rules from evals branch 2025-02-25 19:38:12 -07:00
dal 0da3e9f975
changed the manager prompt 2025-02-25 19:10:49 -07:00
dal 104ce7b027
add in the changes 2025-02-25 14:09:13 -07:00
dal 5e23a322b8
create plan to break down metrics a bit more 2025-02-25 13:47:26 -07:00
dal db309ffeda
modified missing time frame and cleaned prettified the yml schemas 2025-02-25 13:12:46 -07:00
dal 71a500cacf
recursive directory structure works greate 2025-02-25 12:13:23 -07:00
dal c1f7c0d95c
Add Redshift support for credentials and column retrieval 2025-02-25 11:46:38 -07:00
dal 0d45439173
successfully init on redshift 2025-02-25 11:17:28 -07:00
dal 114355a1f2
commit this ish 2025-02-25 08:33:45 -07:00
dal d11996bbe0
things are working real nice 2025-02-24 14:59:59 -07:00
dal 4182d83339
Remove commented-out file modification tools and update file handling 2025-02-24 10:45:16 -07:00
dal 5c3f3acd6a
returning appropriately 2025-02-24 08:07:42 -07:00
dal c9099d92f7
updated propmts to try and simplify... 2025-02-24 08:02:29 -07:00
dal c0415fafe9
adjustments to prompts. 2025-02-24 07:37:53 -07:00
dal 7b013b8031
metric and dashboard agent returning effectively 2025-02-24 07:27:56 -07:00
dal 84bada0dd1
simplify agents pulling off shutdown function 2025-02-24 07:01:25 -07:00
dal 01a3915a4f
opt out working now 2025-02-24 06:59:02 -07:00
dal d8ee830c6a
ok just need to tie up the last few things 2025-02-24 06:20:16 -07:00
dal 18413f2f24
clean up the tool isntantiation 2025-02-22 11:52:05 -07:00
dal d25ccb39ef
ok some context changes and model changes 2025-02-22 11:02:57 -07:00
dal 27fd70e236
working 2025-02-21 19:25:42 -07:00
dal e1c4c6ba41
ok conditional logic good 2025-02-21 16:20:19 -07:00
dal 242f648d85
added in conditional logic 2025-02-21 16:02:28 -07:00
dal 9f1d8eff7d
ok the sub agents are working! 2025-02-21 12:44:00 -07:00
dal ddcb8c7798
added in a few more tweaks 2025-02-21 10:29:48 -07:00
dal 33718942ba
currently builds a few more tweaks 2025-02-20 14:50:59 -07:00
dal 27ee26fc0e
commiting up but broken for now 2025-02-20 12:33:48 -07:00
dal a5902cce6d
existing agent context being passed 2025-02-20 11:45:00 -07:00
dal fbcd0cf2c4
pre agent trait work 2025-02-20 11:03:34 -07:00
dal afba56b5e0
made it so tools can inherit the agent attributes 2025-02-20 08:01:54 -07:00
dal d452f4fb5f
ok adjusted the agent to handle internal memory, pass stream, etc. 2025-02-20 07:47:11 -07:00
dal 1064d5913b
added in prompts and new tools 2025-02-20 07:05:55 -07:00
dal 56d12e7da1
agents and agents as tools. 2025-02-19 15:47:14 -07:00
dal 893c4398b4
new modify tools 2025-02-19 15:15:36 -07:00
dal 57373b6f27
splitting out logic 2025-02-19 14:39:48 -07:00
dal 4d0fca47db
was missing the dataset_ids 2025-02-18 17:01:27 -07:00
dal d4e0812af2
push up changes that are helping with 2025-02-18 16:47:47 -07:00
dal 1ca1e9c736
tweak the prompts to cover isseus with div by zero 2025-02-18 14:22:21 -07:00
dal 7182222bf0
ok capture data type from valiation 2025-02-18 14:04:29 -07:00
dal 450bd8fb67
use database on snowflake columns batch 2025-02-18 13:43:57 -07:00
dal 116677c0ab
bugfix - cli missing types and deploy 2025-02-18 13:35:07 -07:00
dal 87c28fb2bf
middle of doing work on the agent prompt 2025-02-18 13:07:50 -07:00
dal 52571357ab
fix on error messages 2025-02-18 11:36:15 -07:00
dal bb34abcd4c
separate out functions for creation and validation 2025-02-18 11:16:43 -07:00
dal cf45f4eddd
some changes for the sql validation 2025-02-18 11:12:29 -07:00
dal 561c31965e
get dashboards still need to tweak the metrics dashboard rel 2025-02-18 10:22:27 -07:00
dal 7ab35b7f22
here is the fix 2025-02-18 09:26:40 -07:00
dal b03fdd7984
add up the metric get request 2025-02-18 08:52:14 -07:00
dal 7b12a536ed
change to fix datasets search stream 2025-02-18 08:20:37 -07:00
dal 81b781340c
dep db and others 2025-02-18 08:17:43 -07:00
dal 451de44532
starting testing with sampler tool 2025-02-18 07:25:13 -07:00
dal 496d2bab7e
starting to add in sample_query 2025-02-17 17:07:50 -07:00
dal a011e2d115
changes to user prompt 2025-02-17 13:59:28 -07:00
dal 387533de5d
some more tweaks 2025-02-17 11:49:04 -07:00
dal 9b1daff0be
ok basically ready for evals, need to check one more thing 2025-02-17 11:09:57 -07:00
dal bcf242824c
move user back into authed endpoint 2025-02-17 10:03:05 -07:00
dal 53b47291de
ok returning responses need to get full stream 2025-02-17 10:01:19 -07:00
dal 03a712ef14
api mostly there, few more tweaks 2025-02-17 09:34:20 -07:00
dal 2ee32bdb6d
merge conflict fix 2025-02-14 16:47:28 -07:00
dal 751a2da463
Merge branch 'staging' into big-nate/bus-939-create-new-structure-for-chats 2025-02-14 15:22:58 -08:00
dal 24673c3ca3
small todo 2025-02-14 16:11:22 -07:00
dal 854d26fbd2
added in the send user a message tool 2025-02-14 16:01:37 -07:00
dal 1765b20917
handler format looking good 2025-02-14 15:01:38 -07:00
dal 43a8a09796
Try moving user to non auth endpoint. 2025-02-14 14:44:23 -07:00
dal 02978e37e8
fix tests glob and get rid of litellm in the api 2025-02-14 14:23:41 -07:00
dal b48b350381
moved litellm made another lib 2025-02-14 14:12:31 -07:00
dal 8fedcecd43
handlers lib 2025-02-14 13:44:21 -07:00
dal a59e9a26c2
Remove redundant foreign key constraints and joinables for messages_to_files 2025-02-14 13:32:50 -07:00
dal 743c256dbc
added in some testing work and changed some rules 2025-02-14 11:32:33 -07:00
dal e797f24e23
bug fix and prompt updates for o series 2025-02-14 09:19:43 -07:00
dal e68353b61d
now looking for optional database field. 2025-02-14 08:49:19 -07:00
dal 9e420c3201
hide cargo for now 2025-02-14 08:32:54 -07:00
dal 51b6d00159
message fkey error still propagating. 2025-02-14 08:32:06 -07:00
dal da8eb26931
silent on parsing errors since we will have a ton with the optimistic parsing. 2025-02-13 16:36:04 -07:00
dal eac2529f29
ok we are on our way there... 2025-02-13 16:28:59 -07:00
dal 3bd5516486
ok thread is being inserted 2025-02-13 16:15:09 -07:00
dal 977b5eb6de
mdc 2025-02-13 15:05:10 -07:00
dal 2d47c2c539
mdc commit 2025-02-13 14:50:24 -07:00
dal bdeaccdca8
cursor rules 2025-02-13 13:31:53 -07:00
dal 9fc5011b75
cursor rules 2025-02-13 08:38:14 -07:00
dal 5416418955
cargo optimization for faster builds 2025-02-13 08:31:14 -07:00
dal c6d70b62dc
ddl on query 2025-02-12 11:07:59 -07:00
dal 09ab45bbb5
cli release code 2025-02-12 09:00:02 -07:00
dal 37854342da
ok now generating descriptions ayo 2025-02-12 08:41:17 -07:00
dal 0c597e7b0f
snowflake type mapping correct 2025-02-12 08:19:38 -07:00
dal 59054cfefa
tweak to the diffing bug 2025-02-12 08:14:38 -07:00
dal 422b4c5da5
some temp fixes while we prep the new chat 2025-02-12 06:12:56 -07:00
dal 361c48fade
database_identifier during creation 2025-02-12 05:27:08 -07:00
dal ffaa373ec3
Merge remote-tracking branch 'origin/staging' into dal/simplify-deploy-endpoint 2025-02-12 05:25:09 -07:00
dal 61b6cfeffc
database mapping correct 2025-02-12 05:22:36 -07:00
dal c7a631de40
tweak on database from modelfiles 2025-02-12 05:04:34 -07:00
dal 2805d7ed70
implemented database name for snowflake warehouse. temp fix 2025-02-12 04:52:32 -07:00
dal 45739b73f2
get rid of unused code 2025-02-11 17:04:11 -07:00
dal 89912fed59
ITS WORKING 2025-02-11 16:57:44 -07:00
dal 29900149dd
almost there 2025-02-11 16:38:46 -07:00
dal 041859ec28
change thought_pills to thoughts 2025-02-11 15:45:05 -07:00
dal d17cb7e49a
bulk work on deploy 2025-02-11 15:43:07 -07:00
dal e7fedd0a59
working except for bulk in the validation 2025-02-11 15:21:53 -07:00
dal bf24b249d4
Refactor message and thread handling with explicit UUID references 2025-02-11 12:46:21 -07:00
dal 8e8140246d
Update message transformation to include chat and message IDs 2025-02-11 12:34:06 -07:00
dal 8b96ec01fb
Refactor message transformation with new container types and UUIDs 2025-02-11 11:53:06 -07:00
dal bf05c7f06b
Add new thread events for chat generation progress tracking 2025-02-11 11:21:57 -07:00
dal e7b96d9bd5
make a chart card 2025-02-11 10:58:25 -07:00
dal 41a7146a8d
Add initial chat response for new thread creation 2025-02-11 10:05:20 -07:00
dal 6fcfc4fba6
ids matching for stream messages 2025-02-11 09:57:19 -07:00
dal 2376153459
ids and initial message repeat handled 2025-02-11 09:36:28 -07:00
dal 973e9b41ce
ids are set 2025-02-11 09:21:08 -07:00
dal fcc15a0e6f
fix tool name transform path 2025-02-11 08:23:58 -07:00
dal 8940fbf3b6
using name as id for file type reasoning message 2025-02-11 08:21:32 -07:00
dal 8de08323fa
consistent message id for text stream 2025-02-11 08:10:58 -07:00
dal bcf1ac1a65
file stream is working 👍🏼 for create file. 2025-02-11 07:49:22 -07:00
dal afb40c90be
ok restructured the transformer to get vecs back 2025-02-11 07:40:07 -07:00
dal 90931fc029
Add support for chat routes and update thread route handling 2025-02-11 07:27:56 -07:00
dal d75931dcb0
We did it joe 2025-02-11 07:14:06 -07:00
dal 43e2cf44f4
its working, but not sure if it's how I want it... 2025-02-10 17:09:01 -07:00
dal 61153020ba
save point 2025-02-10 16:08:08 -07:00
dal 8c6c1d83ee
still working on the darn stream 2025-02-10 14:49:22 -07:00
dal fd65408e30
clean up to try different impl 2025-02-10 14:22:13 -07:00
dal 2593536efa
So close, just a few more tweaks to clean up stream. 2025-02-10 13:35:57 -07:00
dal 118ef9c691
ok streaming it back 2025-02-10 12:29:13 -07:00
dal 8c8372b50e
ok everything sending back except create and modify 2025-02-10 12:15:21 -07:00
dal d0400b5226
transforms for events 2025-02-10 11:53:19 -07:00
dal 233b580e1c
data catalog search transformation 2025-02-10 11:29:08 -07:00
dal 6a67931667
message transform 2025-02-10 10:47:16 -07:00
dal 93206fcf5c
added in duration and passed back req params 2025-02-10 09:21:07 -07:00