Commit Graph

481 Commits

Author SHA1 Message Date
dal 980a786d21
fix build errors 2025-08-24 21:42:38 -06:00
dal 455888cdcd
ai sdk v4 to v5 conversion 2025-08-24 21:31:16 -06:00
dal dcf1687b50
Refactor sequential thinking tool to remove raw LLM message entries
- Removed the creation and handling of raw LLM message entries in both start and finish functions.
- Updated message entry updates to only include reasoning messages, simplifying the logic and improving clarity.
2025-08-22 16:50:55 -06:00
dal 50c9575d6f
Merge pull request #756 from buster-so/analyst-workflow-output
Enhance Analyst Workflow with Tool Integration and Output Structuring
2025-08-22 16:33:18 -06:00
dal d01259e728
Enhance Analyst Workflow with Tool Integration and Output Structuring
- Added imports for various dashboard, metrics, and report tools to the analyst workflow.
- Updated the `runAnalystWorkflow` function to return a comprehensive output, including tool call results, charts created, and summary statistics.
- Implemented logic to extract tool calls and segment messages by user requests, improving the overall workflow output structure.
2025-08-22 16:28:05 -06:00
dal fe5819efe1
Update AWS SDK dependencies and enhance metric data handling
- Upgraded '@aws-sdk/client-s3' to version 3.873.0 across multiple packages.
- Introduced caching mechanisms for metric data retrieval in the getMetricDataHandler function.
- Updated API endpoints to support report_file_id for cache lookups and data retrieval.
- Enhanced error handling and logging for cache operations.
- Refactored related components to accommodate new caching logic and parameters.
2025-08-22 12:45:05 -06:00
dal 87d3efc3c5
Merge pull request #754 from buster-so/Jacob-report-prompt-v5
Improved Prompts
2025-08-22 12:01:08 -06:00
jacob-buster f539ca2566 Improved Prompts 2025-08-22 11:59:12 -06:00
dal 21a2d3f2d7
Refactor report generation handling and UI updates
- Simplified the `GeneratingContent` component to display a static loading message.
- Updated `ReportPageController` to determine if a report is being generated based on the current message context.
- Adjusted report status handling in the delta creation process to maintain 'loading' status during streaming.
- Enhanced logic in the modify reports helper to ensure file status reflects loading during streaming and only updates to completed or failed when all edits are finalized.
- Modified database query to preserve input order for new messages during updates.
2025-08-22 10:05:07 -06:00
dal d1155e5978
Enhance metric query execution and metadata handling
- Introduced `executeMetricQuery` utility for standardized metric SQL query execution with retry logic.
- Updated `getMetricDataHandler` and metric tool execution functions to utilize the new query utility, improving error handling and result processing.
- Added metadata generation from query results to provide detailed insights into data structure.
- Refactored SQL validation to ensure only read-only queries are executed, enhancing data integrity.
2025-08-22 09:01:28 -06:00
dal 60d7bd67d1
Update modify-reports-transform-helper to display elapsed time only when all edits are complete, ensuring accurate reporting during the editing process. 2025-08-21 21:53:13 -06:00
dal 1f8cb7e8f3
Enhance SQL permission validation error messages with actionable guidance. Update tests to reflect improved error handling and specific feedback for unauthorized queries and wildcard usage. Ensure consistency in error reporting across various SQL operations. 2025-08-21 16:53:48 -06:00
dal d137cfe678
follow ups with tool result error solved for other tool calls 2025-08-21 16:20:08 -06:00
dal 93fdbd07b3
fixes on tests and stuff 2025-08-21 14:15:58 -06:00
dal 81c703a472
Update dependencies to version 4.0.1 for @trigger.dev/build, @trigger.dev/core, and @trigger.dev/sdk; enhance UUID validation in modify-reports-delta tool. 2025-08-21 13:34:26 -06:00
dal 4f7ef9525e
Add basic task examples and update SDK version in Trigger.dev documentation 2025-08-21 13:27:31 -06:00
dal bb6d932f26
Implement caching for report snapshots in modify and create reports tools 2025-08-21 12:57:12 -06:00
dal 0ac8921a8a
small prompt fix 2025-08-21 12:47:31 -06:00
dal 7b693d1c3d
streaming 2025-08-21 12:20:40 -06:00
dal 6e41a4122b
sql fixes and report streaming 2025-08-21 10:31:36 -06:00
dal 6a4da2ed57
staging changes 2025-08-21 09:21:52 -06:00
dal e3cbe674ce
sonnet 4 logging and logic 2025-08-21 09:20:48 -06:00
dal 85b121e8b0
Merge remote-tracking branch 'origin/main' into staging 2025-08-21 09:20:13 -06:00
dal 1084bfd485
add gpt5 to fallback chain on sonnet 4 2025-08-21 09:18:58 -06:00
dal dbe43df0ea
Merge remote-tracking branch 'origin/staging' into dal-fix-report-bugs 2025-08-21 09:02:19 -06:00
dal 170b65887d
Merge pull request #729 from buster-so/improved-sql-parsing
Enhance SQL permission validation to include unauthorized columns in error messages. Update permission error message creation to handle both unauthorized tables and columns. Modify SQL execution functions to validate column permissions alongside table permissions, improving feedback for users lacking access.
2025-08-21 09:02:11 -06:00
dal 84445efa60
tests passing 2025-08-21 08:58:43 -06:00
dal 3b266c07e7
better logging around fallbacks 2025-08-21 08:58:27 -06:00
dal b4e81dcefe
added opus 4.1 to fallback chain for sonnet 2025-08-21 08:50:29 -06:00
dal 5838285c81
Merge remote-tracking branch 'origin/staging' into improved-sql-parsing 2025-08-21 08:31:09 -06:00
dal 2f641e8b2d
Enhance SQL permission validation to include unauthorized columns in error messages. Update permission error message creation to handle both unauthorized tables and columns. Modify SQL execution functions to validate column permissions alongside table permissions, improving feedback for users lacking access. 2025-08-21 08:30:48 -06:00
dal 5d9c9e6a77
got rid of delta streaming 2025-08-20 16:48:13 -06:00
dal c94ceaa10a
modify metric delta close 2025-08-20 16:08:12 -06:00
dal 415010b8fc
create reports fixes 2025-08-20 13:38:38 -06:00
dal 13de96e5f7
Refactor tool call repair strategies to improve error handling and streamline repair logic. Removed unused types and consolidated strategy functions for better clarity. Updated tests to reflect changes in strategy implementations and input handling. 2025-08-20 13:11:55 -06:00
dal 2461dc0a77
bugfixes 2025-08-20 11:26:37 -06:00
dal 1cac320006
logic around reports, bug fixes, self healing, etc. 2025-08-20 10:22:35 -06:00
dal bc6782e156
test fixes 2025-08-18 23:08:41 -06:00
dal 5b5191356a
Refactor report creation and modification logic. Introduced batch update functionality for reports, improved version history management, and enhanced error handling during report updates. Adjusted task duration settings for better performance and refined file extraction logic to filter out reports and metrics appropriately. 2025-08-18 17:00:42 -06:00
dal a821af220f
analysis type router fix 2025-08-18 15:31:39 -06:00
dal 0472a5bc46
descriptions with column label formatas 2025-08-18 15:23:07 -06:00
dal 6f65e25e63
Update pnpm-lock.yaml to resolve merge conflicts and synchronize package versions, including updates to '@aws-sdk/credential-provider-web-identity' and 'platejs' dependencies. 2025-08-18 15:19:01 -06:00
dal f9eece00d6
merge staging in 2025-08-18 14:39:59 -06:00
dal 1d107f4125
lots of changes 2025-08-18 12:43:28 -06:00
dal e0d03c6aab
Refactor data metadata handling and improve report creation logic. Updated SimpleType enum for better serialization, removed unused createDataMetadata function, and integrated createMetadataFromResults for data processing. Enhanced report creation with version history management and improved error handling in report updates. 2025-08-18 11:59:56 -06:00
dal c7627b00d6
identify assumptions fixed 2025-08-18 11:24:21 -06:00
dal b3cfa35430
for the most part things are looking good 2025-08-18 11:20:06 -06:00
dal 35e0fc27d7
done tool fix 2025-08-18 10:43:15 -06:00
dal 6d1a0b6c86
todos cleanedup 2025-08-18 10:31:52 -06:00
dal 6b171aae2e
build error map the reasoning message better in web 2025-08-18 10:16:59 -06:00
dal 9589ca198b
upgrade and fixes 2025-08-18 08:07:13 -06:00
dal 0cf763d9a3
type error on fallback 2025-08-18 07:27:31 -06:00
dal a63e8da785
Refactor sequential thinking tool to use toolCallId for message entries and improve error handling 2025-08-18 07:19:34 -06:00
dal 95b67529ad
sequential thinking tie off the request. 2025-08-15 19:10:45 -06:00
dal 4c042a34fa
tool result entry 2025-08-15 18:51:10 -06:00
dal e0ea7ce616
normalizer fo optimistic json parsing and file selection logic 2025-08-15 18:45:59 -06:00
dal d11c62446a
ok metrics are working again 2025-08-15 16:18:14 -06:00
dal 3f3b9233f3
ok need to debug dash and metrics 2025-08-15 15:57:35 -06:00
dal c476aebd47
tools updating properly 2025-08-15 15:24:05 -06:00
dal e2757c1ad0
now sequential thinkgin 2025-08-15 15:04:03 -06:00
dal 2059988494
sequential thinking 2025-08-15 15:03:58 -06:00
dal 37aa14c43b
respond without assetstool restuls 2025-08-15 14:58:46 -06:00
dal cdb7e4f17e
message user clarifying 2025-08-15 14:48:41 -06:00
dal 641765b430
flip done tool stuff 2025-08-15 14:48:18 -06:00
dal 940ab3f59f
done tool state and context 2025-08-15 14:44:17 -06:00
dal 597f1b56a8
done tool shift in params 2025-08-14 14:39:51 -06:00
dal 82516e4fbb
Update reasoning messages to improve clarity and consistency across tools
- Changed the wording of elapsed time in reasoning messages from "min" to "minutes" for better readability.
- Updated the final reasoning message format to specify "Reasoned for" instead of "Total workflow time," enhancing user understanding of the output.

These changes contribute to a more user-friendly experience and maintain consistency in messaging across different tools.
2025-08-14 14:09:53 -06:00
dal 24e91b2ac7
lots of changes for the entries updates 2025-08-14 13:49:34 -06:00
dal 35623ad987
Integrate access controls with metric file downloads
- Added permission checks to metric file download handler
- Added permission checks to export-metric-data trigger task
- Created comprehensive tests for access control integration
- Updated AssetType enums to include report_file
- Resolved export conflicts in server-shared package
- Fixed AI package imports for new getPermissionedDatasets API
2025-08-13 14:25:41 -06:00
dal ccc27abaee
Enhance tool state management and reasoning entries across various tools
- Introduced start time tracking for tool operations in create, modify, and report tools to improve performance monitoring.
- Updated reasoning entries to include elapsed time for completed operations, enhancing user feedback.
- Refactored tool logic to ensure consistent handling of file statuses and improved clarity in reasoning messages.
- Enhanced logging for better traceability during tool execution.

These changes improve the overall user experience and maintainability of the toolset.
2025-08-13 14:19:32 -06:00
dal ebe496df87
Merge access-controls branch and resolve conflicts
- Combined asset type enums from both branches
- Merged all database query exports
- Integrated access-controls package into server-shared
- Resolved conflicts in AI package instructions
2025-08-13 14:15:20 -06:00
dal d02d809e59
migration, optimization on entry querires, etc. 2025-08-13 11:50:56 -06:00
dal abc070449b
update the reasoning entries for all of hte tools 2025-08-13 11:04:37 -06:00
dal dab0bce7d2
Refactor tool imports and enhance naming consistency in Think and Prep Agent
- Updated import statements for communication and database tools to improve clarity and organization.
- Introduced constants for tool names in the `execute-sql` and `sequential-thinking-tool` modules to ensure consistent usage across the codebase.
- Enhanced the `createThinkAndPrepAgent` function to utilize these constants, improving maintainability and readability.

These changes streamline the integration of tools within the Think and Prep Agent, enhancing overall code organization.
2025-08-13 10:52:28 -06:00
dal 3e1181c121
more type safety 2025-08-13 10:49:35 -06:00
dal 8299e47e4e
more migration, streaming, type safety, etc 2025-08-13 10:48:07 -06:00
dal eb14e26972
dashboard helpers and tools 2025-08-12 23:26:46 -06:00
dal d9e6c3dee2
done tool no overwrite 2025-08-12 23:23:35 -06:00
dal 6c989b7c25
Refactor tool names and enhance context handling in AnalystAgent
- Updated tool name constants for visualization and communication tools to improve clarity and consistency.
- Modified the AnalystAgent to utilize these constants, ensuring better context handling during tool calls.
- Enhanced the STOP_CONDITIONS to reference the DONE_TOOL_NAME constant, improving maintainability.

These changes streamline the integration of tools within the AnalystAgent, enhancing overall code organization and readability.
2025-08-12 23:05:45 -06:00
dal 0f0a5ed7d1
fix prompts of dashboard and metric tools 2025-08-12 22:42:21 -06:00
dal 5d2631b848
Enhance agent streaming and logging in Analyst and Think and Prep steps
- Added consumption of text streams in both `runAnalystAgentStep` and `runThinkAndPrepAgentStep` to ensure continuous processing of agent responses.
- Introduced detailed logging at various stages of the agent's execution to improve traceability and debugging.
- These changes enhance the robustness of the agent workflow and provide better insights during execution.
2025-08-12 21:47:09 -06:00
dal 855e7b1a55
Integrate dataset handling into Analyst and Think and Prep agents
- Added support for fetching and managing user-specific datasets in the `analystAgentTask`, enhancing the context available for processing.
- Updated the `AnalystAgent` and `ThinkAndPrepAgent` schemas to include datasets, ensuring they are passed correctly in system messages.
- Implemented error handling for dataset retrieval to prevent workflow interruptions.
- Adjusted integration tests to accommodate the new datasets structure, ensuring comprehensive coverage.

These changes improve the agents' ability to utilize relevant datasets, enhancing their functionality and user experience.
2025-08-12 19:31:25 -06:00
dal cc6c407023
Enhance TODO creation process with streaming support
- Introduced a new streaming mechanism for generating TODO lists, allowing for real-time updates and improved user experience.
- Added context handling for datasets in both `AnalystAgent` and `ThinkAndPrepAgent`, ensuring relevant data is included in system messages.
- Implemented new helper functions for managing TODO state and reasoning messages, improving code organization and clarity.
- Updated integration tests to validate the new streaming functionality and ensure consistent message roles.

These changes significantly enhance the functionality and maintainability of the TODO creation process within the agent workflow.
2025-08-12 18:32:56 -06:00
dal e52c0c7d72
move sequential thinking away from old inherited context 2025-08-12 16:15:37 -06:00
dal 0b8f8665d6
Refactor agent steps and message roles
- Removed unused `steps` array from `createThinkAndPrepAgent` function to simplify the code.
- Updated message role from 'assistant' to 'user' in `create-todos-step` for better context alignment.
- Adjusted `valuesMessage` role in `extract-values-search-step` to 'user' when extracted values are present, enhancing message clarity.

These changes improve code clarity and ensure consistent message roles across agent steps.
2025-08-12 16:13:41 -06:00
dal a7ced93c6e
move to newer braintrust version 2025-08-12 16:06:00 -06:00
dal 1d0d312ff3
lots of tests passing 2025-08-12 15:54:46 -06:00
dal da4f3605cc
Refactor prompt loading and streamline agent steps
- Replaced file system reads with direct imports of prompt text files in various agent and step files to improve performance and reduce complexity.
- Updated the `runDocsAgentStep` and `runDocsAgentWorkflow` functions to return `void` instead of structured outputs, simplifying their interfaces.
- Enhanced test cases to validate prompt loading without relying on file system checks, ensuring faster and more reliable tests.
- Cleaned up unused imports and optimized code structure across multiple files.

These changes aim to enhance code clarity, maintainability, and performance in the agent workflow and related components.
2025-08-12 14:57:23 -06:00
dal 8c27a3dfff
Merge remote-tracking branch 'origin/staging' into dal/upgrade-to-ai-sdk-v5 2025-08-12 12:53:48 -06:00
dal c6a28e39d5
migration changes 2025-08-12 12:44:15 -06:00
dal 79103376f1
more migratsion 2025-08-12 12:30:38 -06:00
dal 7e6e406727
more changes 2025-08-12 12:10:21 -06:00
dal 8f58ff84de
lots of migration and report tooling 2025-08-12 12:08:30 -06:00
dal 4871f49f59
Refactor identify assumptions step and related tests
- Updated type imports from `CoreMessage` to `ModelMessage` for consistency across the identify assumptions step.
- Changed argument names from `args` to `input` and `result` to `output` in the integration tests to align with the new structure.
- Removed legacy step export for `identifyAssumptionsStepLegacy` to clean up the codebase.
- Adjusted the reporting tools to import `StatusSchema` from the correct path.
- Deleted outdated test files and helper functions related to the docs agent workflow to streamline the project structure.

These changes improve code clarity and maintainability while ensuring the integration tests reflect the latest design patterns.
2025-08-12 11:58:15 -06:00
dal 299efd1c13
format follow up messages 2025-08-12 11:50:29 -06:00
dal 4a241ce419
repository tree cleanup 2025-08-12 11:46:15 -06:00
dal 9052bc6251
build issues cleaned up 2025-08-12 11:43:54 -06:00
dal cf3dc3387b
modify metrics finish 2025-08-12 11:33:39 -06:00
dal eb68b4edff
flag chat step clean 2025-08-12 11:33:01 -06:00
dal 72150c2ee1
clean bar line tests 2025-08-12 11:32:28 -06:00