Commit Graph

748 Commits

Author SHA1 Message Date
dal d052f56f86
execute sql and sequential tests 2025-08-07 22:21:20 -06:00
dal ca2d3e940c
Refactor SQL execution tools to improve code readability and maintainability. Consolidate function parameters into single lines and enhance error handling in execution results. Update imports for consistency across files. 2025-08-07 22:10:11 -06:00
dal ee99a835c3
Refactor Analyst and Think-and-Prep agents to enforce required messageId field in options schema. Update tool creation logic to streamline context handling and enhance error reporting. Introduce new execute-sql tool with improved state management and SQL execution capabilities, including delta processing and message updates. Remove deprecated execute-sql functionality and related tests. 2025-08-07 22:09:58 -06:00
Nate Kelley 064bc3e9c9
use client updates 2025-08-07 22:04:50 -06:00
dal affa91ce4f
done with communication tools 2025-08-07 21:38:43 -06:00
dal f3436f7a04
Remove deprecated dashboard and metrics tools, including associated tests. Refactor the create and modify dashboard/metrics execution logic to streamline processing and enhance error handling. Update schemas and validation logic to ensure consistency across tools. 2025-08-07 20:36:48 -06:00
Nate Kelley b6df224590
Merge pull request #677 from buster-so/big-nate-bus-1647-make-report-top-level-button
Big nate bus 1647 make report top level button
2025-08-07 17:32:31 -06:00
dal ead86c5d39
Refactor agent tools to enhance error handling and state management. Update healing message structure in Analyst and Think-and-Prep agents to provide more detailed tool availability information. Introduce state management for streaming in Modify and Create dashboards/metrics tools, improving database interaction and processing feedback. Remove deprecated tools and streamline tool creation processes. 2025-08-07 17:31:13 -06:00
dal 8987ca17a1
parallelToolCalls 2025-08-07 17:26:47 -06:00
Nate Kelley 0969a1cbd3
Merge branch 'staging' into cursor/add-report-menu-options-and-stub-functions-e636 2025-08-07 17:22:18 -06:00
Nate Kelley 216e610aa8
Added some additional safe parse element stuff 2025-08-07 17:21:38 -06:00
dal 8c8d1f37cc
big migration of tools 2025-08-07 17:10:24 -06:00
Nate Kelley 75950ae108
super nested list items 2025-08-07 17:01:45 -06:00
Nate Kelley 7a45e20903
Add more error handling for get report 2025-08-07 16:42:04 -06:00
dal 468cf44cca
done tool 2025-08-07 16:36:01 -06:00
Nate Kelley 04121ac987
report version handler 2025-08-07 16:17:22 -06:00
dal 91290530ba
tons of changes 2025-08-07 16:09:45 -06:00
dal 8e624a2c50
fixing migrations 2025-08-07 15:57:01 -06:00
dal be13ce221d
think and prep minimal effort 2025-08-07 14:58:59 -06:00
Nate Kelley 06aa5a8874
Update build 2025-08-07 14:15:25 -06:00
Nate Kelley 4006852efa
Add comment to content 2025-08-07 14:12:32 -06:00
Nate Kelley 1ef2983d15
Merge branch 'staging' into big-nate-bus-1617-create-report-page-and-file-page 2025-08-07 14:08:59 -06:00
Nate Kelley 09c96ab4f9
update agents 2025-08-07 14:07:20 -06:00
Nate Kelley 40a44cf1f9
Merge branch 'staging' into dallin-bus-1589-create-and-modify-report-tools 2025-08-07 14:05:44 -06:00
Nate Kelley 12d060cf58
Merge branch 'staging' into big-nate-bus-1617-create-report-page-and-file-page 2025-08-07 12:51:57 -06:00
Nate Kelley 6fc8d70b45
Fixed toolbar button 2025-08-07 12:44:46 -06:00
dal 290b698807
temp 1 2025-08-07 12:27:59 -06:00
dal 5bc3feb6f7
no temp 2025-08-07 12:23:15 -06:00
dal 9cafd4e0ff
remove max tokens 2025-08-07 12:22:16 -06:00
dal 92c4c1e257
Update AI package to use GPT-5 model and add OpenAI SDK dependency 2025-08-07 11:20:55 -06:00
dal 07eb5aa0c9
ok going to make tools follow factory pattern and prepping to move chunk processor to be tool specific 2025-08-07 09:58:28 -06:00
dal a065612deb
Refactor generateChatTitle function to improve title generation and database updates. Introduce helper functions for LLM title generation and database record updates, enhancing code clarity and maintainability. 2025-08-06 22:58:25 -06:00
dal 5370b8cbf6
generate cfhat title 2025-08-06 22:56:27 -06:00
dal 1d545a009c
healing messages 2025-08-06 17:57:04 -06:00
dal aaae50a32f
remove useless tests 2025-08-06 17:21:50 -06:00
dal 218bdf8eb3
Refactor Docs Agent to include additional context parameters and streamline SQL execution. Introduce user, chat, data source, organization, and optional message IDs in the DocsAgentOptions schema. Update createDocsAgent function to utilize the new context structure. Remove obsolete parseStreamingArgs function from execute-sql-docs-agent as AI SDK v5 handles streaming parsing internally. 2025-08-06 17:10:25 -06:00
dal 04ae594d3a
no need to have extra tool for tool call repair 2025-08-06 16:57:06 -06:00
dal 2b5efe790e
repiar tool try catch errors. 2025-08-06 16:52:21 -06:00
dal d211a2cd25
tons of ai sdk v5 changes 2025-08-06 16:52:05 -06:00
dal 74400c6b9d
Enhance analyst agent integration by adding user and organization context. Update the analyst agent to include additional parameters for user and organization IDs, and refactor tool integration to utilize new dashboard and metrics functions. Remove unused context injection helper to streamline the codebase. 2025-08-06 14:31:37 -06:00
dal f694c534c7
Refactor analyst agent tools integration and SQL execution context. Update the analyst agent to utilize new tool functions for metrics and dashboards, and modify SQL execution to accept context directly from the analyst agent options, enhancing clarity and maintainability. 2025-08-06 14:31:30 -06:00
dal 6b72213992
Update dependencies to stable versions and refactor analyst agent context. Replace beta versions with specific stable versions in pnpm-lock and package.json. Adjust context handling in various files to improve clarity and maintainability. Remove unused DocsAgentContext and related schemas. 2025-08-06 11:47:12 -06:00
dal 11c071ffe6
Refactor retry logic in analyst and think-and-prep steps to remove unnecessary error handling and improve healing strategy. Update tests to reflect changes in retry behavior and remove obsolete tests related to network error handling. 2025-08-05 22:56:02 -06:00
dal f17d81ba30
migration 2025-08-05 22:11:48 -06:00
dal a2d90f01a7
ai fallback on ai sdk v5 2025-08-05 18:24:32 -06:00
Nate Kelley 9ba4750a65
Adjust add metric modal 2025-08-05 17:05:27 -06:00
dal 69209e086c
Refactor edit reports functionality to support sequential edit operations with improved error handling and user feedback. Update schemas to include detailed operation results, including duration and error messages, enhancing overall report content management. 2025-08-05 14:45:55 -06:00
dal ba1da07473
Add new report content manipulation functions
Introduce 'replace-report-content' and 'append-report-content' exports to enhance report content management capabilities, allowing for more flexible report updates and modifications.
2025-08-05 14:30:22 -06:00
dal 2b926c3e91
Refactor report creation tool to support multiple report files with enhanced validation and error handling. Update schemas and processing logic to accommodate markdown content, ensuring robust file management and improved user feedback during report generation. 2025-08-05 14:10:09 -06:00
Nate Kelley 8e31d18066
Add markdown conversion function 2025-08-05 13:40:16 -06:00
dal a26242c46d
Enhance report handling by integrating markdown to PlateJS conversion in the report retrieval process, improving content formatting and error handling. Update report update schema to accept string content for markdown streaming. 2025-08-05 12:02:40 -06:00
dal b8ad52cf28
change the schema content to be text for markdown streaming 2025-08-05 11:38:43 -06:00
dal bb07af8cbd
route to different think and prep based on the context from the router 2025-08-05 11:15:59 -06:00
dal 5219cc0004
Enhance report generation capabilities by adding new report creation and editing tools, updating agent instructions to include report generation, and refining the analyst agent's workflow for improved narrative and analysis integration. 2025-08-05 11:09:55 -06:00
dal 03ccc51b5f
Refactor analysis type router to use a dedicated prompt formatting function and clean up code structure 2025-08-05 11:02:45 -06:00
dal d63aa94011
Implement analysis router enhancements and optimize report tools 2025-08-05 10:47:25 -06:00
dal db69b8bce5
Added in the analysis router using sonnet4 2025-08-05 10:47:05 -06:00
jacob-buster 0f78400dc4 Adding Router and Two Prompts 2025-08-05 10:28:19 -06:00
dal d55ce0db9c
Merge remote-tracking branch 'origin/staging' into dallin-bus-1589-create-and-modify-report-tools 2025-08-05 10:17:35 -06:00
Nate Kelley 1ef0d18c61
Report playground updates for fixed toolbar 2025-08-05 10:15:22 -06:00
dal fcbe1838a1
migrating over to sdk v5 2025-08-05 09:40:05 -06:00
dal 5883fc8762
migrating over the agent 2025-08-05 09:39:56 -06:00
dal 9214075cad
analyst agent is clean 2025-08-05 00:54:23 -06:00
Nate Kelley 44787f5478
Add additional asset queries 2025-08-04 22:13:09 -06:00
Nate Kelley 124523ade9
add a version number to reports 2025-08-04 21:37:23 -06:00
Nate Kelley 4a6c36c4b0
update report version logic 2025-08-04 21:10:03 -06:00
Nate Kelley 43af5fdb4d
add a fix for broken migrate 2025-08-04 20:45:30 -06:00
Nate Kelley 4196b8bcd8
type safe create list by date 2025-08-04 19:15:40 -06:00
Nate Kelley c6834bdfeb
update 2025-08-04 18:20:06 -06:00
Nate Kelley ffeee17365
move enum types 2025-08-04 18:04:32 -06:00
Nate Kelley 87ea87e963
collection and assets queries 2025-08-04 16:45:49 -06:00
jacob-buster ab441d17cb Improved Report Builder Prompt 2025-08-04 15:33:33 -06:00
Nate Kelley 1a955d786b
Get report 2025-08-04 15:25:22 -06:00
Nate Kelley b3b759bd26
addded collection query 2025-08-04 15:20:15 -06:00
Nate Kelley ddff671040
Update get report 2025-08-04 15:13:21 -06:00
Nate Kelley a3198003a3
get report 2025-08-04 15:05:18 -06:00
Nate Kelley 5f6524581b
created list database query 2025-08-04 14:21:49 -06:00
Nate Kelley aae819e151
create new schema for reports 2025-08-04 14:03:52 -06:00
Nate Kelley 1eb7201d5e
fix broken list type 2025-08-04 11:04:12 -06:00
Nate Kelley 75daab7f98
fix broken uni tests 2025-08-04 10:57:26 -06:00
Nate Kelley fad6670e83
fix type assertion
added safe guards around report_fule

pass generics through

fix list pass throughs
2025-08-04 10:06:59 -06:00
Nate Kelley 46f812d823
add linking 2025-08-03 00:01:21 -06:00
Nate Kelley 08d7014725
report asset layout 2025-08-02 23:47:27 -06:00
Nate Kelley 962b4edd8d
make list column more type safe 2025-08-02 23:08:28 -06:00
Nate Kelley 8eb1b276fd
update server type 2025-08-02 22:43:01 -06:00
Nate Kelley 55b66d866d
Part 1 of adding report to front end 2025-08-02 22:35:20 -06:00
Nate Kelley 3883248d8b
create report items container 2025-08-02 22:24:39 -06:00
Nate Kelley cf5d549af3
stubbed in report lists 2025-08-02 21:48:15 -06:00
Nate Kelley 7cf8b10c07
Added void type 2025-08-02 21:30:26 -06:00
Nate Kelley a4f960ff13
Update scheams for get list 2025-08-02 20:35:34 -06:00
Nate Kelley 7b3975c4ae
update schemas 2025-08-02 20:15:48 -06:00
Nate Kelley 13d814e980
Merge branch 'staging' into devin/BUS-1605-1754181219 2025-08-02 19:32:58 -06:00
Devin AI 884f5b7392 fix: use z.any() type casting to avoid TypeScript inference limits
- Replace ReportElementsSchema with z.any() cast to ReportElements type
- Avoid complex Zod schema inference that exceeds TypeScript serialization limits
- Maintain type safety through explicit type annotations while fixing CI compilation

Co-Authored-By: nate@buster.so <nate@buster.so>
2025-08-03 01:28:11 +00:00
Devin AI c3657493f3 fix: restructure report schemas to avoid TypeScript inference limits
- Use BaseReportSchema.extend() pattern to break down complex type inference
- Separate content field extension to avoid 'type exceeds maximum length' errors
- Maintain same API contract while fixing CI compilation issues

Co-Authored-By: nate@buster.so <nate@buster.so>
2025-08-03 01:26:50 +00:00
Devin AI abc801f10b feat: implement reports API endpoints for BUS-1605
- Add Report schema extending ReportElements with metadata fields
- Create GET /api/v2/reports endpoint with pagination
- Create PUT /api/v2/reports/:id endpoint for updates
- Use stubbed data responses following established patterns
- Follow modular route structure and Zod-first validation

Co-Authored-By: nate@buster.so <nate@buster.so>
2025-08-03 00:38:50 +00:00
Nate Kelley 5a501d9630
Finalized floating toolbars 2025-08-02 17:20:37 -06:00
Nate Kelley f51a599f3d
finalized highlighter 2025-08-02 17:12:33 -06:00
Nate Kelley 6502d9487d
finalized toolist 2025-08-02 16:49:01 -06:00
Nate Kelley 3d726438fb
custom colors in dropdown 2025-08-02 16:22:17 -06:00
Nate Kelley 0778c8db4e
update elements to support date 2025-08-02 15:49:52 -06:00
Nate Kelley b8b39b3d93
finalized equation 2025-08-02 14:04:37 -06:00
Nate Kelley 1f8cdd1677
media embed element 2025-08-02 13:16:06 -06:00
Nate Kelley 76c87fb47c
update nodes 2025-08-02 11:54:42 -06:00
Nate Kelley a406e46ee8
Add additional components 2025-08-01 21:12:59 -06:00
Nate Kelley 2c9abed9bc
Update list dynamics 2025-08-01 20:33:23 -06:00
jacob-buster 65a1780b2c Further Reporting Improvements 2025-08-01 13:31:03 -06:00
dal f17df330d6
catch all for jacob testing 2025-07-31 15:34:27 -06:00
dal 14f34a7b41
Refactor report tools to include runtime context in parameters for create and edit functions 2025-07-31 15:30:32 -06:00
jacob-buster b17cc4695f Initial Report Builder Prompts 2025-07-30 12:22:50 -06:00
Nate Kelley cff68bd6ff
add suspense back in 2025-07-30 10:54:04 -06:00
dal 0450b8c350
fallback and the analyst agent 2025-07-29 22:07:11 -06:00
dal 81ebcc67ca
fallback and analyst agent changes 2025-07-29 21:35:01 -06:00
dal bfee540c5b
starting migration to ai sdk 5 2025-07-29 20:57:22 -06:00
dal 2f8622e5bb
grep search getting me? 2025-07-29 20:14:20 -06:00
Nate Kelley 3fba54a26c
Merge pull request #646 from buster-so/big-nate-bus-1520-make-report-component
Big nate bus 1520 make report component
2025-07-29 16:50:04 -06:00
dal a6ea5bef71
switched the tools to use commands instead of scripts where possible 2025-07-29 16:05:47 -06:00
Nate Kelley d46688bc5b
Added additional plugins 2025-07-29 15:48:01 -06:00
Nate Kelley be3e8b7adf
add a common markdown parser to server 2025-07-29 14:57:19 -06:00
dal f2a8388b86
feat: enhance repository tree output with current directory information
- Added functionality to retrieve and prepend the current working directory to the repository tree output, improving context for users.
- Updated runtime context to store the modified tree structure with location information.
- Removed outdated integration tests and streamlined the test suite for better maintainability.

This update enhances the usability of the repository tree feature by providing clearer context during execution.
2025-07-29 14:48:18 -06:00
dal 3b1354ddff
refactor: enhance docs agent execution with abort handling and improved error management
- Introduced an AbortController to manage idle tool execution, allowing for graceful aborting of the documentation process.
- Moved tracking variables outside the try block for better state management.
- Updated error handling to gracefully manage abort scenarios, ensuring clear logging and returning final state information.
- Adjusted integration tests to reflect changes in the docs agent workflow, improving overall robustness and reliability.

This update enhances the responsiveness of the docs agent during execution and improves error handling for better user experience.
2025-07-29 14:32:31 -06:00
dal b31f856c3b
refactor: enhance file tools with sandbox execution and error handling improvements
- Updated file tools to generate CommonJS code for sandbox execution, improving robustness and flexibility.
- Refactored bash-execute-tool, create-files-tool, delete-files-tool, edit-files-tool, grep-search-tool, ls-files-tool, and read-files-tool to handle command arguments as JSON, enhancing error handling and output consistency.
- Improved integration tests to validate new execution patterns and error scenarios, ensuring comprehensive coverage across all tools.
- Enhanced error messages for better clarity during execution failures.

This update streamlines the execution process and enhances the overall reliability of file tools.
2025-07-29 14:21:13 -06:00
jacob-buster 4eb7f09e73 Merge remote-tracking branch 'origin/staging' into dallin-bus-1589-create-and-modify-report-tools 2025-07-29 14:00:14 -06:00
Nate Kelley b6a8fa9eac
Update report-elements.ts 2025-07-29 13:59:19 -06:00
Nate Kelley c0a12cad88
Merge pull request #643 from buster-so/big-nate-bus-1520-make-report-component
Big nate bus 1520 make report component
2025-07-29 13:31:16 -06:00
Nate Kelley 991fbc799f
Update example-markdown.md 2025-07-29 13:30:35 -06:00
Nate Kelley 2c250f0a02
validation updates 2025-07-29 13:26:25 -06:00
Nate Kelley 7f328f39bf
make draggable blocks better 2025-07-29 12:47:09 -06:00
dal 47f413e111
fix: update access-controls tests for new cache structure
Updated dataset permission tests to expect the full DatasetAccessResult
object instead of just a boolean value in cache operations. This aligns
with the PR feedback to cache the complete access result including
accessPath and userRole.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-29 12:29:15 -06:00
dal 273fbc36c4
fix: address non-critical PR review comments
- Optimized N+1 query in get-permissioned-datasets.ts using inArray for batch lookup
- Removed unused bulkRemoveAssetPermissions import
- Fixed import organization in find-user-by-email.ts
- Updated CLAUDE.md to reflect tests are written and fixed API example
- Clarified TODO comment in lookup.ts to prevent potential infinite recursion

These are style and performance improvements that don't affect functionality.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-29 12:29:02 -06:00
dal 2e04af1785
fix: address additional critical PR review comments
- Fixed permission hierarchy: full_access (5) now correctly ranks higher than viewer (3)
- Removed 'querier' role from admin permission check as it was too permissive
- Added organizationId parameter to dashboard access checks to prevent unauthorized access
- Fixed public dashboard expiry date check to verify dates are in the future
- Added cycle detection for collection permissions to prevent infinite recursion
- Fixed bulk remove permissions to correctly filter by identityIds array
- Updated date comparison to use ISO string format for PostgreSQL timestamp columns

These fixes address critical security and logic issues identified in the PR review.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-29 12:28:58 -06:00
dal d078830a18
fix: address PR review comments for access control migration
- Fixed AssetTypeSchema to include all active asset types (excluding deprecated 'metric' and 'dashboard')
- Added missing 'restricted_querier' role to UserOrganizationRole type
- Fixed dataset access caching to store full result object including accessPath and userRole
- Updated count query to use SQL COUNT for better performance
- Fixed IdentityType consistency across dataset permissions
- Removed unused 'ne' import from list-asset-permissions.ts
- Updated comments to correctly reference 6 access paths instead of 5

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-29 12:28:52 -06:00
Nate Kelley ae2b21dcd9
update server markdown to platejs 2025-07-29 10:53:24 -06:00
dal 54c7843b15
refactor: convert file-tools integration tests to concurrent execution
- Update all 7 file-tools integration tests to use concurrent execution
- Create individual sandboxes per test instead of shared beforeAll/afterAll
- Use try/finally blocks for proper sandbox cleanup
- Add 65-second timeouts to accommodate sandbox operations
- Replace it.skipIf pattern with (hasApiKey ? it.concurrent : it.concurrent.skip)
- Improves test performance by enabling parallel execution

Affected tools:
- bash-tool
- create-files-tool
- delete-files-tool
- edit-files-tool
- grep-search-tool
- ls-files-tool
- read-files-tool

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-29 09:29:20 -06:00
dal 60bc1d37a8
Revert "Revert "Add createReports and editReports tools to analyst-agent""
This reverts commit 67c2eea1f1.
2025-07-29 09:13:29 -06:00
dal 67c2eea1f1
Revert "Add createReports and editReports tools to analyst-agent"
This reverts commit 351689f93b.
2025-07-29 09:06:27 -06:00
dal 351689f93b
Add createReports and editReports tools to analyst-agent 2025-07-29 08:04:48 -06:00
dal 6d36edeeb2
moving tools over 2025-07-29 07:39:09 -06:00
Nate Kelley ad53f0ffe1
update code blocs 2025-07-28 22:19:11 -06:00
Nate Kelley 0ac9db4bf1
Added additional plugins 2025-07-28 20:14:37 -06:00
Nate Kelley d6ff3f8bcb
Add component level typesafety 2025-07-28 18:57:46 -06:00
dal ed9ab33b35
feat: enhance file tools to support base64 encoding for command arguments
- Updated bash-execute-script, create-files-script, edit-files-script, and grep-search-script to handle base64 encoded JSON arguments, improving robustness against data corruption.
- Refactored corresponding tool scripts to encode command parameters as base64 before execution.
- Enhanced integration tests to validate the new base64 encoding functionality across various file tools.
2025-07-28 16:55:52 -06:00
dal 3b706a73b3
refactor: streamline file tool scripts and enhance error handling
- Removed sequential test execution settings from vitest configuration to improve performance.
- Updated bash-execute-script to handle missing arguments and improved error handling for JSON parsing.
- Refactored create-files-tool to process file creation sequentially, enhancing directory management and error reporting.
- Enhanced read-files-tool to return structured error messages when no file paths are provided.
- Updated grep-search-tool to accept raw ripgrep commands, simplifying the command structure and improving output handling.
- Removed outdated test files and integrated new test cases for improved coverage and validation across file tools.
2025-07-28 16:22:12 -06:00
dal a41d5c944b
feat: implement ls-files functionality with comprehensive tests
- Introduced the `ls-files-script` module to handle file listing with various options (detailed, all, recursive, human-readable).
- Added integration tests for the `ls-files-script` to validate functionality across different scenarios, including handling of hidden files and non-existent paths.
- Removed the previous `ls-files-tool` integration tests to streamline the testing process and focus on the new implementation.
- Updated the `ls-files-tool` to utilize the new `ls-files-script` for execution and code generation.
- Enhanced error handling and output parsing for improved robustness.
2025-07-28 14:57:05 -06:00
dal 05c309b0c1
refactor: convert create-files-tool to script pattern
- Rename create-file-functions.ts to create-files-script.ts
- Implement script pattern matching ls-files-tool structure
- Update create-file-tool.ts to execute script via sandbox
- Add comprehensive unit tests for script functionality
- Add integration tests for script execution
- Update existing tests to work with new pattern

The create-files-tool now follows the established script pattern where
the script handles the core file creation logic and the tool serves as
a medium that executes the script in a sandboxed environment.

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-28 13:54:03 -06:00
dal 786e4be791
feat: add integration tests for file tools and enhance todo list functionality
- Introduced integration tests for various file tools including bash execution, file creation, deletion, editing, and listing.
- Enhanced the check-off todo list tool to support multiple items and improved error handling for non-existent tasks.
- Updated test cases to cover edge scenarios and ensure robust validation across all tools.
- Increased timeout for the docs agent workflow to accommodate longer-running tests.
2025-07-28 12:41:07 -06:00
dal 2f4aeba817
feat: enhance documentation and testing capabilities for docs agent workflow
- Added section in CLAUDE.md for direct database access during integration testing.
- Updated `maxSteps` in `docs-agent` to allow for more complex tasks.
- Improved validation in `docs-agent-context` for sandbox instances.
- Enhanced `create-docs-todos` step to handle todos more effectively.
- Introduced comprehensive integration tests for the docs agent workflow, covering various scenarios and edge cases.
- Added test helpers for creating mock dbt projects and managing sandboxes.
- Implemented error handling and logging improvements in the workflow execution process.
2025-07-28 11:56:59 -06:00
jacob-buster ae0c4f048d Fixes for the filter tool + changes for data existence 2025-07-28 11:19:45 -06:00
dal 4bef4205f3
feat(access-controls): migrate Rust access control libraries to TypeScript
This PR migrates the Rust  and  libraries to TypeScript in the new  package.

## Changes

### New Access Controls Package
- Implemented complete asset permissions system with CRUD operations
- Added dataset permissions with all 5 access paths (admin, direct user, user→group, team→direct, team→group, org→default)
- Implemented cascading permissions (metrics inherit from dashboards/chats/collections)
- Added LRU caching to replace Redis (30-second TTL)
- Comprehensive test coverage (148 tests passing, 3 skipped pending createUser)

### Database Package Updates
- Fixed AssetType enum to include all 14 asset types
- Added missing database queries for permissions
- Fixed timestamp fields to use ISO strings
- Added getUserOrganizationsByUserId function
- Created organized query structure by table

### AI Package Updates
- Updated getPermissionedDatasets API calls to new format
- Changed property references from ymlFile to ymlContent
- Fixed all test mocks to match new API structure

### Trigger App Updates
- Updated to use new access controls API
- Fixed test mocks to match DatasetListResult structure
- Added proper type imports

### Server Shared Updates
- Added request/response types for access control endpoints
- Exported types for API consistency

## Testing
- All packages build successfully with turbo build:dry-run
- All tests pass with turbo test:unit
- Full type safety maintained throughout

## Migration Notes
- Drop-in replacement for Rust libraries
- Same permission model and roles
- Cache invalidation strategies implemented
- Soft delete pattern maintained

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-28 10:17:35 -06:00
dal a08f32fe1d
refactor: remove unused test setup files and helper functions to streamline testing process 2025-07-28 08:48:48 -06:00
dal c9b52ccdb8
Refactor CLAUDE.md for improved build and linting instructions; update context handling in workflow and schemas. Enhance test validation for clarification questions and adjust output structure in related tests. 2025-07-26 12:43:25 -06:00
dal a92c3a0b44
Merge remote-tracking branch 'origin/staging' into dallin/bus-1498-piece-together-docs-agent-with-instructions-tools-workflow 2025-07-25 19:10:19 -06:00
dal 57dd2895d2
dry run for these two bad boys 2025-07-25 19:00:07 -06:00
dal 2833c6bb0c
dry run 2025-07-25 18:29:35 -06:00
dal 523a6921b1
hotfix on sql dialect 2025-07-25 14:31:35 -06:00
dal 1f52bd9b69
Enhance asset chat handling by introducing `handleAssetChatWithPrompt` for processing user prompts alongside asset imports. Update `createChatHandler` to manage asset-only and asset+prompt scenarios, ensuring correct message order and preventing unnecessary analyst task triggers. Add tests for new functionality and refactor related services for improved clarity and maintainability. 2025-07-25 12:47:01 -06:00
Nate Kelley 5e6eb76f5b
move get asset types around 2025-07-24 17:41:36 -06:00
Nate Kelley b2cf1725fc
Merge branch 'staging' into devin/BUS-1494-1753276227 2025-07-24 17:21:04 -06:00
dal a6f8e041cd
fix 1 hr 2025-07-24 10:16:59 -06:00
dal 2c02b9189b
fix the 1 hr ttl 2025-07-24 10:16:19 -06:00
dal ed77fb4409
Merge remote-tracking branch 'origin/staging' into dallin/bus-1498-piece-together-docs-agent-with-instructions-tools-workflow 2025-07-24 10:13:47 -06:00
dal 2d8890837a
add the extended cache beta header 2025-07-24 10:12:48 -06:00
dal 19f7256a27
switch system messages to leverage caching a bit better 2025-07-24 10:06:18 -06:00
dal 0c3994da00
hotfix: use v2 on chats 2025-07-24 09:22:30 -06:00
Nate Kelley af090d467e
fix tests 2025-07-23 22:53:54 -06:00
Nate Kelley e6d4062847
Merge branch 'staging' into big-nate/bus-1483-quick-win-for-filter-dashboard-drill-downexplore-metric 2025-07-23 22:45:54 -06:00
Nate Kelley 5eb43d0373
Add expanded threedot menu for menus 2025-07-23 22:33:16 -06:00
dal 7cd3aed6fa
Refactor import statements and enhance error messages in SQL validation tests
- Simplified import statements in web-search-tool.ts and web-search-tool.test.ts for better readability.
- Updated error messages in sql-parser-helpers.test.ts to provide clearer feedback regarding wildcard usage on physical tables.
2025-07-23 21:46:51 -06:00
Devin AI ae9f0c4f7e Fix incorrect import paths from '@buster-tools/web-tools' to '@buster/web-tools'
- Update package.json dependencies in ai and trigger packages
- Fix import statements in web-search-tool.ts and web-search-tool.test.ts
- Update pnpm-lock.yaml to reflect correct package references
- Resolves CI build failure due to missing module '@buster-tools/web-tools'

Co-Authored-By: Dallin Bentley <dallinbentley98@gmail.com>
2025-07-24 03:20:46 +00:00
Devin AI ab374dc465 BUS-1524: Enhance error messages for tool availability and SQL wildcards
- Update createWorkflowAwareHealingMessage to include next workflow step info and transition descriptions
- Replace SQL wildcard error message with more user-friendly text
- Maintain existing function signatures and return structures

Co-Authored-By: Dallin Bentley <dallinbentley98@gmail.com>
2025-07-24 03:09:56 +00:00
dal 2140f08163
package renamo 2025-07-23 21:06:42 -06:00
dal 5f43b2d074
new structure for chat and values 2025-07-23 17:39:03 -06:00
Nate Kelley df3533ffc7
pass in better props 2025-07-23 17:18:45 -06:00
dal 482564528a
lint fixes 2025-07-23 16:56:32 -06:00
Nate Kelley 503c9fafa4
response types update 2025-07-23 16:56:17 -06:00
dal 42d1da5389
context fixes on messages 2025-07-23 16:56:06 -06:00
Nate Kelley a11ce3bfd2
Update responses and requests 2025-07-23 16:35:14 -06:00
Nate Kelley 1ea1d6c97c
move around some types 2025-07-23 16:29:00 -06:00
Nate Kelley 0601a3cd09
fix weird vite 7 error 2025-07-23 15:57:44 -06:00
dal fb2e2c529c
feat: enhance documentation agent with SQL execution and context management
- Introduced executeSqlDocsAgent tool for executing SQL queries specific to documentation tasks.
- Updated DocsAgentContext to include dataSourceId and improved context management.
- Refactored context initialization and workflow steps to utilize new context structure.
- Enhanced createDocsTodosStep to generate comprehensive TODO lists based on user input.
- Improved error handling and logging throughout the documentation agent workflow.
- Updated tests to reflect changes in context keys and ensure proper functionality.
2025-07-23 15:53:18 -06:00
dal cb9aac6a2f
added in the web search to the agent 2025-07-23 14:26:46 -06:00
dal 2fe23084a5
Merge remote-tracking branch 'origin/staging' into dallin/bus-1498-piece-together-docs-agent-with-instructions-tools-workflow 2025-07-23 14:26:02 -06:00
dal 9e67fbfaae
refactor: update web search tool integration tests and improve code formatting
- Changed test query from 'OpenAI GPT' to 'Buster Data' with an increased limit of 10.
- Reorganized import statements in web-search-tool.ts for better readability.
- Enhanced formatting in permission-validator.test.ts for improved code clarity.
2025-07-23 13:12:56 -06:00
Devin AI 341b97f351 feat: implement web search functionality for BUS-1501
- Add webSearch method to FirecrawlService with WebSearchOptions, WebSearchResult, and WebSearchResponse interfaces
- Export new types from web-tools package
- Create web-search-tool in AI package with proper input/output schemas
- Add comprehensive unit tests for webSearch method (16 tests total)
- Add tool tests with mocking (4 tests)
- Add integration tests (skipped when no API key)
- Update package exports and dependencies
- Default search limit: 5, default format: markdown, content scraping enabled
- Proper error handling using CompanyResearchError
- AI package has no direct Firecrawl dependency

Co-Authored-By: Dallin Bentley <dallinbentley98@gmail.com>
2025-07-23 17:43:13 +00:00
dal 4f3f8f3810
feat: implement documentation agent workflow with context initialization
- Added new steps for the documentation agent, including context initialization, todo creation, and main processing logic.
- Introduced schemas for input and output validation using Zod.
- Created a new workflow that orchestrates the steps for generating documentation based on user input.
- Enhanced the existing file structure to support the new documentation agent functionality.
2025-07-23 11:32:50 -06:00
dal b043bcd03d
refactor: rename bashExecute to executeBash for consistency
- Updated the export name in index.ts and adjusted imports in the corresponding test file.
- Modified the tool definition in bash-execute-tool.ts to reflect the new naming convention.
2025-07-23 10:55:03 -06:00
dal 21a89151d3
Merge pull request #600 from buster-so/devin/BUS-1487-1753225168
feat: implement wildcard validation for SQL security (BUS-1487)
2025-07-23 10:23:22 -06:00
dal 240986d7a0
instruction on execute sql 2025-07-23 10:16:49 -06:00
dal 77ffeab37a
Fix Snowflake adapter tests for lowercase column names
The Snowflake adapter implementation transforms column names to lowercase
for consistency, but the tests were expecting uppercase column names.
This commit updates the tests to match the implementation:

- Update test expectations to use lowercase column names (id, name)
- Fix hasMoreRows assertions to match implementation logic (only true when rowCount > limit)
- Ensure all Snowflake-related tests pass with the current adapter behavior

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-23 10:09:51 -06:00
dal d371a65524
Update Snowflake adapter tests and implementation for improved row handling
- Increased allowed variance in cached query time checks to accommodate network fluctuations.
- Corrected property name in test assertions to match expected lowercase format.
- Enhanced SnowflakeAdapter to transform column names to lowercase and adjusted logic for determining if more rows are available from the stream.
2025-07-23 10:01:34 -06:00
dal 03ba461dc4
Merge remote-tracking branch 'origin/staging' into devin/BUS-1495-1753278753 2025-07-23 09:43:18 -06:00
dal 5aa781a536
Add fetch body modification for tool_choice in Anthropics and Vertex models
- Implemented a custom fetch function in both anthropic.ts and vertex.ts to modify the request body.
- If tool_choice is present, added disable_parallel_tool_use to the request body.
- Included error handling for JSON parsing to ensure fallback to original request on failure.
2025-07-23 09:32:07 -06:00
dal f10627b005
Implement AbortError handling in streaming models
- Added tests for handling AbortError scenarios in both memory-safe and standard streaming models.
- Updated the FallbackModel to gracefully handle intentional aborts without retrying or causing errors.
- Ensured that the controller closes properly on AbortError and that no fallback to subsequent models occurs.
- Enhanced mock models to simulate AbortError conditions for comprehensive testing.
2025-07-23 09:01:08 -06:00
dal 5be55782fc
Update packages/ai/src/utils/memory/message-converters.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:29:47 -06:00
dal 87aa4f1993
Update packages/ai/src/tools/communication-tools/respond-without-asset-creation.test.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:29:40 -06:00
dal 3161c2b5e1
Update packages/ai/src/utils/memory/message-converters.test.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:29:20 -06:00
dal 5b0b6f360b
Update packages/ai/src/utils/database/format-llm-messages-as-reasoning.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:29:06 -06:00
dal b1be6aacc2
Update packages/ai/src/tools/communication-tools/respond-without-asset-creation.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:28:58 -06:00
dal b13d7c71fb
Update packages/ai/evals/agents/analyst-agent/metrics/think-and-prep-updates.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:28:38 -06:00
dal 6c52727b48
Update packages/ai/src/tools/communication-tools/respond-without-asset-creation.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-07-23 08:28:32 -06:00
Devin AI a44153e2ee fix: update permission validator tests to work with wildcard validation
- Replace SELECT * with explicit column names in permission validation tests
- Update CTE test to use explicit columns in final SELECT
- Maintain test intent while aligning with new wildcard security validation
- Ensure all tests pass with new wildcard blocking behavior

Co-Authored-By: Dallin Bentley <dallinbentley98@gmail.com>
2025-07-23 14:23:32 +00:00