Commit Graph

80 Commits

Author SHA1 Message Date
dal f0796b35af
Refactor message post-processing logic to improve handling of workflow outputs and assumptions. Updated test cases to reflect changes in message structure and added type definitions for flagChat results. Enhanced error handling for scenarios with minimal workflow output. 2025-08-18 23:42:27 -06:00
dal 1d3146e35b
Enhance Slack integration by adding support for direct messages (DMs) and updating event handling. Introduced new environment variables for Slack integration, updated deployment command to use the latest version, and improved message filtering logic for DMs. Refactored Slack event processing to differentiate between app mentions and direct messages, ensuring proper handling and logging. Updated webhook types to include message IM events. 2025-08-18 23:19:51 -06:00
dal bc6782e156
test fixes 2025-08-18 23:08:41 -06:00
dal 5e7467aefc
fix: improve Slack messaging reliability and error handling
- Add proper error handling for Slack API failures with typed responses
- Implement message operation types for better type safety
- Add retry logic with exponential backoff for transient failures
- Export webhook types for external consumers
- Update Slack agent task to handle errors gracefully and continue processing
- Add proper validation and error messages for failed operations
- Include structured error tracking for debugging

🤖 Generated with Anthropic

Co-Authored-By: Claude <noreply@anthropic.com>
2025-08-18 20:36:29 -06:00
dal 5b5191356a
Refactor report creation and modification logic. Introduced batch update functionality for reports, improved version history management, and enhanced error handling during report updates. Adjusted task duration settings for better performance and refined file extraction logic to filter out reports and metrics appropriately. 2025-08-18 17:00:42 -06:00
dal 6f65e25e63
Update pnpm-lock.yaml to resolve merge conflicts and synchronize package versions, including updates to '@aws-sdk/credential-provider-web-identity' and 'platejs' dependencies. 2025-08-18 15:19:01 -06:00
dal f9eece00d6
merge staging in 2025-08-18 14:39:59 -06:00
dal 35623ad987
Integrate access controls with metric file downloads
- Added permission checks to metric file download handler
- Added permission checks to export-metric-data trigger task
- Created comprehensive tests for access control integration
- Updated AssetType enums to include report_file
- Resolved export conflicts in server-shared package
- Fixed AI package imports for new getPermissionedDatasets API
2025-08-13 14:25:41 -06:00
dal ebe496df87
Merge access-controls branch and resolve conflicts
- Combined asset type enums from both branches
- Merged all database query exports
- Integrated access-controls package into server-shared
- Resolved conflicts in AI package instructions
2025-08-13 14:15:20 -06:00
dal 594f08202b
Refactor metric file handling and improve error handling
- Updated type definitions for better clarity and type safety in metric file download and export tasks.
- Enhanced error handling in the metric files API to utilize HTTPException for more consistent error responses.
- Added environment variable validation in export tasks to ensure necessary credentials are present before execution.
- Improved type assertions for content in metric export queries to ensure proper handling of JSONB data.
2025-08-13 14:01:46 -06:00
dal 3eb80ae630
Add metric file export functionality with Cloudflare R2 support
- Introduced new API endpoint for downloading metric files as CSV.
- Implemented export logic to handle large datasets (up to 1 million rows) and generate presigned URLs for secure downloads.
- Added cleanup task to remove exported files from R2 storage after 60 seconds.
- Updated environment configuration to include Cloudflare R2 credentials.
- Enhanced error handling for various export scenarios.
- Refactored related database queries and schemas for better integration.
- Updated documentation for new features and usage instructions.
2025-08-13 13:36:42 -06:00
dal 855e7b1a55
Integrate dataset handling into Analyst and Think and Prep agents
- Added support for fetching and managing user-specific datasets in the `analystAgentTask`, enhancing the context available for processing.
- Updated the `AnalystAgent` and `ThinkAndPrepAgent` schemas to include datasets, ensuring they are passed correctly in system messages.
- Implemented error handling for dataset retrieval to prevent workflow interruptions.
- Adjusted integration tests to accommodate the new datasets structure, ensuring comprehensive coverage.

These changes improve the agents' ability to utilize relevant datasets, enhancing their functionality and user experience.
2025-08-12 19:31:25 -06:00
dal 8c27a3dfff
Merge remote-tracking branch 'origin/staging' into dal/upgrade-to-ai-sdk-v5 2025-08-12 12:53:48 -06:00
dal c6a28e39d5
migration changes 2025-08-12 12:44:15 -06:00
dal 8d438f25fd
fix trigger int tests 2025-08-11 13:32:13 -06:00
dal 4bef4205f3
feat(access-controls): migrate Rust access control libraries to TypeScript
This PR migrates the Rust  and  libraries to TypeScript in the new  package.

## Changes

### New Access Controls Package
- Implemented complete asset permissions system with CRUD operations
- Added dataset permissions with all 5 access paths (admin, direct user, user→group, team→direct, team→group, org→default)
- Implemented cascading permissions (metrics inherit from dashboards/chats/collections)
- Added LRU caching to replace Redis (30-second TTL)
- Comprehensive test coverage (148 tests passing, 3 skipped pending createUser)

### Database Package Updates
- Fixed AssetType enum to include all 14 asset types
- Added missing database queries for permissions
- Fixed timestamp fields to use ISO strings
- Added getUserOrganizationsByUserId function
- Created organized query structure by table

### AI Package Updates
- Updated getPermissionedDatasets API calls to new format
- Changed property references from ymlFile to ymlContent
- Fixed all test mocks to match new API structure

### Trigger App Updates
- Updated to use new access controls API
- Fixed test mocks to match DatasetListResult structure
- Added proper type imports

### Server Shared Updates
- Added request/response types for access control endpoints
- Exported types for API consistency

## Testing
- All packages build successfully with turbo build:dry-run
- All tests pass with turbo test:unit
- Full type safety maintained throughout

## Migration Notes
- Drop-in replacement for Rust libraries
- Same permission model and roles
- Cache invalidation strategies implemented
- Soft delete pattern maintained

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-07-28 10:17:35 -06:00
dal 42d1da5389
context fixes on messages 2025-07-23 16:56:06 -06:00
dal e1a60bdf11
build fixes 2025-07-22 09:11:36 -06:00
dal 9b9914cd70
build fixes 2025-07-21 17:38:37 -06:00
dal cb3dd968e3
slack markdown fixes 2025-07-21 17:35:58 -06:00
dal cf2ec2b02a
please 2025-07-21 16:27:15 -06:00
dal 1fa75800fc
unknwon fix and build error 2025-07-21 16:09:39 -06:00
dal cee4483751
message post processing bugfix no longer loading duplicate conversation history 2025-07-21 12:34:34 -06:00
dal 06249f5e8a
rearrange and get some things right for the initial read file tool 2025-07-20 23:04:11 -06:00
dal d3e2577d13
New polling logic 2025-07-18 23:30:28 -06:00
dal 18dde9e40b
concurrency and queuing 2025-07-18 23:19:48 -06:00
dal 6e65bec499
Enhance task triggering by adding concurrency key for sequential processing
- Updated `createChatHandler` to include a `concurrencyKey` when triggering the `analyst-agent-task`, ensuring tasks are processed sequentially per chat.
- Adjusted related test cases to verify the inclusion of the `concurrencyKey`.
- Integrated the `concurrencyKey` in the `slackAgentTask` to manage task queuing and notify users when tasks are queued.
2025-07-18 23:01:32 -06:00
dal 8daceae2e3
Add duplicate message check in slack-agent-task
- Introduced a new function `checkForDuplicateMessages` in the database queries to verify if a message already exists in the same chat.
- Integrated the duplicate check in the `slackAgentTask` to prevent processing of duplicate messages, enhancing task efficiency and logging warnings for duplicates detected.
2025-07-18 22:53:02 -06:00
dal 0e46d64683
trigger run id being added during the slack agent task 2025-07-18 22:34:02 -06:00
dal ba04450469
Enhance Slack event handling by adding hourglass reaction on app mentions and refactoring reaction management in slack-agent-task. Update CLAUDE.md and global.mdc with new guidelines for testing and development workflows. Adjust .gitignore for rerank package to ensure proper directory exclusion. 2025-07-18 21:40:20 -06:00
dal f9786c75c8
increase polling time for trigger bc 5 seconds or less still get charged lol 2025-07-18 16:12:03 -06:00
Nate Kelley 5f61995296
Fix linting errors 2025-07-18 10:48:49 -06:00
dal cd8a50403f
Merge branch 'staging' into dallin/bus-1419-enable-sharing-of-dashboards-or-collections-with-workspace 2025-07-17 17:16:07 -06:00
Nate Kelley 5dd7b20f25
fix broken linting 2025-07-17 13:18:32 -06:00
dal a0a1e11493
update workspace sharing on all assets 2025-07-17 12:54:02 -06:00
dal bcaa133059
Enhance Slack agent task with no message handling and increase max duration
- Updated maxDuration to 600 seconds to align with analyst agent task.
- Added logic to handle cases where no messages are found, sending a direct response to Slack and updating message reactions accordingly.
- Improved type safety in SlackSharingPermissions component by defining a specific type for sharing permissions.
2025-07-16 17:37:17 -06:00
dal da380485d9
added in the slack auto-sharing functionality 2025-07-16 16:54:09 -06:00
dal 8221bca8de
react appropriately 2025-07-16 14:50:26 -06:00
dal 26f196c77d
unauthorized message send back as reply 2025-07-16 14:05:35 -06:00
dal 86572acfa4
slack agent react 2025-07-16 13:58:03 -06:00
dal a20c8dad56
pass up userId 2025-07-16 13:22:43 -06:00
dal 6b01f2f97a
change to slack-agent-task 2025-07-16 13:16:10 -06:00
dal d4f216cb66
Merge remote-tracking branch 'origin/staging' into dallin/bus-1363-slack-agent-query-buster-from-slack-direct-query 2025-07-16 12:54:18 -06:00
dal 1e2e031240
slack info from user 2025-07-16 11:56:11 -06:00
dal 0a665da961
stub out the slack agent task 2025-07-16 10:37:42 -06:00
Nate Kelley 0fa77aa5c9
update imports 2025-07-15 16:03:07 -06:00
dal 3821c0211a
slack and env for buster prod alerts 2025-07-14 08:19:57 -06:00
dal 06a5eb38e6
the trigger post processing slack notifier should only look for the analyst post processing messages 2025-07-10 09:37:45 -06:00
dal 947b38d65c
Get rid of action on button. 2025-07-09 16:29:15 -06:00
dal 03ae028e40
slack-notifier 2025-07-09 16:15:08 -06:00