Commit Graph

165 Commits

Author SHA1 Message Date
dal 48786d55d3
type fix 2025-09-11 13:51:23 -06:00
dal 7a07283e30
Refactor sync job processing to use dataset-based syncing from YAML files. Removed unused sync job status tracking and related database queries. Updated tests to reflect changes in job payload structure and logging. Added new types for datasets and searchable fields. 2025-09-11 13:15:22 -06:00
Wells Bunker 60f0a1e0e0
Adding in database column, api input, and logic to skip analyst mode router if it is provided in a message 2025-09-10 22:00:15 -06:00
dal 50db4d25de
fix test 2025-09-10 10:52:35 -06:00
dal af5a7cdd88
fix: Configure Trigger.dev to handle @duckdb/node-api native bindings
- Add @duckdb/node-bindings as explicit dependency
- Mark all DuckDB native binding packages as external in build config
- This ensures native modules are available at runtime without bundling
2025-09-10 08:24:17 -06:00
dal c784445960
shake up trigger and search dependencies to work now 2025-09-10 08:11:29 -06:00
dal 4d19d01c29
medium 1x upgrade 2025-09-10 07:42:26 -06:00
dal 47d9e70f8e
Merge remote-tracking branch 'origin/staging' into move-search-to-turbo-puffer 2025-09-09 10:15:12 -06:00
dal c354a08348
Merge remote-tracking branch 'origin/staging' into move-search-to-turbo-puffer 2025-09-09 10:04:50 -06:00
dal 99108c6f54
Merge remote-tracking branch 'origin/staging' into dallin-bus-1694-applying-an-analystmd-to-analyst-agent 2025-09-09 09:28:03 -06:00
dal 1344bfceba
Add Slack notification handling logic in message post-processing task
- Implemented tests for Slack notification skip logic based on issue and assumption conditions.
- Updated the main task to skip notifications when no issues are found and no major assumptions exist.
- Enhanced workflow to handle undefined `isSlackFollowUp` correctly, ensuring proper message formatting and notification sending.
2025-09-09 09:22:14 -06:00
dal ef41516325
Implement unified deployment for models and docs
- Added new deployment functionality to handle both models and documentation in a single request.
- Introduced new schemas for unified deployment requests and responses using Zod.
- Updated deployment handlers to process and validate models and docs together.
- Enhanced logging to provide detailed information about deleted models and docs during deployment.
- Refactored existing code to integrate the new deployment structure, ensuring backward compatibility with previous functionalities.
2025-09-09 00:32:48 -06:00
dal db8a919e08
final changes on search 2025-09-05 09:45:17 -06:00
dal e5c8512c76
ok sync jobs to turbopuffer 2025-09-04 14:36:08 -06:00
dal a69eefe2b7
Merge remote-tracking branch 'origin/staging' into move-search-to-turbo-puffer 2025-09-04 11:46:55 -06:00
dal 4e93071e75
Update environment configuration and sync functionality
- Added `TURBOPUFFER_REGION` to the environment configuration.
- Modified the `createClient` function to utilize the new `TURBOPUFFER_REGION` variable.
- Updated the `generateNamespace` function to return the data source ID directly instead of prefixing it.
- Adjusted various tests and sync job logic to reflect changes in namespace generation and ensure consistency across the application.
2025-09-04 11:45:59 -06:00
dal f733c405cc
final tweaks 2025-09-02 13:38:53 -06:00
dal b505639d50
env config 2025-09-02 13:20:38 -06:00
dal 836a2b0787
Add searchable values sync functionality
- Introduced the `processSyncJob` function to handle the complete workflow for syncing searchable values, including fetching credentials, querying distinct values, deduplication, generating embeddings, and upserting to Turbopuffer.
- Added support for the `@buster/search` package in the project configuration.
- Updated dependencies to version 4.0.2 for `@trigger.dev/build`, `@trigger.dev/core`, and `@trigger.dev/sdk`.
- Enhanced logging for better traceability during the sync process.
2025-09-02 12:57:59 -06:00
dal 5f73d2b14b
sync jobs in trigger 2025-09-02 11:59:30 -06:00
dal b3604c6cb0
embeddings and sync job 2025-09-02 11:29:46 -06:00
dal 9f14b55c01
catalog for trigger.dev smh 2025-08-29 15:42:24 -06:00
dal 6b0b4112d7
fixed all report bugs 2025-08-27 09:49:21 -06:00
dal e97ec9c002
Enhance S3 integration functionality
- Added bucketName to S3 integration responses and handlers to support bucket-specific operations.
- Updated tests to reflect the inclusion of bucketName in integration creation and retrieval processes.
- Improved error handling for fetching bucket names from the vault during S3 integration retrieval.

These changes improve the S3 integration management by allowing for more granular control and visibility of storage buckets.
2025-08-25 12:48:19 -06:00
dal 48de08f603
Merge remote-tracking branch 'origin/staging' into add-s3-integration-capability 2025-08-25 09:53:18 -06:00
dal 41ca3c3724
Refactor S3 integration handlers and storage provider logic
- Simplified S3 integration handler functions by consolidating imports and improving code readability.
- Updated error handling in the S3 integration process to enhance clarity and maintainability.
- Refactored storage provider functions to utilize a more modular approach, separating concerns for better organization.
- Introduced utility functions for common operations, improving code reuse and reducing duplication.

These changes enhance the overall structure and maintainability of the S3 integration management features.
2025-08-25 08:06:07 -06:00
dal 5f51dfc459
Implement S3 integration management features
- Added routes for creating, retrieving, and deleting S3 integrations in the API.
- Introduced handlers for S3 integration operations, including validation of user permissions and storage credentials.
- Updated database schema to support S3 integrations, including a new table and associated queries.
- Integrated storage provider logic to handle S3, R2, and GCS configurations.
- Enhanced error handling and response structures for integration operations.

This commit lays the groundwork for managing storage integrations within the application, allowing users to connect and manage their S3 storage solutions.
2025-08-25 08:05:19 -06:00
dal 455888cdcd
ai sdk v4 to v5 conversion 2025-08-24 21:31:16 -06:00
dal fe5819efe1
Update AWS SDK dependencies and enhance metric data handling
- Upgraded '@aws-sdk/client-s3' to version 3.873.0 across multiple packages.
- Introduced caching mechanisms for metric data retrieval in the getMetricDataHandler function.
- Updated API endpoints to support report_file_id for cache lookups and data retrieval.
- Enhanced error handling and logging for cache operations.
- Refactored related components to accommodate new caching logic and parameters.
2025-08-22 12:45:05 -06:00
dal 4b34e65fc1
get rid of random perbuild? 2025-08-21 16:32:34 -06:00
dal 96d20ff512
package.json 2025-08-21 16:25:00 -06:00
dal c7cc610d73
fix trigger by getting rid of the env stuff bc it breaks it. 2025-08-21 14:29:34 -06:00
dal 81c703a472
Update dependencies to version 4.0.1 for @trigger.dev/build, @trigger.dev/core, and @trigger.dev/sdk; enhance UUID validation in modify-reports-delta tool. 2025-08-21 13:34:26 -06:00
dal 4f7ef9525e
Add basic task examples and update SDK version in Trigger.dev documentation 2025-08-21 13:27:31 -06:00
Nate Kelley d4366037bf
Add some platejs tests 2025-08-20 22:13:02 -06:00
dal 2461dc0a77
bugfixes 2025-08-20 11:26:37 -06:00
dal 5c3acf4b01
slack fixes 2025-08-19 13:01:47 -06:00
dal 90dc2a254d
change trigger back to node 2025-08-19 10:08:27 -06:00
dal f0796b35af
Refactor message post-processing logic to improve handling of workflow outputs and assumptions. Updated test cases to reflect changes in message structure and added type definitions for flagChat results. Enhanced error handling for scenarios with minimal workflow output. 2025-08-18 23:42:27 -06:00
dal 1d3146e35b
Enhance Slack integration by adding support for direct messages (DMs) and updating event handling. Introduced new environment variables for Slack integration, updated deployment command to use the latest version, and improved message filtering logic for DMs. Refactored Slack event processing to differentiate between app mentions and direct messages, ensuring proper handling and logging. Updated webhook types to include message IM events. 2025-08-18 23:19:51 -06:00
dal bc6782e156
test fixes 2025-08-18 23:08:41 -06:00
dal a8d719de1d
upgrade trigger 2025-08-18 20:59:25 -06:00
dal 5e7467aefc
fix: improve Slack messaging reliability and error handling
- Add proper error handling for Slack API failures with typed responses
- Implement message operation types for better type safety
- Add retry logic with exponential backoff for transient failures
- Export webhook types for external consumers
- Update Slack agent task to handle errors gracefully and continue processing
- Add proper validation and error messages for failed operations
- Include structured error tracking for debugging

🤖 Generated with Anthropic

Co-Authored-By: Claude <noreply@anthropic.com>
2025-08-18 20:36:29 -06:00
dal 5b5191356a
Refactor report creation and modification logic. Introduced batch update functionality for reports, improved version history management, and enhanced error handling during report updates. Adjusted task duration settings for better performance and refined file extraction logic to filter out reports and metrics appropriately. 2025-08-18 17:00:42 -06:00
dal 6f65e25e63
Update pnpm-lock.yaml to resolve merge conflicts and synchronize package versions, including updates to '@aws-sdk/credential-provider-web-identity' and 'platejs' dependencies. 2025-08-18 15:19:01 -06:00
dal 9b2c92ade7
trigger set to bun and electric handler lint 2025-08-18 14:40:13 -06:00
dal f9eece00d6
merge staging in 2025-08-18 14:39:59 -06:00
dal b4e34d22e0
trigger updates 2025-08-18 08:27:15 -06:00
dal 9589ca198b
upgrade and fixes 2025-08-18 08:07:13 -06:00
dal 35623ad987
Integrate access controls with metric file downloads
- Added permission checks to metric file download handler
- Added permission checks to export-metric-data trigger task
- Created comprehensive tests for access control integration
- Updated AssetType enums to include report_file
- Resolved export conflicts in server-shared package
- Fixed AI package imports for new getPermissionedDatasets API
2025-08-13 14:25:41 -06:00