Commit Graph

5587 Commits

Author SHA1 Message Date
dal 7c9fbc65b0
logging 2025-08-26 14:01:15 -06:00
dal 0c91de708d
Enhance logging and update tests to remove hardcoded secrets
- Added logging for server startup with port number in main.rs
- Removed hardcoded GITHUB_WEBHOOK_SECRET from github-webhook-validator tests
- Updated slack-notifier tests to remove BUSTER_URL environment variable
- Refactored FirecrawlService tests to use async creation method and removed API key from environment
2025-08-26 13:57:51 -06:00
dal 7bcb9199c8
fix: mock getSecret in message-post-processing tests to prevent CI failures
- Add mock for @buster/secrets module
- Mock getSecret function to return test values
- Remove outdated BRAINTRUST_KEY env stubbing
- Fixes CI/CD failures due to missing Infisical secrets
2025-08-26 13:30:54 -06:00
dal fd7cbd3e5d
mock models in test env 2025-08-26 13:24:20 -06:00
dal e7980c9105
Refactor test mocks for LLM modules across multiple test files to prevent initialization errors. Updated mocking strategy for 'ai' and 'braintrust' modules to ensure consistent behavior in unit tests. 2025-08-26 13:13:22 -06:00
dal 754f38270d
small lint and build fixes 2025-08-26 12:54:01 -06:00
dal 40a612f10a
fix all tests and stuffc 2025-08-26 12:22:31 -06:00
dal 93e80f5698
lint fixes 2025-08-26 09:28:57 -06:00
dal 8a740a8da1
secrets are all working 2025-08-26 09:19:35 -06:00
dal 36d6357933
moved a lot over to infisical 2025-08-26 08:24:42 -06:00
dal 682ea736ca
tons of secrets changes for infisical 2025-08-26 08:05:21 -06:00
dal 8305fff105
Merge origin/staging into move-secrets-to-infiscal
Resolved conflicts by:
- Using storage provider approach from staging in cleanup-export-file.ts
- Keeping Opus fallback model from our env var work in sonnet-4.ts
- Merging dependencies in data-source package.json (kept @buster/secrets, added new deps from staging)
- Regenerated pnpm-lock.yaml after resolving package.json conflicts
2025-08-25 13:07:12 -06:00
dal e97ec9c002
Enhance S3 integration functionality
- Added bucketName to S3 integration responses and handlers to support bucket-specific operations.
- Updated tests to reflect the inclusion of bucketName in integration creation and retrieval processes.
- Improved error handling for fetching bucket names from the vault during S3 integration retrieval.

These changes improve the S3 integration management by allowing for more granular control and visibility of storage buckets.
2025-08-25 12:48:19 -06:00
dal 11f31a792f
Merge staging into move-secrets-to-infiscal
- Accept deletion of env.d.ts and validate-env.ts (replaced by centralized secrets)
- Remove SLACK_INTEGRATION_ENABLED (now always enabled per staging changes)
- Update Slack OAuth service to use @buster/secrets instead of process.env
- Add BUSTER_URL to server keys
- Fix Snowflake test timeout issues
2025-08-25 10:12:55 -06:00
dal f4b8199f21
Merge pull request #765 from buster-so/add-s3-integration-capability
Storage Bucket Integration
2025-08-25 09:58:05 -06:00
dal 48de08f603
Merge remote-tracking branch 'origin/staging' into add-s3-integration-capability 2025-08-25 09:53:18 -06:00
dal 8a26630836
storage integration 2025-08-25 09:52:37 -06:00
dal abbbd6eac7
make update message entries await 2025-08-25 09:26:27 -06:00
dal e2cf8449e6
s3 tests 2025-08-25 08:48:10 -06:00
dal 41ca3c3724
Refactor S3 integration handlers and storage provider logic
- Simplified S3 integration handler functions by consolidating imports and improving code readability.
- Updated error handling in the S3 integration process to enhance clarity and maintainability.
- Refactored storage provider functions to utilize a more modular approach, separating concerns for better organization.
- Introduced utility functions for common operations, improving code reuse and reducing duplication.

These changes enhance the overall structure and maintainability of the S3 integration management features.
2025-08-25 08:06:07 -06:00
dal 5f51dfc459
Implement S3 integration management features
- Added routes for creating, retrieving, and deleting S3 integrations in the API.
- Introduced handlers for S3 integration operations, including validation of user permissions and storage credentials.
- Updated database schema to support S3 integrations, including a new table and associated queries.
- Integrated storage provider logic to handle S3, R2, and GCS configurations.
- Enhanced error handling and response structures for integration operations.

This commit lays the groundwork for managing storage integrations within the application, allowing users to connect and manage their S3 storage solutions.
2025-08-25 08:05:19 -06:00
dal 6c8e2ba03c
remove slack integration feature flag 2025-08-25 01:11:10 -06:00
dal 87559314b8
Merge from staging 2025-08-25 01:05:16 -06:00
dal 1dcaaca339
get rid of env and other crap 2025-08-25 00:37:35 -06:00
dal f469b2a152
Update PostgreSQL adapter SSL configuration to allow self-signed certificates
- Modified the SSL configuration in both the PostgreSQL adapter and its tests to use { rejectUnauthorized: false } instead of a boolean true value.
- Ensured consistency in handling SSL settings across the adapter and its tests.
2025-08-25 00:26:29 -06:00
dal da7af5f384
remove main hono server deploy job 2025-08-25 00:18:22 -06:00
dal 570624a112
posgres ssl fix 2025-08-25 00:15:09 -06:00
dal 4e82c14f52
feat: migrate AI package from process.env to @buster/secrets
- Update all LLM model files to use getSecretSync with AI_KEYS constants
- Migrate OpenAI GPT models (gpt-5, gpt-5-mini, gpt-5-nano) to use secrets system
- Migrate Anthropic models (sonnet-4, haiku-3-5) to use secrets for both Anthropic API and Vertex AI credentials
- Update provider files (openai.ts, anthropic.ts, vertex.ts) to use getSecretSync
- Migrate evaluation workflow to use BRAINTRUST_KEY from secrets
- Implement proper error handling for missing credentials with try-catch blocks
- Test files will be migrated in a separate update

All non-test source files now use centralized secrets management instead of direct process.env access.
2025-08-24 23:42:12 -06:00
dal 2e24d830f0
Refactor database credential handling across adapters
- Updated all database adapter tests and implementations to replace the 'database' field with 'default_database' for consistency.
- Ensured backward compatibility in the Redshift adapter by allowing both 'database' and 'default_database' fields.
- Enhanced SQLServer and MySQL adapters to reflect the new credential structure, improving clarity and maintainability.
2025-08-24 23:35:46 -06:00
dal 210fa646b1
ci cd fixes 2025-08-24 22:35:49 -06:00
dal 4b21ef1fea
set up infiscal and remove test and env packages 2025-08-24 22:30:45 -06:00
dal a03776ed0a
fix docker buiild and deploy in ci 2025-08-24 22:29:12 -06:00
dal c1ad9cd710
ci cd fixes and clean up 2025-08-24 22:14:06 -06:00
dal 9bdfe81cd5
final tweak 2025-08-24 22:09:45 -06:00
dal 7b9afdbb2f
Enhance tool result conversion by validating toolCallId
- Added checks to ensure toolCallId exists and is a valid string before processing tool results.
- Preserves the original part if toolCallId is missing or invalid, improving robustness in message conversion.
2025-08-24 21:51:13 -06:00
dal 980a786d21
fix build errors 2025-08-24 21:42:38 -06:00
dal 455888cdcd
ai sdk v4 to v5 conversion 2025-08-24 21:31:16 -06:00
dal c5d5e28cc5
Merge branch 'main' into staging 2025-08-22 21:44:27 -06:00
dal 39caebef28
Merge pull request #757 from buster-so/update-message-entries-pass-through-cache
Add lru-cache dependency and refactor updateMessageEntries function
2025-08-22 20:48:39 -06:00
dal ce8d9a3064
Refactor updateMessageEntries for cache-first streaming approach
- Updated logic to prioritize cache as the source of truth during streaming, with asynchronous database updates for persistence.
- Improved error handling for background database updates, ensuring cache validity even if DB update fails.
- Cleaned up mergeResponseMessages and mergeReasoningMessages functions by removing redundant code.
2025-08-22 20:43:44 -06:00
dal 0d44a230d7
Update packages/database/src/queries/messages/helpers/merge-entries.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-08-22 17:37:43 -06:00
dal 948a07ec72
Update packages/database/src/queries/messages/helpers/merge-entries.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-08-22 17:37:34 -06:00
dal 77cd39b151
Update packages/database/src/queries/messages/update-message-entries.ts
Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2025-08-22 17:37:10 -06:00
dal b14054a033
Add lru-cache dependency and refactor updateMessageEntries function
- Introduced lru-cache version 11.1.0 in package.json and pnpm-lock.yaml.
- Refactored updateMessageEntries to utilize TypeScript-based merge logic with write-through caching.
- Improved error handling for fetching existing message entries and updated database logic to merge new entries with existing ones.
2025-08-22 17:34:40 -06:00
dal affe7b710b
update message entries query fix 2025-08-22 17:03:41 -06:00
dal dcf1687b50
Refactor sequential thinking tool to remove raw LLM message entries
- Removed the creation and handling of raw LLM message entries in both start and finish functions.
- Updated message entry updates to only include reasoning messages, simplifying the logic and improving clarity.
2025-08-22 16:50:55 -06:00
dal 50c9575d6f
Merge pull request #756 from buster-so/analyst-workflow-output
Enhance Analyst Workflow with Tool Integration and Output Structuring
2025-08-22 16:33:18 -06:00
dal d01259e728
Enhance Analyst Workflow with Tool Integration and Output Structuring
- Added imports for various dashboard, metrics, and report tools to the analyst workflow.
- Updated the `runAnalystWorkflow` function to return a comprehensive output, including tool call results, charts created, and summary statistics.
- Implemented logic to extract tool calls and segment messages by user requests, improving the overall workflow output structure.
2025-08-22 16:28:05 -06:00
dal 1cff29d936
update messages 2025-08-22 16:22:11 -06:00
dal 9031d3d2a6
Merge pull request #755 from buster-so/add-static-dataframe-caching
Add-static-dataframe-caching
2025-08-22 13:00:34 -06:00