- Add @duckdb/node-bindings as explicit dependency
- Mark all DuckDB native binding packages as external in build config
- This ensures native modules are available at runtime without bundling
- Added `TURBOPUFFER_REGION` to the environment configuration.
- Modified the `createClient` function to utilize the new `TURBOPUFFER_REGION` variable.
- Updated the `generateNamespace` function to return the data source ID directly instead of prefixing it.
- Adjusted various tests and sync job logic to reflect changes in namespace generation and ensure consistency across the application.
- Introduced the `processSyncJob` function to handle the complete workflow for syncing searchable values, including fetching credentials, querying distinct values, deduplication, generating embeddings, and upserting to Turbopuffer.
- Added support for the `@buster/search` package in the project configuration.
- Updated dependencies to version 4.0.2 for `@trigger.dev/build`, `@trigger.dev/core`, and `@trigger.dev/sdk`.
- Enhanced logging for better traceability during the sync process.
- Upgraded '@aws-sdk/client-s3' to version 3.873.0 across multiple packages.
- Introduced caching mechanisms for metric data retrieval in the getMetricDataHandler function.
- Updated API endpoints to support report_file_id for cache lookups and data retrieval.
- Enhanced error handling and logging for cache operations.
- Refactored related components to accommodate new caching logic and parameters.
- Introduced new API endpoint for downloading metric files as CSV.
- Implemented export logic to handle large datasets (up to 1 million rows) and generate presigned URLs for secure downloads.
- Added cleanup task to remove exported files from R2 storage after 60 seconds.
- Updated environment configuration to include Cloudflare R2 credentials.
- Enhanced error handling for various export scenarios.
- Refactored related database queries and schemas for better integration.
- Updated documentation for new features and usage instructions.
- Deleted references to the `@mastra/core` package from various configuration files.
- Removed multiple unused test files and helper functions related to visualization tools, including axis validation and version history management.
- Cleaned up import statements for better organization and readability.
These changes streamline the codebase by eliminating unnecessary dependencies and improving maintainability.