Commit Graph

210 Commits

Author SHA1 Message Date
dal 5ccd8ddd72 Log error when failing to retrieve user organization ID in get_asset_access route 2025-01-06 13:00:01 -07:00
Nate Kelley 786874545e Merge branch 'staging' of https://github.com/buster-so/buster into staging 2025-01-06 12:43:42 -07:00
Nate Kelley fd45d11780 update prettier files 2025-01-06 12:43:40 -07:00
dal 855bc6bc99
Merge pull request #14 from buster-so/dal/actions-workflows
Enhance GitHub Actions workflows and Dependabot configuration
2025-01-06 11:11:39 -08:00
dal f7bb098ba9 Enhance GitHub Actions workflows and Dependabot configuration
- Added new Dependabot configurations for npm packages in the /api and /web directories, scheduled for weekly updates with a limit of 10 open pull requests.
- Updated the GitHub Actions workflows for both main and staging deployments to trigger on changes within the api directory, specifically for migrations, improving deployment reliability.

These changes streamline dependency management and enhance the deployment process for the application.
2025-01-06 12:10:42 -07:00
dal b0d65d3839
Merge pull request #10 from buster-so/staging
Staging
2025-01-06 10:34:24 -08:00
dal 5f2c72fbf6
Merge pull request #9 from buster-so/nate/initial-web-commit
Initial Web Commit
2025-01-06 10:32:48 -08:00
Nate Kelley 0302fb9a0c Initial web commit 🤙
Initial commit for all files and folder related to the web project
2025-01-06 11:29:29 -07:00
dal c5d3e34fde
Merge pull request #8 from buster-so/porter-stack-main-862aaabf
Enable Porter Application main
2025-01-03 15:52:52 -08:00
dal 488bc596dc Refactor GitHub Actions workflow for enhanced deployment process
- Added a new job for database deployment, including steps for installing Rust, configuring AWS credentials, downloading the Postgres certificate from S3, and running migrations.
- Updated the existing porter-deploy job to include AWS credentials configuration and SSL certificate download from S3.
- Improved organization and reliability of the deployment process by ensuring all steps are correctly defined and executed in the appropriate context.

These changes streamline the deployment workflow and enhance the overall reliability of the application deployment process.
2025-01-03 16:49:28 -07:00
porter-deployment-app[bot] a34312f64f
Create porter_app_main_3155.yml file 2025-01-03 23:46:52 +00:00
dal 44af558fa9
Merge pull request #7 from buster-so/staging
Staging
2025-01-03 15:40:55 -08:00
dal c23ca4c36e Update GitHub Actions workflow to set working directory for migrations
- Added a working-directory specification for the 'Run migrations' step in the GitHub Actions workflow, ensuring that Diesel migrations are executed in the correct context within the './api' directory. This change enhances the reliability of the migration process during deployment.
2025-01-03 16:39:26 -07:00
dal 501b8031a4 Update GitHub Actions workflow to use new S3 URL for Postgres SSL certificate
- Changed the S3 URL variable for downloading the Postgres SSL certificate in the GitHub Actions workflow from `PG_CERT_S3_URL` to `CERT_S3_URL`.
- This update ensures the workflow correctly references the updated secret for SSL certificate retrieval, improving the reliability of the deployment process.
2025-01-03 16:29:21 -07:00
dal 5f6792484a Enhance GitHub Actions workflow and Dockerfile for SSL certificate management
- Added steps to configure AWS credentials and download the Postgres SSL certificate from S3 in the GitHub Actions workflow.
- Updated the Dockerfile to reflect the new path for the SSL certificate, ensuring it is correctly copied to the container.

These changes improve the security and organization of SSL certificate handling during the deployment process.
2025-01-03 16:25:39 -07:00
dal 0ef11c1971 Update SSL certificate handling in GitHub Actions workflow and Dockerfile
- Changed the directory structure for SSL certificates in the GitHub Actions workflow, creating a new path `certs/cert` for better organization.
- Updated the Dockerfile to reference the new certificate path, ensuring the SSL certificate is correctly installed in the container.

These changes improve the clarity and maintainability of the deployment process.
2025-01-03 16:19:02 -07:00
dal 11ee658d39 Fix Ubuntu version format in GitHub Actions workflow for staging deployment 2025-01-03 16:18:07 -07:00
dal 78da6550d1 Fix GitHub Actions workflow configuration for staging deployment
- Updated the runner specification for the database-deploy job to correct the Ubuntu version format.
- Ensured consistency in the runner configuration for the porter-deploy job by reverting to the previous Ubuntu version.

These changes enhance the accuracy of the workflow configuration, ensuring proper execution of deployment jobs.
2025-01-03 16:17:24 -07:00
dal 31bfaaeecf Update GitHub Actions workflow and Dockerfile for SSL certificate handling
- Added steps to create a directory for SSL certificates and copy the downloaded certificate to the new location in the GitHub Actions workflow.
- Updated the Dockerfile to reference the new certificate path, ensuring proper installation of the SSL certificate in the container.

These changes improve the organization of SSL certificates and enhance the deployment process.
2025-01-03 16:12:31 -07:00
dal fe6cf9d945 Enhance GitHub Actions workflow for staging deployment
- Added support for pull requests targeting the staging branch to the existing workflow.
- This change improves the deployment process by ensuring that pull requests are also considered for staging deployments.
2025-01-03 15:59:25 -07:00
dal 03f522dddb Refactor GitHub Actions workflow for staging deployment
- Introduced a new job for database deployment, including steps to install Rust, cache dependencies, and run Diesel migrations.
- Updated the existing porter-deploy job to include AWS credentials configuration and SSL certificate retrieval from S3.
- Enhanced the overall structure and organization of the workflow for improved clarity and maintainability.
2025-01-03 15:56:44 -07:00
dal fb4efe1610
Merge pull request #6 from buster-so:dal/bi-api
Dal/bi-api
2025-01-03 14:34:50 -08:00
dal 3ab1f6a66d Update Dependabot configuration for cargo packages
- Changed the directory for the buster-cli package from "/packages/buster-cli" to "/cli".
- Added a new configuration for the cargo package in the "/api" directory.
- Updated scheduling and branch settings for both packages to improve dependency management.

These changes streamline the dependency update process and enhance the organization of package configurations.
2025-01-03 15:31:33 -07:00
dal fccccc75af Merge remote-tracking branch 'origin/staging' into dal/bi-api 2025-01-03 15:30:53 -07:00
dal d41206cbf1
Merge pull request #5 from buster-so/porter-stack-staging-bed642d5
Enable Porter Application staging
2025-01-03 14:30:18 -08:00
porter-deployment-app[bot] 8ac228cca6
Create porter_app_staging_3155.yml file 2025-01-03 22:28:53 +00:00
dal bdc3c10712 Brought in the bi-api 2025-01-03 14:32:54 -07:00
dal 4569c64f23
Merge pull request #4 from buster-so/dal/buster-cli
Refactor buster-cli model structures and update YAML templates
2025-01-03 12:27:41 -08:00
dal ad16e55cce Merge remote-tracking branch 'origin/main' into dal/buster-cli 2025-01-03 13:27:16 -07:00
dal d4bd71b988 Refactor buster-cli model structures and update YAML templates
- Renamed `semantic_models` to `models` in YAML template and related structures for consistency.
- Changed `expr` field type in `PostDatasetsEntityRelationshipsRequest` from `Vec<String>` to `String` to simplify data handling.
- Updated `BusterModel` struct to reflect the new `models` naming and removed unused `ModelDefaults` struct.
- Adjusted tests to align with the updated model structure.

These changes enhance clarity and maintainability in the model representation and data handling within the buster-cli.
2025-01-03 13:26:48 -07:00
dal bc4fd6c8b3
Merge pull request #3 from buster-so/dal/buster-cli
Refactor buster-cli model structures and update YAML templates
2025-01-02 15:49:02 -08:00
dal a8e270a5f4 Merge remote-tracking branch 'origin/main' into dal/buster-cli 2025-01-02 16:48:28 -07:00
dal 1cff6c01e4 Refactor buster-cli model structures and update YAML templates
- Renamed `semantic_models` to `models` in YAML template and related structures for consistency.
- Changed `expr` field type in `PostDatasetsEntityRelationshipsRequest` from `Vec<String>` to `String` to simplify data handling.
- Updated `BusterModel` struct to reflect the new `models` naming and removed unused `ModelDefaults` struct.
- Adjusted tests to align with the updated model structure.

These changes enhance clarity and maintainability in the model representation and data handling within the buster-cli.
2025-01-02 16:48:10 -07:00
dal 93c7546e60
Merge pull request #2 from buster-so/dal/buster-cli
Buster CLI init
2024-12-05 13:39:58 -08:00
Dallin Bentley 26198ab926 Update dependabot configuration: Set target branch to 'main', add labels for dependencies, and customize commit message format with prefix and scope inclusion. 2024-12-05 14:33:34 -07:00
Dallin Bentley 518c2f7ec7 Enhance buster-cli: Improve initialization process and model file handling
- Added a TODO in the init function for ID retrieval and storage in artifacts.
- Introduced an optional `sql_definition` field in `PostDatasetsRequest` for better model representation.
- Refactored `get_model_files` to support recursive directory processing, improving model file retrieval.
- Implemented logging for model file uploads to Buster, enhancing operational visibility.

These changes streamline the initialization and model file management, laying the groundwork for future enhancements.
2024-12-04 20:26:39 -07:00
Dallin Bentley 87cc56f9b9 Merge branch 'main' into dal/buster-cli 2024-12-04 20:24:41 -07:00
dal 196bb8cbf5
Merge pull request #1 from buster-so/dal/security-md
Create SECURITY.md
2024-12-04 19:21:27 -08:00
dal 5835037eb0
Create SECURITY.md 2024-12-04 19:21:14 -08:00
Dallin Bentley ed1e28da1c Enhance buster-cli initialization and model file handling
- Added a TODO in the init function to retrieve and store IDs in artifacts.
- Introduced an optional `sql_definition` field in the `PostDatasetsRequest` struct for better model representation.
- Refactored `get_model_files` to process directories recursively, improving model file retrieval.
- Added logging for model file uploads to Buster, enhancing visibility during operations.

These changes improve the initialization process and enhance the handling of model files, setting the stage for future features.
2024-11-26 16:09:48 -07:00
Dallin Bentley 3ddab17ff3 Implement error handling improvements and remove unused templates in buster-cli
- Added conversion from `anyhow::Error` to `BusterError` for better error management.
- Deleted unused `buster_model.rs` and `buster_project.rs` template files to clean up the codebase.
- Enhanced the `deploy` command with improved error handling and credential validation.
- Updated model file handling to support optional model definitions.

This commit streamlines error handling and reduces clutter in the project structure.
2024-11-26 14:36:38 -07:00
Dallin Bentley 1f6e6c68c6 Refactor buster-cli: Simplify Deploy command by removing parameters, update deploy function signature, and enhance model file handling with new data structures for YAML parsing. Cleaned up init function and removed unnecessary comments. 2024-11-26 10:47:43 -07:00
Dallin Bentley d616f98c90 putting the init function back bc I accidentally deleted it 2024-11-26 08:48:08 -07:00
Dallin Bentley 6194f61356 Refactor buster-cli: Remove init and credentials modules, introduce buster_credentials module, and enhance API client. Added ratatui dependency for improved UI. Updated credential handling and API key validation logic. Implemented new data source posting functionality. 2024-11-26 08:46:09 -07:00
Dallin Bentley 785fe6f237 Enhance buster-cli initialization with dbt project integration and user selection. Added MultiSelect for existing dbt projects, improved credential handling, and refactored profile management in YAML. Introduced new dbt module for profiles and connection configurations. 2024-11-25 17:44:10 -07:00
Dallin Bentley 3a40be46cc check api key on init 2024-11-25 15:13:46 -07:00
Dallin Bentley 2642739bdb added in more configs 2024-11-25 12:49:05 -07:00
Dallin Bentley 1c5d13b25d modelfile helper and starting point for fields. 2024-11-25 11:46:48 -07:00
Dallin Bentley a6c5dff778 add in buster-cli and start prepping for analytics/bi app 2024-11-21 15:47:21 -07:00
Dallin Bentley 14d801f44a path fix on env 2024-09-11 11:27:45 -06:00