0.0.3

版本发布时间: 2023-09-26 07:20:32

Dataherald/dataherald最新发布版本:1.0.3(2024-04-30 23:22:47)

When a database connection is created or updated, it now attempts to establish a connection.
If the connection is successfully established, it is stored, and a 200 response is returned.
In case of failure, a 400 error response is generated.

With the latest update, when creating or updating a database connection, you have the option to set LLM credentials. This allows you to use different keys for different connections

3. SSH Connection Update https://github.com/Dataherald/dataherald/commit/a66f7d899cb06ef6ad07777574dbbf7d56652e34

We have discontinued the use of the private_key_path field for SSH connections.
Instead, we now utilize the path_to_credentials_file to specify the path to the SSH private key file.

We have implemented background tasks for asynchronous table scanning.
The endpoint name has been updated from /api/v1/table-descriptions/scan to /api/v1/table-descriptions/sync-schemas.
This enhancement ensures that even if the process operates slowly, potentially taking several minutes, the HTTP response remains consistently fast and responsive.

This endpoint /api/v1/table-descriptions should make a db connection to retrieve all the table names and check which tables have been scanned to generate a response.
The status can be:
- NOT_SYNCHRONIZED if the table has not been scanned
- SYNCHRONIZING while the sync schema process is running
- DEPRECATED if there is a row in our table-descriptions collection that is no longer in the database, probably because the table/view was deleted or renamed
- SYNCHRONIZED when we have scanned the table
- FAILED if anything failed during the sync schema process, and the error_message field stores the error.

This script facilitates the transition from version v0.0.2 to v0.0.3 by performing the following essential task: In the table_descriptions collection, it updates the status field to the value SYNCHRONIZED.

To execute the script, simply run the following command:

docker-compose exec app python3 -m dataherald.scripts.migrate_v002_to_v003