hms-mirror

Added saveWorkingTables to cli and web ui options.

hms-mirror

What's New
BEHAVIOR CHANGE - Drop any shadow table definitions created during migration automatically

hms-mirror

Error event is not logged for table skipped because RIGHT already has the table
Would be great to be able to omit warnings from the end of logs
Be able to reduce spring framework related log entries

hms-mirror

Bug Fixes

• Doubling of mapping locations for partitions in distcp for STORAGE_MIGRATION.
• STORAGE_MIGRATION is setting ACID to ON, regardless.

What's New

• Validate JDBC Jar Files in config.
• Ability to turn-on strict mode for Storage Migration. This will cause distcp to fail when non-standard locations are used. To turn off, use the -sms|--storage-migration-strict flag via the CLI.

Behavior Changes

The default behavior for Storage Migration 'strict' has changed from true to false. The intent behind the strict mode was to ensure distcp would fail when non-standard locations are used. The combination of metastore_direct and knowing the partition location details gives us a better chance on making these mappings work for distcp. When the scenario arises, we do HIGHLY recommend that you validate the plans created. The new default behavior will allow distcp to continue when non-standard locations are encountered, while throwing a warning. This will allow the migration to continue, but you should validate the results.

You will need to reset the `strict` mode flag in you configuration yaml. It will be set to `true` if the configuration was created before this release. You will need to set it to `false` to maintain this new 'preferred' behavior.

transfer:
  storageMigration:
    strict: false

hms-mirror

Bug Fixes

• Doubling of mapping locations for partitions in distcp for STORAGE_MIGRATION.
• STORAGE_MIGRATION is setting ACID to ON, regardless.

What's New

• Validate JDBC Jar Files in config.
• Ability to turn-on strict mode for Storage Migration. This will cause distcp to fail when non-standard locations are used. To turn off, use the -sms|--storage-migration-strict flag via the CLI.

Behavior Changes

The default behavior for Storage Migration 'strict' has changed from true to false. The intent behind the strict mode was to ensure distcp would fail when non-standard locations are used. The combination of metastore_direct and knowing the partition location details gives us a better chance on making these mappings work for distcp. When the scenario arises, we do HIGHLY recommend that you validate the plans created. The new default behavior will allow distcp to continue when non-standard locations are encountered, while throwing a warning. This will allow the migration to continue, but you should validate the results.

You will need to reset the `strict` mode flag in you configuration yaml. It will be set to `true` if the configuration was created before this release. You will need to set it to `false` to maintain this new 'preferred' behavior.

transfer:
  storageMigration:
    strict: false

hms-mirror

Fixed

• Property overrides - po|pol|por - are not honored in v2, were working in 1.6.x: #156
• Partition auto-discovery config value is misconfigured during setup: #155
• Enhancement for hms-mirror setup: #154
• Remove automatic DB location as db_name.db in db location: #153
• Add support for Hive table backup in DISTCP mode: #152

New

• Beta Flag to be used for future beta features.

hms-mirror

BETA RELEASE

Fixed

• Property overrides - po|pol|por - are not honored in v2, were working in 1.6.x: #156
• Partition auto-discovery config value is misconfigured during setup: #155
• Enhancement for hms-mirror setup: #154
• Remove automatic DB location as db_name.db in db location: #153
• Add support for Hive table backup in DISTCP mode: #152

New

• Beta Flag to be used for future beta features.

hms-mirror

Extend / Split 'transfer-ownership' to apply to database and/or table: #151

DB Prefix and DB Rename not working: #150

Support alternate db name for STORAGE_MIGRATION: #149

hms-mirror

Missing CR/LF in Clean up scripts.

hms-mirror

Skip Database Location Updates for STORAGE_MIGRATION: #147