Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

doc(partner_sdk): Alter Table operation guidelines #71

Merged
merged 4 commits into from
Oct 15, 2024

Conversation

fivetran-rishabhghosh
Copy link
Contributor

@fivetran-rishabhghosh fivetran-rishabhghosh commented Oct 9, 2024

Links https://fivetran.height.app/T-797932/description
Add guidelines for Alter Table operation

Copy link

height bot commented Oct 9, 2024

This pull request has been linked to 1 task:

💡Tip: Add "Close T-797932" to the pull request title or description, to a commit message, or in a comment to mark this task as "Done" when the pull request is merged.

Copy link
Contributor

@fivetran-dejantucakov fivetran-dejantucakov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-rishabhghosh Please see suggestions and comments.

development-guide.md Outdated Show resolved Hide resolved
development-guide.md Outdated Show resolved Hide resolved
development-guide.md Outdated Show resolved Hide resolved
fivetran-rishabhghosh and others added 2 commits October 14, 2024 23:28
Co-authored-by: Dejan Tucakov <141165749+fivetran-dejantucakov@users.noreply.github.com>
@fivetran-rishabhghosh
Copy link
Contributor Author

@fivetran-dejantucakov Updated

Copy link
Contributor

@fivetran-dejantucakov fivetran-dejantucakov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-rishabhghosh Please see suggestions.

Co-authored-by: Dejan Tucakov <141165749+fivetran-dejantucakov@users.noreply.github.com>
Copy link
Contributor

@fivetran-dejantucakov fivetran-dejantucakov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-rishabhghosh Approved, tnx!

@fivetran-rishabhghosh fivetran-rishabhghosh merged commit a19be3b into main Oct 15, 2024
1 check passed
@fivetran-rishabhghosh fivetran-rishabhghosh deleted the dev-guide-update-alter-request branch October 15, 2024 13:28
@@ -125,6 +125,10 @@ This operation should report all columns in the destination table, including Fiv
- This operation might be requested for a table that does not exist in the destination. In that case, it should NOT fail, simply ignore the request and return `success = true`.
- `utc_delete_before` has millisecond precision.

#### AlterTable
- This operation should be used for changing primary key columns, adding columns, and changing data types.
- However, this operation should not drop any columns even if the `AlterTable` request has a table with a different set of columns. Dropping columns could lead to unexpected customer data loss and is against Fivetran's general approach to data movement.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This doesn't say what they should do. i'd also love to link to a doc that describes our policy/what we usually do - ie not dropping columns/deleting data - but I didn't just find a suitable link.

eg 'this operation should not drop any columns even if the 'AlterTabel' request has a table with a different set of columns. Fivetran's approach to data movement is to leave such columns in a customer's warehouse with no additional data populating to provide the customer control and choice on timing for removal. Dropping columns can lead to unexpected customer data loss.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants