Skip to content

Schema Change: Field deprecations/sunsetting#155

Merged
fivetran-avinash merged 11 commits into
mainfrom
schema-change/field-deprecations-and-sunsetting
Apr 29, 2026
Merged

Schema Change: Field deprecations/sunsetting#155
fivetran-avinash merged 11 commits into
mainfrom
schema-change/field-deprecations-and-sunsetting

Conversation

@fivetran-avinash

@fivetran-avinash fivetran-avinash commented Apr 27, 2026

Copy link
Copy Markdown
Contributor

PR Overview

Package version introduced in this PR:

  • 1.8.0

This PR addresses the following Issue/Feature(s):

  • GA-1019139

Summary of changes:

  • Deprecated/sunsetted fields no longer used in Shopify connector

Submission Checklist

  • SHOPIFY-SPECIFIC: If you added a field to any model with metafields, did you increase the relevant column count in the downstream_model_column_count macro?
  • Alignment meeting with the reviewer (if needed)
    • Timeline and validation requirements discussed
  • Provide validation details:
    • Validation Steps: Check for unintentional effects (e.g., add/run consistency & integrity tests)
    • Testing Instructions: Confirm the change addresses the issue(s)
    • Focus Areas: Complex logic or queries that need extra attention
  • Merge any relevant open PRs into this PR

Changelog

  • Draft changelog for PR
  • Final changelog for release review

@fivetran-avinash fivetran-avinash self-assigned this Apr 27, 2026
@fivetran-avinash fivetran-avinash marked this pull request as ready for review April 27, 2026 20:08
Comment thread CHANGELOG.md Outdated
| ------------- | ----------- | --- | --- | ----- |
| `shopify__order_lines` | Removed columns | `variant_fulfillment_service`<br>`variant_grams`<br>`variant_weight`<br>`variant_weight_unit`<br>`variant_option_1`<br>`variant_option_2`<br>`variant_option_3` | | Completes deprecation of `product_variant` source, [which was removed in earlier Shopify connector updates](https://fivetran.com/docs/connectors/applications/shopify/changelog#january2025). |
| `shopify__inventory_levels` | Removed columns | `variant_fulfillment_service`<br>`variant_inventory_management`<br>`variant_grams`<br>`variant_weight`<br>`variant_weight_unit`<br>`variant_option_1`<br>`variant_option_2`<br>`variant_option_3` | | Columns sourced from deprecated `product_variant` source, [removed in earlier Shopify connector updates](https://fivetran.com/docs/connectors/applications/shopify/changelog#january2025). |
| `shopify__daily_shop`<br>`shopify_gql__daily_shop` | Data changes | Order metrics may be inflated | Order metrics now correctly calculated | Soft-deleted staging shop records filtered out, which previously could incorrectly inflate metrics. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| `shopify__daily_shop`<br>`shopify_gql__daily_shop` | Data changes | Order metrics may be inflated | Order metrics now correctly calculated | Soft-deleted staging shop records filtered out, which previously could incorrectly inflate metrics. |
| `shopify__daily_shop`<br>`shopify_gql__daily_shop` | Data changes | Order metrics may be inflated | Order metrics now correctly calculated | Soft-deleted staging shop records are now filtered out, which previously could have incorrectly inflated metrics. |

Comment thread CHANGELOG.md

## Documentation
- Adds deprecation notes to fields no longer supported by the connector. These fields now return null and will be removed in a future release.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should there be an under the hood entry about adjusting the horizontal integrity test?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd say no, as we are trying to tighten up our changelogs to be more customer-focused and the customer won't really have interest in what our internal tests are.

Comment thread CHANGELOG.md Outdated
| `shopify__order_lines` | Removed columns | `variant_fulfillment_service`<br>`variant_grams`<br>`variant_weight`<br>`variant_weight_unit`<br>`variant_option_1`<br>`variant_option_2`<br>`variant_option_3` | | Completes deprecation of `product_variant` source, [which was removed in earlier Shopify connector updates](https://fivetran.com/docs/connectors/applications/shopify/changelog#january2025). |
| `shopify__inventory_levels` | Removed columns | `variant_fulfillment_service`<br>`variant_inventory_management`<br>`variant_grams`<br>`variant_weight`<br>`variant_weight_unit`<br>`variant_option_1`<br>`variant_option_2`<br>`variant_option_3` | | Columns sourced from deprecated `product_variant` source, [removed in earlier Shopify connector updates](https://fivetran.com/docs/connectors/applications/shopify/changelog#january2025). |
| `shopify__daily_shop`<br>`shopify_gql__daily_shop` | Data changes | Order metrics may be inflated | Order metrics now correctly calculated | Soft-deleted staging shop records filtered out, which previously could incorrectly inflate metrics. |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add deprecated columns to table.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good callout! Adding that in.

description: (DEPRECATED) The number of times that the redeem code has been used. This field now returns null following a connector update and will be removed in a future release.
- name: code
description: The redeemable code that a customer can enter at checkout (e.g., `SUMMER20`).
- name: created_by_description

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neither the body_html or published_scope field from the stg_shopify_gql__product model is documented in the yml, but they should probably be added and then documented as being deprecated. Same goes for pre_tax_price and pre_tax_price_set from the stg_shopify_gql__order_line model, inventory_quantity_management, inventory_quantity_adjustment, and presentment_prices fields from the stg_shopify_gql__product_variant model, and the cost field from the stg_shopify_gql__inventory_item.sql model.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, did not realize that!

description: (DEPRECATED) The number of times that the redeem code has been used. This field now returns null following a connector update and will be removed in a future release.
- name: code
description: The redeemable code that a customer can enter at checkout (e.g., `SUMMER20`).
- name: created_by_description

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same general comment as in src.yml, there appear to be several fields on the to-be-deprecated list that were never documented in the first place.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See the src yml comment.

@fivetran-savage fivetran-savage left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@fivetran-avinash fivetran-avinash added the docs:ready Triggers the docs generator workflow. label Apr 29, 2026
Comment thread CHANGELOG.md Outdated
Comment on lines +16 to +17
## Feature Updates
- Applied removal (or deprecation) of equivalent fields above to the upstream staging models.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would just remove this since there is no new information.

Suggested change
## Feature Updates
- Applied removal (or deprecation) of equivalent fields above to the upstream staging models.

Comment thread CHANGELOG.md Outdated

| Data Model(s) | Change type | Old | New | Notes |
| ------------- | ----------- | --- | --- | ----- |
| `shopify__order_lines` | Removed columns | `variant_fulfillment_service`<br>`variant_grams`<br>`variant_weight`<br>`variant_weight_unit`<br>`variant_option_1`<br>`variant_option_2`<br>`variant_option_3` | | [Completes removal of deprecated fields from January updates](https://fivetran.com/docs/connectors/applications/shopify/changelog#january2025). |

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to standardize on “remove” or “sunset”? The PR title uses “sunset,” and that’s what we’ve used in other packages, so I’d lean toward “sunset” for consistency--but open to thoughts. Maybe post in the team channel if you want to discuss.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call, let's use sunset, it's the more appropriate term in this case.

@fivetran-avinash fivetran-avinash added docs:ready Triggers the docs generator workflow. and removed docs:ready Triggers the docs generator workflow. labels Apr 29, 2026
@fivetran-avinash fivetran-avinash merged commit d768d54 into main Apr 29, 2026
8 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs:ready Triggers the docs generator workflow.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants