Warehouse Observability Enhancements
Improved event discard reasons for enhanced observability.
Available Plans
- free
- growth
- enterprise
less than a minute
- Date: Nov 20, 2024
RudderStack’s latest warehouse observability enhancements give you detailed insights into why the data going to a warehouse destination was discarded, especially in cases where there is a data type mismatch and the event data does not conform to the Warehouse Schema.
How the feature works
RudderStack discards any event data going into a warehouse destination that does not strictly conform to the Warehouse Schema spec and cannot be fixed.
In such cases, RudderStack puts the discarded records into a rudder_discards table along with a reason. With the latest observability enhancements, the reasons will give more insights on exactly why the data was discarded.
Some examples are shown below:
incompatible schema conversion from string to booleanincompatible schema conversion from string to intincompatible schema conversion from datetime to stringincompatible schema conversion from bigint to float
