(Glue-2108) Q: Can we replicate SAP time stamps into a more speaking format than the SAP data element TIMESTAMP provides?
Timestamps from SAP can be adjusted to external formats. To achieve this, the following is needed: when specifying fields to hold timestamp in Glue table definition, you have to change data element TIMESTAMP to data type STRING.
Following that, you need to convert the timestamp to a specified format – the easiest way to do it is to create universal include, that can handle this conversion for any timestamp field. Then you simply create a routine in an extractor and pin in this include
The code can look something like this (works in every routine for each and every field with a timestamp, but timestamp cannot be initial):
CONCATENATE
cv_field(4) `-` cv_field+4(2) `-` cv_field+6(2)
` `
cv_field+8(2) `:` cv_field+10(2) `:` cv_field+12(2)
cv_field+14 INTO cv_field.
The result will look like this:
Alternatively, you can adjust timestamp format to anything that suits you and the data scientists on the Hadoop side would need even more.