You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[C++][Python] Use timestamp_parsers as a fallback for CSV time columns #54651
CSV columns typed as time32 or time64 are parsed only from the ISO-8601 format, and ConvertOptions.timestamp_parsers applies only to timestamp columns:
pyarrow.lib.ArrowInvalid: In CSV column #0: CSV conversion error to time32[s]: invalid value '14.30.00'
The workaround is to read the column as a timestamp and cast it to a time. I propose that time columns try timestamp_parsers after the ISO-8601 parser fails, and take the time of day of the parsed timestamp, as a cast from timestamp to time does.
An implementation exists in #50146, which is being refactored into smaller PRs.
Activity