-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DateTime reader support #133
Comments
I think this might just be a bug on this line with the wrong/incomplete storage type listed Line 227 in a21df68
The Parquet.jl/src/PAR2/PAR2_types.jl Line 11 in a21df68
From the same file: type |
We need to have an implementation that can decode Int64 logical timestamps and then plug it in there. This is the format specification: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#timestamp. The |
Is it currently possible to read data in as a
DateTime
? If not, what would need to be done for this to be added?(Sort of partner to #108, although i don't know how related reader and writer support are).
Current behaviour seems to be to read datetimes in as
Int64
values.For example, generating some data in Python:
and then reading it in Julia
i’ve tried to use the
map_logical_types
keyword, for exampleDict(["datetime_utc"] => (DateTime, Parquet.logical_timestamp))
, but this errors withERROR: unsupported storage type 2 for DateTime
.The text was updated successfully, but these errors were encountered: