Type Mapping Between MapR Database JSON and DataFrames
This table maps data types between MapR Database JSON OJAI and Apache Spark DataFrame.
OJAI Data Type | DataFrame Data Type |
---|---|
Boolean | BooleanType |
String | StringType |
Byte | ByteType |
Short | ShortType |
Int | IntegerType |
Long | LongType |
Float | FloatType |
Double | DoubleType |
Decimal | DecimalType |
Date | DateType |
Time | TimestampType |
TimeStamp | TimeStampType |
Interval | CalendarIntervalType |
Binary | BinaryType |
Map | StructType |
Array | ArrayType |
Time
data type is converted to a Spark
TimestampType
with the date set to the epoch date. Spark SQL does not
support a TIME
type.