Type Mapping Between MapR Database JSON and DataFrames
This table maps data types between MapR Database JSON OJAI and Apache Spark DataFrame.
Note: Not all DataFrame data types are supported by MapR Database, for a list of supported data types, see JSON Documents.
| OJAI Data Type | DataFrame Data Type |
|---|---|
| Boolean | BooleanType |
| String | StringType |
| Byte | ByteType |
| Short | ShortType |
| Int | IntegerType |
| Long | LongType |
| Float | FloatType |
| Double | DoubleType |
| Decimal | DecimalType |
| Date | DateType |
| Time | TimestampType |
| TimeStamp | TimeStampType |
| Interval | CalendarIntervalType |
| Binary | BinaryType |
| Map | StructType |
| Array | ArrayType |
Note: The OJAI
Time data type is converted to a Spark
TimestampType with the date set to the epoch date. Spark SQL does not
support a TIME type.