[ad_1]
I am reading orc file with following data
| C1 | C2 |
| 1 | 1954E7 |
My column c1 should be int and c2 should be string but spark is interpreting the c2 as decimal. I tried following code to overcome it
spark.read.option("inferSchema","false").option("header", "true").load("path to file")
But spark orc reader still reads the data with schema even though I force it to turn off the inferschema. Is there a way to force spark not to read the schema and I apply my custom schema later after the read?
[ad_2]