| Parameters | Default | Note |
|---|
| spark.auron.enable | true | Enable/disable auron engine. |
| spark.auron.batchSize | 10000 | Suggested batch size for arrow batches. |
| spark.auron.memoryFraction | 0.6 | Suggested fraction of off-heap memory used in native execution. Actual off-heap memory usage is expected to be spark.executor.memoryOverhead * fraction. |
| spark.auron.tokio.num.worker.threads | 1 | Number of worker threads used in tokio runtime, 0 to use default available parallelism value. For CPUs those support hyperthreading, it is recommended to set this value to the number of available physical cores. |
| spark.auron.enableInputBatchStatistics | true | Enable extra metrics of input batch statistics. |
| spark.auron.partialAggSkipping.enable | true | Enable partial aggregate skipping. (see https://github.com/auron-init/auron/issues/327) |
| spark.auron.partialAggSkipping.ratio | 0.8 | Partial aggregate skipping ratio. |
| spark.auron.partialAggSkipping.minRows | 20000 | Minimum number of rows to trigger partial aggregate skipping. |
| spark.auron.parquet.enable.pageFiltering | false | Parquet enable page filtering. |
| spark.auron.parquet.enable.bloomFilter | false | Parquet enable bloom filter. |
| spark.auron.forceShuffledHashJoin | false | Replace all sort-merge join to shuffled-hash join, only used for special benchmarking. |
| Parameters | Default |
|---|
| spark.auron.enable.scan | true |
| spark.auron.enable.project | true |
| spark.auron.enable.filter | true |
| spark.auron.enable.sort | true |
| spark.auron.enable.union | true |
| spark.auron.enable.smj | true |
| spark.auron.enable.shj | true |
| spark.auron.enable.bhj | true |
| spark.auron.enable.bnlj | true |
| spark.auron.enable.local.limit | true |
| spark.auron.enable.global.limit | true |
| spark.auron.enable.take.ordered.and.project | true |
| spark.auron.enable.aggr | true |
| spark.auron.enable.expand | true |
| spark.auron.enable.window | true |
| spark.auron.enable.generate | true |
| spark.auron.enable.local.table.scan | true |
| spark.auron.enable.data.writing | false |
