Skip to content

Ability to merge ranges and create a larger token range to reduce number of tasks #141

Description

@parekuti

FiloDB is very good at parallelism and performance, but if someone wants to increase concurrency they should have options to control number of tasks.

Please refer to the link for spark connector code on how to control the number of tasks getting created during full table scan.

https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector/src/main/scala/com/datastax/spark/connector/rdd/partitioner/CassandraPartitionGenerator.scala

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions