An error is reported during Phoenix service query. The number of

[Problem Description]

A Phoenix service query error is reported, and the number of concurrent queries reaches the upper limit.

org.apache.phoenix.exception.PhoenixIOException: Task org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask@6c0f32a6 rejected from org.apache.phoenix.job.JobManager$1@5e9e266e[Running, pool size = 128, active threads = 127, queued tasks = 5000, completed tasks = 1]

         at org.apache.phoenix.util.ServerUtil.parseServerException(ServerUtil.java:120)

         at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:1024)

         at org.apache.phoenix.iterate.BaseResultIterators.getIterators(BaseResultIterators.java:916)

         at org.apache.phoenix.iterate.RoundRobinResultIterator.getIterators(RoundRobinResultIterator.java:176)

         at org.apache.phoenix.iterate.RoundRobinResultIterator.next(RoundRobinResultIterator.java:91)

         at org.apache.phoenix.jdbc.PhoenixResultSet.next(PhoenixResultSet.java:779)

         at com.main.opdata.OpDataQueryBytime2.queryLoad(OpDataQueryBytime2.java:81)

         at com.main.opdata.OpDataQueryBytime2.query(OpDataQueryBytime2.java:66)

         at com.main.opdata.OpDataTask.run(OpDataTask.java:29)

         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

         at java.lang.Thread.run(Thread.java:748)

[Analysis Process]

1. Print query SQL execution plans. A maximum of 6236 tasks need to be started concurrently. By default, a maximum of 5000 tasks can be started at a time.

[Root Cause]

The number of concurrent query tasks is too large. The default number of tasks cannot meet the configuration requirements.

[Workaround]

Add the following configurations to the hbase-site.xml file on the service side to improve the query concurrency:

phoenix.query.threadPoolSize =512
phoenix.query.queueSize=10000

Determine the size of phoenix.query.queueSize based on the number of chunks printed in the execution plan.