Regression: list of blocked/blocking tasks not shown for tasks with more than 100 related tasks
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Nemo_bis
	Jul 14 2016, 7:00 AM

Description

Issue:

Phabricator was upgraded on July 13th and that upgrade included the new "Task Graph" functionality. This graph functionality is unable to deal with very very large sets of dependent tasks (eg: many of our tracking tasks or other tasks with many sub-tasks or tasks being subtasks of tracking tasks). This initially prevented the task page from loading at all.

Temporary fix:

We have committed a temporary fix (authored by upstream) to disable the graph on tasks that have more than 100 related (sub- or parent) tasks.

Temporary workaround for lost functionality:

For tasks that the list of sub-tasks and parents tasks are not shown you can view them via "Edit related tasks" and selecting either "Edit Parent Tasks" or "Edit Subtasks" as appropriate. The full list will be displayed there and you can click on the icon to the left of the task title to open the task in a new browser tab.

Plan:

A real fix is in the works upstream to deal with this corner case more gracefully.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		• mmodell	T140326 Phabricator task graphs need a limit on how big they draw
		Resolved		• mmodell	T140333 Regression: list of blocked/blocking tasks not shown for tasks with more than 100 related tasks

Event Timeline

Nemo_bis created this task.Jul 14 2016, 7:00 AM

Restricted Application added subscribers: Zppix, TerraCodes, Aklapper. · View Herald TranscriptJul 14 2016, 7:00 AM

That's temporary hack ATM because of T140326: Phabricator task graphs need a limit on how big they draw.

See T140326#2460857 for some context., plus discussion in -devtools and -operations.

In T140333#2460981, @Danny_B wrote:

That's temporary hack ATM because of T140326: Phabricator task graphs need a limit on how big they draw.

Thanks. Reverting to known-working Phabricator code would have been better, what now?

Peachey88 added a parent task: T140326: Phabricator task graphs need a limit on how big they draw.Jul 14 2016, 7:29 AM

This is hardly an unbreak! now issue.

See T140207: Consider alternative processes for Unbreak Now bugs, especially those which cross-cut components

This is an upstream change and we will most likely wait for an upstream solution.

Restricted Application added a project: Upstream. · View Herald TranscriptJul 14 2016, 8:59 AM

Paladox subscribed.Jul 14 2016, 8:59 AM

greg renamed this task from Regression: list of blocked/blocking tasks disappeared to Regression: list of blocked/blocking tasks not shown for tasks with more than 100 subtasks.Jul 14 2016, 3:15 PM

greg merged a task: T140351: Phabricator no longer displays blocking tasks if there are more than 100 of them.

greg added a subscriber: matmarex.

I can no longer see the subtasks of T107037 (without attempting to edit them). I think this is a major issue. It should at least fall back to a simple list of direct blocking/blocked tasks.

The summary change was incorrect; the count of 100 considers tasks other than subtasks, too.

Nemo_bis raised the priority of this task from Low to Needs Triage.Jul 14 2016, 5:09 PM

Peachey88 merged a task: T140425: Overuse of tracking bugs makes dependencies inaccessible.Jul 14 2016, 10:13 PM

Peachey88 added subscribers: MaxSem, Peachey88.

greg merged a task: T140428: Need replacement for "task graph" for tasks with big graphs.Jul 14 2016, 10:41 PM

greg added a subscriber: Smalyshev.

Smalyshev awarded a token.Jul 14 2016, 10:43 PM

greg triaged this task as High priority.Jul 14 2016, 10:46 PM

greg updated the task description. (Show Details)

greg updated the task description. (Show Details)Jul 14 2016, 11:14 PM

greg updated the task description. (Show Details)

Danny_B updated the task description. (Show Details)Jul 14 2016, 11:22 PM

Perhaps I'm oversimplifying, but… can't we just do this?

diff --git a/src/utils/AbstractDirectedGraph.php b/src/utils/AbstractDirectedGraph.php
index 40242fa..5771827 100644
--- a/src/utils/AbstractDirectedGraph.php
+++ b/src/utils/AbstractDirectedGraph.php
@@ -218,6 +218,7 @@ abstract class AbstractDirectedGraph extends Phobject {
    * @task build
    */
   final public function loadGraph() {
+    $max_nodes = 100;
 
     $new_nodes = $this->knownNodes;
     while (true) {
@@ -230,11 +231,13 @@ abstract class AbstractDirectedGraph extends Phobject {
         }
       }
 
-      if (empty($load)) {
-        break;
-      }
-
+      $max_to_load = $max_nodes - count($this->knownNodes);
       $load = array_keys($load);
+      $load = array_slice($load, 0, $max_to_load);
+
+      if (empty($load)) {
+        break;
+      }
 
       $new_nodes = $this->loadEdges($load);
       foreach ($load as $node) {

This already loads the nodes in breadth-first order, so it should load the directly blocked/blocking tasks first, then blocked/blocking tasks of them, etc.

greg mentioned this in T140326: Phabricator task graphs need a limit on how big they draw.Jul 15 2016, 1:04 AM

Fixed in https://phabricator.wikimedia.org/rPHABcf12fdf248df82dc414d96bddd147c058bc3d636 which has been deployed to phab-01.wmflabs.org

See task there at https://phab-01.wmflabs.org/T63 please.

If no issue arise it will deployed here soon.

In T140333#2464797, @matmarex wrote:

Perhaps I'm oversimplifying, but… can't we just do this?

diff --git a/src/utils/AbstractDirectedGraph.php b/src/utils/AbstractDirectedGraph.php
index 40242fa..5771827 100644
--- a/src/utils/AbstractDirectedGraph.php
+++ b/src/utils/AbstractDirectedGraph.php
@@ -218,6 +218,7 @@ abstract class AbstractDirectedGraph extends Phobject {
    * @task build
    */
   final public function loadGraph() {
+    $max_nodes = 100;
 
     $new_nodes = $this->knownNodes;
     while (true) {
@@ -230,11 +231,13 @@ abstract class AbstractDirectedGraph extends Phobject {
         }
       }
 
-      if (empty($load)) {
-        break;
-      }
-
+      $max_to_load = $max_nodes - count($this->knownNodes);
       $load = array_keys($load);
+      $load = array_slice($load, 0, $max_to_load);
+
+      if (empty($load)) {
+        break;
+      }
 
       $new_nodes = $this->loadEdges($load);
       foreach ($load as $node) {

This already loads the nodes in breadth-first order, so it should load the directly blocked/blocking tasks first, then blocked/blocking tasks of them, etc.

@matmarex: What good does that do when there are more than 100 subtasks? There needs to be a fallback, apparently.

matmarex awarded a token.Jul 15 2016, 4:06 PM

Ok, I now see the list of dependencies in the details at https://phabricator.wikimedia.org/T72163 and elsewhere. Thanks.

Nemo_bis mentioned this in T140077: Replace tracking T40638 by "Voice & Tone".Sep 15 2016, 1:01 PM

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Regression: list of blocked/blocking tasks not shown for tasks with more than 100 related tasksClosed, ResolvedPublicActions