Skip to content
This repository was archived by the owner on Feb 8, 2019. It is now read-only.

fix GEARPUMP-110, try streaming kmeans on Gearpump#5

Open
gy910210 wants to merge 1 commit intoapache:masterfrom
gy910210:kmeans
Open

fix GEARPUMP-110, try streaming kmeans on Gearpump#5
gy910210 wants to merge 1 commit intoapache:masterfrom
gy910210:kmeans

Conversation

@gy910210
Copy link
Contributor

No description provided.

@manuzhang
Copy link
Member

+1, Thanks.

previousNumber += currentNumber
currentNumber = 0
}
val newPoint = dataQueue.take()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a blocking call. We suggest against block in Task. You may use "poll" instead.

@manuzhang
Copy link
Member

sorry, I was too optimistic previously. This example contains a cycle which cause the generation of process levels into dead loop. Please check https://github.com/apache/incubator-gearpump/blob/master/core/src/main/scala/io/gearpump/util/Graph.scala#L380

@gy910210
Copy link
Contributor Author

gy910210 commented May 3, 2016

@manuzhang Yes, I find that vertexHierarchyLevelMap() can cause dead loop if graph contains circle. But for topology sorting, the graph will call topologicalOrderWithCirclesIterator() if contains circle. So can we make vertexHierarchyLevelMap() possible to support circles in graph?

@manuzhang
Copy link
Member

Yes, please create a jira issue and open an PR if you've got a solution.

manuzhang added a commit to manuzhang/incubator-gearpump that referenced this pull request Jan 24, 2017
Author: manuzhang <owenzhang1990@gmail.com>

Closes apache#5 from manuzhang/upgrade.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants