Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDFS-10930.07.patch #160

Closed
wants to merge 3 commits into from
Closed

HDFS-10930.07.patch #160

wants to merge 3 commits into from

Conversation

xiaoyuyao
Copy link
Contributor

Create a PR for easy review.

Copy link
Contributor

@arp7 arp7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @xiaoyuyao. The patch looks good overall. Findbugs flagged a few warnings and the TestWriteToReplica failure looks related.

There's a few remaining static methods like Storage#rename, and DatanodeUtil#createTmpFile that aren't as easy to factor out. We can look at them in a subsequent Jira.

In a subsequent change we'll want to move the refactored methods into interfaces for testability and optional instrumentation.

@xiaoyuyao
Copy link
Contributor Author

Update PR to fix the findbugs and unit test failure.

Copy link
Contributor

@arp7 arp7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 LGTM, pending Jenkins.

@xiaoyuyao xiaoyuyao changed the title HDFS-10930.05.patch HDFS-10930.07.patch Nov 29, 2016
@xiaoyuyao xiaoyuyao closed this Nov 29, 2016
@xiaoyuyao xiaoyuyao deleted the HDFS-10930 branch November 30, 2016 06:26
@xiaoyuyao xiaoyuyao restored the HDFS-10930 branch December 6, 2016 04:44
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
We will compute triggering duration as follows:
- If user configures `task.window.ms` we will honor it as the triggering duration
- If not, we will use the `GCD(windowTriggerDurations, joinTTLs)` as the triggering duration.

Changes in this PR:
- Common Interface for all time based triggers
- Additional APIs in `StreamGraphImpl` to recursively traverse all `OperatorSpec`s
- Recursive computation of `triggerInterval` for each `WindowOperatorSpec`
- Tests for all the above

Author: vjagadish1989 <[email protected]>

Reviewers: Prateek Maheshwari <[email protected]>, Jacob Maes <[email protected]>, Xinyu Liu <[email protected]>

Closes apache#160 from vjagadish1989/samza-1155
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants