Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KAFKA-3968: fsync the parent directory of a segment file when the file is created #10405

Merged
merged 27 commits into from
Apr 3, 2021
Merged

KAFKA-3968: fsync the parent directory of a segment file when the file is created #10405

merged 27 commits into from
Apr 3, 2021
+80 −19

Commits on Mar 25, 2021

  1. [KAFKA-3968] fsync the parent directory of a segment file when the fi… 

    …le is created
    @ccding
    ccding committed Mar 25, 2021
    Configuration menu
    Copy the full SHA
    459facb View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2021

  1. move import

    @ccding
    ccding committed Mar 26, 2021
    Configuration menu
    Copy the full SHA
    b4c8284 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2021

  1. address comments (except the topic partition one)

    @ccding
    ccding committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    b260169 View commit details
    Browse the repository at this point in the history

  2. remove import

    @ccding
    ccding committed Mar 29, 2021
    Configuration menu
    Copy the full SHA
    ba086e9 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2021

  1. reuse the function in utils.java

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    2a19e0e View commit details
    Browse the repository at this point in the history

  2. simplify logic

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    40a1abe View commit details
    Browse the repository at this point in the history

  3. default changeFileSuffixes flush to true

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    1ac80b6 View commit details
    Browse the repository at this point in the history

  4. flush when mkdirs

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    09cac0b View commit details
    Browse the repository at this point in the history

  5. revert accidential change

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    5be95aa View commit details
    Browse the repository at this point in the history

  6. atomicMoveWithFallback

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    c9448c8 View commit details
    Browse the repository at this point in the history

  7. no flush parent dir in test

    @ccding
    ccding committed Mar 30, 2021
    Configuration menu
    Copy the full SHA
    daeb698 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2021

  1. check null pointer

    @ccding
    ccding committed Mar 31, 2021
    Configuration menu
    Copy the full SHA
    0d4800b View commit details
    Browse the repository at this point in the history

  2. fix unit test error

    @ccding
    ccding committed Mar 31, 2021
    Configuration menu
    Copy the full SHA
    95a6c3f View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2021

  1. set flag after flush

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    8c859f3 View commit details
    Browse the repository at this point in the history

  2. disable flushing on renameTo

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    fdc1faa View commit details
    Browse the repository at this point in the history

  3. address comments based on offline discussion with Jun

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    6795ec9 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'trunk' into fsync

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    55ae3bc View commit details
    Browse the repository at this point in the history

  5. check hadCleanShutdown for open FileRecord

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    e653af4 View commit details
    Browse the repository at this point in the history

  6. address comments

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    85861ee View commit details
    Browse the repository at this point in the history

  7. fix default values

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    1578678 View commit details
    Browse the repository at this point in the history

  8. more default value

    @ccding
    ccding committed Apr 1, 2021
    Configuration menu
    Copy the full SHA
    fffc353 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2021

  1. do flush in the LogSegment class

    @ccding
    ccding committed Apr 2, 2021
    Configuration menu
    Copy the full SHA
    f66c545 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'trunk' into fsync

    @ccding
    ccding committed Apr 2, 2021
    Configuration menu
    Copy the full SHA
    56be9d8 View commit details
    Browse the repository at this point in the history

  3. remove parameter from FileRecord.open

    @ccding
    ccding committed Apr 2, 2021
    Configuration menu
    Copy the full SHA
    1ecf94b View commit details
    Browse the repository at this point in the history

  4. default to false

    @ccding
    ccding committed Apr 2, 2021
    Configuration menu
    Copy the full SHA
    080a79a View commit details
    Browse the repository at this point in the history

  5. add param to javadoc

    @ccding
    ccding committed Apr 2, 2021
    Configuration menu
    Copy the full SHA
    61eee4a View commit details
    Browse the repository at this point in the history

  6. during flush -> during the next flush

    @ccding
    ccding committed Apr 2, 2021
    Configuration menu
    Copy the full SHA
    7543938 View commit details
    Browse the repository at this point in the history