Skip to content

HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable #147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable #147

wants to merge 1 commit into from

Conversation

QwertyManiac
Copy link
Contributor

@QwertyManiac QwertyManiac commented Oct 26, 2016 •
edited
Loading

  • Allowed the sync interval size to be configurable via a new parameter in the Writer argument API
  • New default sync interval size is 200 KiB
  • Added tests with varied sync interval sizes, and kept a test for the older default as-is for compatibility checks
  • Moved some older Reader API usage in modified tests to support newer constructions

@QwertyManiac QwertyManiac force-pushed the HADOOP-1381 branch 2 times, most recently from cad79b9 to 937269b Compare November 16, 2016 05:18
@QwertyManiac QwertyManiac changed the title HADOOP-1381. The distance between sync blocks in SequenceFiles should… HADOOP-1381. The distance between sync blocks in SequenceFiles should be configurable Nov 16, 2016
HADOOP-1381. The distance between sync blocks in SequenceFiles should…
25d97f6 
… be configurable rather than hard coded to 2000 bytes.
@QwertyManiac
Copy link
Contributor Author

Fixed via 07825f2

@QwertyManiac QwertyManiac deleted the HADOOP-1381 branch November 25, 2016 16:57
This was referenced Aug 3, 2021
Merged
Merged
Closed
Merged
Closed
Merged
This was referenced Aug 10, 2021
Merged
Merged
Closed
Open
Merged
Draft
Merged
Merged
This was referenced Aug 19, 2021
Merged
Merged
Merged
Closed
This was referenced Aug 26, 2021
Merged
Closed
Closed
Merged
This was referenced May 14, 2025
Open
Open
Merged
Closed
Open
Merged
Open
Open
Open
Open
Merged
Merged
This was referenced May 21, 2025
Merged
Draft
Merged
Merged
Open
Open
Open
Merged
Closed
Open
Open
Open
Merged
Open
This was referenced May 28, 2025
Merged
Open
Merged
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@QwertyManiac