forked from kovyrin/hbase
-
Notifications
You must be signed in to change notification settings - Fork 0
/
CHANGES.txt
6044 lines (5769 loc) · 360 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
HBase Change Log
Release 0.94.15 - 12/17/2013
Bug
[HBASE-7886] - [replication] hlog zk node will not be deleted if client roll hlog
[HBASE-9485] - TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart
[HBASE-9995] - Not stopping ReplicationSink when using custom implementation for the ReplicationSink
[HBASE-10014] - HRegion#doMiniBatchMutation rollbacks the memstore even if there is nothing to rollback.
[HBASE-10015] - Replace intrinsic locking with explicit locks in StoreScanner
[HBASE-10026] - HBaseAdmin#createTable could fail if region splits too fast
[HBASE-10046] - Unmonitored HBase service could accumulate Status objects and OOM
[HBASE-10057] - TestRestoreFlushSnapshotFromClient and TestRestoreSnapshotFromClient fail to finish occasionally
[HBASE-10061] - TableMapReduceUtil.findOrCreateJar calls updateMap(null, ) resulting in thrown NPE
[HBASE-10064] - AggregateClient.validateParameters can throw NPE
[HBASE-10089] - Metrics intern table names cause eventual permgen OOM in 0.94
[HBASE-10111] - Verify that a snapshot is not corrupted before restoring it
[HBASE-10112] - Hbase rest query params for maxVersions and maxValues are not parsed
[HBASE-10117] - Avoid synchronization in HRegionScannerImpl.isFilterDone
[HBASE-10120] - start-hbase.sh doesn't respect --config in non-distributed mode
[HBASE-10179] - HRegionServer underreports readRequestCounts by 1 under certain conditions
[HBASE-10181] - HBaseObjectWritable.readObject catches DoNotRetryIOException and wraps it back in a regular IOException
Improvement
[HBASE-9931] - Optional setBatch for CopyTable to copy large rows in batches
[HBASE-10001] - Add a coprocessor to help testing the performances without taking into account the i/o
[HBASE-10007] - PerformanceEvaluation: Add sampling and latency collection to randomRead test
[HBASE-10010] - eliminate the put latency spike on the new log file beginning
[HBASE-10048] - Add hlog number metric in regionserver
[HBASE-10049] - Small improvments in region_mover.rb
[HBASE-10093] - Unregister ReplicationSource metric bean when the replication source thread is terminated
New Feature
[HBASE-9047] - Tool to handle finishing replication when the cluster is offline
[HBASE-10119] - Allow HBase coprocessors to clean up when they fail
Task
[HBASE-9927] - ReplicationLogCleaner#stop() calls HConnectionManager#deleteConnection() unnecessarily
[HBASE-9986] - Incorporate HTTPS support for HBase (0.94 port)
Test
[HBASE-10058] - Test for HBASE-9915 (avoid reading index blocks)
[HBASE-10189] - Intermittent TestReplicationSyncUpTool failure
Release 0.94.14 - 11/18/2013
Sub-task
[HBASE-9165] - Improvements to addDependencyJars
Bug
[HBASE-9138] - getHaseIntegrationTestingUtility() is misspelled
[HBASE-9799] - Change Hadoop 1.2 dependency to 1.2.1
[HBASE-9809] - RegionTooBusyException should provide region name which was too busy
[HBASE-9834] - Minimize byte[] copies for 'smart' clients
[HBASE-9849] - [REST] Forbidden schema delete in read only mode
[HBASE-9850] - Issues with UI for table compact/split operation completion. After split/compaction operation using UI, the page is not automatically redirecting back using IE8/Firefox.
[HBASE-9865] - Reused WALEdits in replication may cause RegionServers to go OOM
[HBASE-9872] - ModifyTable does not modify the attributes of a newly modified/changed ColumnDescriptor
[HBASE-9890] - MR jobs are not working if started by a delegated user
[HBASE-9902] - Region Server is starting normally even if clock skew is more than default 30 seconds(or any configured). -> Regionserver node time is greater than master node time
[HBASE-9906] - Restore snapshot fails to restore the meta edits sporadically
[HBASE-9915] - Performance: isSeeked() in EncodedScannerV2 always returns false
[HBASE-9952] - Snapshot restore may fail due to NullPointerException
[HBASE-9956] - Remove keyLength cache from KeyValue
[HBASE-9970] - HBase BulkLoad, table is creating with the timestamp key also as a column to the table.
[HBASE-9971] - Port part of HBASE-9958 to 0.94 - change lock scope in locateRegion
[HBASE-9975] - Not starting ReplicationSink when using custom implementation for the ReplicationSink.
[HBASE-9993] - 0.94: HBASE-9865 breaks coprocessor compatibility with WALEdit.
Improvement
[HBASE-4654] - [replication] Add a check to make sure we don't replicate to ourselves
[HBASE-8438] - Extend bin/hbase to print a "mapreduce classpath"
[HBASE-9715] - Backport -in_memory option support for LoadTestTool from trunk
[HBASE-9831] - 'hbasefsck.numthreads' property isn't passed to hbck via cmdline -D option
[HBASE-9894] - remove the inappropriate assert statement in Store.getSplitPoint()
[HBASE-9963] - Remove the ReentrantReadWriteLock in the MemStore
Test
[HBASE-8397] - improve unit-test coverage of package org.apache.hadoop.hbase.master.metrics (0.94)
[HBASE-8543] - fix coverage org.apache.hadoop.hbase.rest.client
[HBASE-8552] - fix coverage org.apache.hadoop.hbase.rest.filter
[HBASE-8556] - fix coverage org.apache.hadoop.hbase.metrics.histogram
[HBASE-8557] - fix coverage org.apache.hadoop.hbase.rest.metrics
[HBASE-8559] - increase unit-test coverage of package org.apache.hadoop.hbase.coprocessor
Release 0.94.13 - 10/29/2013
Sub-task
[HBASE-9711] - Improve HBASE-9428 - avoid copying bytes for RegexFilter unless necessary
Bug
[HBASE-7600] - TestAdmin.testCreateBadTables is failing occasionally
[HBASE-8521] - Cells cannot be overwritten with bulk loaded HFiles
[HBASE-9430] - Memstore heapSize calculation - DEEP_OVERHEAD is incorrect
[HBASE-9504] - Backport HBASE-1212 to 0.94
[HBASE-9548] - Cleanup SnapshotTestingUtils
[HBASE-9607] - Data loss after snapshot restore into cloned table
[HBASE-9649] - HFilePrettyPrinter should not throw a NPE if FirstKey or LastKey is null.
[HBASE-9651] - Backport HBASE-3890 'Scheduled tasks in distributed log splitting not in sync with ZK' to 0.94
[HBASE-9727] - HBase Rest Server - DELETE scanner operation is a no-op
[HBASE-9731] - updatesBlockedSeconds RegionServer metric should not be a histogram
[HBASE-9732] - Static AtomicLong updated in StoreFileScanner every (re)seek
[HBASE-9737] - Corrupt HFile cause resource leak leading to Region Server OOM
[HBASE-9745] - Append HBASE_CLASSPATH to end of Java classpath and use another env var for prefix
[HBASE-9747] - PrefixFilter with OR condition gives wrong results
[HBASE-9751] - Excessive readpoints checks in StoreFileScanner
[HBASE-9753] - Excessive readpoint checks in MemstoreScanner
[HBASE-9783] - o.a.h.h.r.HRegion.mutateRow() with non-existent CF cause NPE
[HBASE-9789] - Change logging for Coprocessor exec call to trace
[HBASE-9807] - block encoder unnecessarily copies the key for each reseek
[HBASE-9842] - Backport HBASE-9593 and HBASE-8667 to 0.94
[HBASE-9847] - HConnectionImplementation does not connect to new active master
Improvement
[HBASE-9221] - Provide interface for getting a User in the client
[HBASE-9488] - Improve performance for small scan
[HBASE-9716] - LoadTestTool should provide default min and max settings to the data generator
[HBASE-9749] - Custom threadpool for Coprocessor obtained HTables
Task
[HBASE-9819] - Backport HBASE-8372 'Provide mutability to CompoundConfiguration' to 0.94
Test
[HBASE-8553] - improve unit-test coverage of package org.apache.hadoop.hbase.mapreduce.hadoopbackport
[HBASE-9851] - TestHBaseFsck.testQuarantineMissingHFile is flaky
[HBASE-9852] - TestRpcMetrics.testCustomMetrics is flaky
Release 0.94.12 - 9/19/2013
Sub-task
[HBASE-9277] - REST should use listTableNames to list tables
[HBASE-9279] - Thrift should use listTableNames to list tables
Bug
[HBASE-7709] - Infinite loop possible in Master/Master replication
[HBASE-7954] - Fix the retrying logic of memstore flushes to avoid extra sleep
[HBASE-8760] - possible loss of data in snapshot taken after region split
[HBASE-8930] - Filter evaluates KVs outside requested columns
[HBASE-9167] - ServerCallable retries just once if timeout is not integer.max
[HBASE-9182] - Allow non-admin users to list all table names
[HBASE-9195] - Fix TestFSHDFSUtils against java7 test re-ordering
[HBASE-9207] - An Offline SplitParent Region can be assigned breaking split references
[HBASE-9231] - Multipage book is generated to the wrong location
[HBASE-9233] - isTableAvailable() may be stuck if an offline parent was never assigned
[HBASE-9252] - HConnectionManager#getZooKeeperWatcher() should be deprecated in 0.94
[HBASE-9256] - HBaseClient#setupIOStreams should handle all exceptions
[HBASE-9266] - Javadoc: Document that HBaseAdmin.flush(...) is synchronous
[HBASE-9286] - [0.94] ageOfLastShippedOp replication metric doesn't update if the slave regionserver is stalled
[HBASE-9301] - Default hbase.dynamic.jars.dir to hbase.rootdir/jars
[HBASE-9303] - Snapshot restore of table which splits after snapshot was taken encounters 'Region is not online'
[HBASE-9326] - ServerName is created using getLocalSocketAddress, breaks binding to the wildcard address. Revert HBASE-8640
[HBASE-9329] - SnapshotManager should check for directory existance before throwing a warning.
[HBASE-9344] - RegionServer not shutting down upon KeeperException in open region
[HBASE-9356] - [0.94] SecureServer.INSECURE_VERSIONS is declared incorrectly
[HBASE-9397] - Snapshots with the same name are allowed to proceed concurrently
[HBASE-9415] - In rpcServer, replicationQueue is initialized with the max queue size instead of the max queue lenght
[HBASE-9428] - Regex filters are at least an order of magnitude slower since 0.94.3
[HBASE-9429] - Add back MetaScanner.allTableRegions(Configuration conf,byte[] tablename,boolean offlined) method
[HBASE-9432] - Backport HBASE-8781 to 0.94
[HBASE-9448] - [0.94] Shell needs to fall back after HBASE-9182 if talking to older servers
[HBASE-9455] - Port HBASE-7113 'TestGzipFilter is flaky with jdk1.7' to 0.94
[HBASE-9468] - Previous active master can still serves RPC request when it is trying recovering expired zk session
[HBASE-9482] - Do not enforce secure Hadoop for secure HBase
[HBASE-9506] - [0.94] Backport HBASE-9309 The links in the backup masters template are bad
[HBASE-9534] - Short-Circuit Coprocessor HTable access when on the same server
[HBASE-9566] - Add back WALEdit#get/setScopes method
[HBASE-9584] - Short-Circuit Coprocessor doesn't correctly lookup table when on server
Improvement
[HBASE-9243] - Add more useful statistics in the HFile tool
[HBASE-9314] - Dropping a table always prints a TableInfoMissingException in the master log
Task
[HBASE-9153] - Introduce/update a script to generate jdiff reports
[HBASE-9377] - Backport HBASE- 9208 "ReplicationLogCleaner slow at large scale"
Test
[HBASE-9287] - TestCatalogTracker depends on the execution order
Release 0.94.11 - 8/13/2013
Sub-task
[HBASE-8779] - Add mutateRow method support to Thrift2
[HBASE-8946] - Add a new function to Thrift 2 to open scanner, get results and close scanner
[HBASE-8947] - Thrift 2 : Replace "bool writeToWAL" with "TDurability durability"
[HBASE-8948] - Bound table pool size in Thrift 2 server
Bug
[HBASE-6826] - [WINDOWS] TestFromClientSide failures
[HBASE-8067] - TestHFileArchiving.testArchiveOnTableDelete sometimes fails
[HBASE-8670] - [0.94] Backport HBASE-8449,HBASE-8204 and HBASE-8699 to 0.94 (Refactor recoverLease retries and pauses)
[HBASE-8698] - potential thread creation in MetaScanner.metaScan
[HBASE-8935] - IntegrationTestBigLinkedList fails under load on 0.94 due to some scan issues - add logging
[HBASE-8949] - hbase.mapreduce.hfileoutputformat.blocksize should configure with blocksize of a table
[HBASE-9026] - RestartRsHoldingRoot action in org.apache.hadoop.hbase.util.ChaosMonkey restarting the server holding .META. instead of -ROOT-
[HBASE-9032] - Result.getBytes() returns null if backed by KeyValue array
[HBASE-9048] - HCM throws NullPointerException under load
[HBASE-9050] - HBaseClient#call could hang
[HBASE-9060] - ExportSnapshot job fails if target path contains percentage character
[HBASE-9079] - FilterList getNextKeyHint skips rows that should be included in the results
[HBASE-9080] - Retain assignment should be used when re-enabling table(s)
[HBASE-9085] - Integration Tests fails because of bug in teardown phase where the cluster state is not being restored properly.
[HBASE-9087] - Handlers being blocked during reads
[HBASE-9097] - Set HBASE_CLASSPATH before rest of the classpath
[HBASE-9115] - HTableInterface.append operation may overwrites values
[HBASE-9120] - ClassFinder logs errors that are not
[HBASE-9146] - TestHTablePool hangs when run as part of runMediumTests profile
[HBASE-9158] - Serious bug in cyclic replication
[HBASE-9189] - IncreasingToUpperBoundRegionSplitPolicy.shouldSplit() should check all the stores before returning.
[HBASE-9200] - HFilePrettyPrinter finds incorrect largest row
Improvement
[HBASE-6580] - Deprecate HTablePool in favor of HConnection.getTable(...)
[HBASE-8995] - Add hadoop-1.2 profile
[HBASE-9019] - Port HBASE-8690: Reduce unnecessary getFileStatus hdfs calls in TTL hfile and hlog cleanners to 0.94
[HBASE-9029] - Backport HBASE-8706 Some improvement in snapshot to 0.94
[HBASE-9132] - Use table dir modtime to avoid scanning table dir to check cached table descriptor in 0.94
[HBASE-9139] - Independent timeout configuration for rpc channel between cluster nodes
New Feature
[HBASE-7826] - Improve Hbase Thrift v1 to return results in sorted order
[HBASE-8663] - a HBase Shell command to list the tables replicated from current cluster
Test
[HBASE-8816] - Add support of loading multiple tables into LoadTestTool
[HBASE-9075] - [0.94] Backport HBASE-5760 Unit tests should write only under /target to 0.94
[HBASE-9090] - cleanup snapshot tests setup/teardown code
[HBASE-9106] - Do not fail TestAcidGuarantees for exceptions on table flush
[HBASE-9107] - [0.94] Backport HBASE-6950 TestAcidGuarantees system test now flushes too aggressively to 0.94
Release 0.94.10 - 7/19/2013
Sub-task
[HBASE-8774] - Add BatchSize and Filter to Thrift2
[HBASE-8819] - Port HBASE-5428 to Thrift 2
[HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
[HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
[HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to Thrift2 - Add BatchSize Test
[HBASE-8938] - Thrift2 does not close scanner instance
Bug
[HBASE-8432] - a table with unbalanced regions will balance indefinitely with the 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
[HBASE-8678] - Wrongly delete cells in some case which can not be deleted
[HBASE-8695] - The HBase thrift service ignores XML configuration
[HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
[HBASE-8782] - Thrift2 can not parse values when using framed transport
[HBASE-8794] - DependentColumnFilter.toString() throws NullPointerException
[HBASE-8811] - REST service ignores misspelled "check=" parameter, causing unexpected mutations
[HBASE-8814] - Possible NPE in split if a region has empty store files.
[HBASE-8858] - Backport hbase-6979 "recovered.edits file should not break distributed log splitting"
[HBASE-8910] - HMaster.abortNow shouldn't try to become a master again if it was stopped
[HBASE-8967] - Duplicate call to snapshotManager.stop() in HRegionServer
[HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log the master address which already read from the zk.
[HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
[HBASE-8988] - Reuse the thread pool in the shell to not run out of threads
Improvement
[HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is minimal
[HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
[HBASE-8806] - Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.
[HBASE-8809] - Include deletes in the scan (setRaw) method does not respect the time range or the filter
[HBASE-8847] - Filter.transform() always applies unconditionally, even when combined in a FilterList
[HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test to Test MTTR) to 0.94
[HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
[HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and Improve ExplicitColumnTracker performance.
Task
[HBASE-8829] - Improve failed TestMetaScanner assert message so can see where/why failure
Test
[HBASE-7770] - minor integration test framework fixes
[HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
[HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is flaky
[HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow addition of more actions and policies.
[HBASE-8934] - Fix bunch of flaky tests
[HBASE-8969] - Backport HBASE-8535+HBASE-8586 TestHCM#testDeleteForZKConnLeak enhancement to 0.94
Release 0.94.9 - 6/24/2013
Sub-task
[HBASE-8453] - TestImportExport failing again due to configuration issues
Bug
[HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
[HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
[HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
[HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
[HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
[HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
[HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
[HBASE-8656] - Rpc call may not be notified in SecureClient
[HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
[HBASE-8684] - Table Coprocessor can't access external HTable by default
[HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
[HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
[HBASE-8742] - HTableDescriptor Properties not preserved when cloning
[HBASE-8743] - upgrade hadoop-23 version to 0.23.7
[HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
[HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
[HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
Improvement
[HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
[HBASE-8609] - Make the CopyTable support startRow, stopRow options
[HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
[HBASE-8683] - Add major compaction support in CompactionTool
[HBASE-8702] - Make WALEditCodec pluggable
New Feature
[HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
Task
[HBASE-8603] - Backport HBASE-6921 to 0.94
Release 0.94.8 - 5/22/2013
Sub-task
[HBASE-8381] - TestTableInputFormatScan on Hadoop 2 fails because YARN kills our applications
[HBASE-8399] - TestTableInputFormatScan2#testScanFromConfiguration fails on hadoop2 profile
Bug
[HBASE-7122] - Proper warning message when opening a log file with no entries (idle cluster)
[HBASE-7210] - Backport HBASE-6059 to 0.94
[HBASE-7921] - TestHFileBlock.testGzipCompression should ignore the block checksum
[HBASE-8282] - User triggered flushes does not allow compaction to get triggered even if compaction criteria is met
[HBASE-8327] - Consolidate class loaders
[HBASE-8354] - Backport HBASE-7878 'recoverFileLease does not check return value of recoverLease' to 0.94
[HBASE-8355] - BaseRegionObserver#pre(Compact|Flush|Store)ScannerOpen returns null
[HBASE-8377] - IntegrationTestBigLinkedList calculates wrap for linked list size incorrectly
[HBASE-8379] - bin/graceful_stop.sh does not return the balancer to original state
[HBASE-8385] - [SNAPSHOTS]: Restore fails to restore snapshot of a deleted table
[HBASE-8389] - HBASE-8354 forces Namenode into loop with lease recovery requests
[HBASE-8413] - Snapshot verify region will always fail if the HFile has been archived
[HBASE-8451] - MetricsMBeanBase has concurrency issues in init
[HBASE-8455] - Update ExportSnapshot to reflect changes in HBASE-7419
[HBASE-8464] - FastDiffEncoder - valueOffset calculation is incorrect
[HBASE-8483] - HConnectionManager can leak ZooKeeper connections when using deleteStaleConnection
[HBASE-8493] - Backport HBASE-8422, 'Master won't go down', to 0.94
[HBASE-8503] - Backport hbase-8483 "HConnectionManager can leak ZooKeeper connections when using deleteStaleConnection" to 0.94
[HBASE-8505] - References to split daughters should not be deleted separately from parent META entry
[HBASE-8509] - ZKUtil#createWithParents won't set data during znode creation when parent folder doesn't exit
[HBASE-8513] - [0.94] Fix class files with CRLF endings
[HBASE-8516] - FSUtils.create() fail with ViewFS
[HBASE-8525] - Use sleep multilier when choosing sinks in ReplicationSource
[HBASE-8530] - Refine error message from ExportSnapshot when there is leftover snapshot in target cluster
[HBASE-8538] - HBaseAdmin#isTableEnabled() should check table existence before checking zk state.
[HBASE-8539] - Double(or tripple ...) ZooKeeper listeners of the same type when Master recovers from ZK SessionExpiredException
[HBASE-8540] - SnapshotFileCache logs too many times if snapshot dir doesn't exists
[HBASE-8547] - Fix java.lang.RuntimeException: Cached an already cached block
[HBASE-8550] - 0.94 ChaosMonkey grep for master is too broad
[HBASE-8563] - Double count of read requests for Gets
[HBASE-8588] - [Documentation]: Add information about adding REST and Thrift API kerberos principals to HBase ACL table
Improvement
[HBASE-5930] - Limits the amount of time an edit can live in the memstore.
[HBASE-6870] - HTable#coprocessorExec always scan the whole table
[HBASE-8345] - Add all available resources in o.a.h.h.rest.RootResource and VersionResource to o.a.h.h.rest.client.RemoteAdmin
[HBASE-8350] - enable ChaosMonkey to run commands as different users
[HBASE-8367] - LoadIncrementalHFiles does not return an error code nor throw Exception when failures occur due to timeouts
[HBASE-8383] - Support lib/*jar inside coprocessor jar
[HBASE-8405] - Add more custom options to how ClusterManager runs commands
[HBASE-8446] - Allow parallel snapshot of different tables
New Feature
[HBASE-7965] - Port table locking to 0.94 (HBASE-7305, HBASE-7546, HBASE-7933)
[HBASE-8415] - DisabledRegionSplitPolicy
Task
[HBASE-8574] - Add how to rename a table in the docbook
Test
[HBASE-8508] - improve unit-test coverage of package org.apache.hadoop.hbase.metrics.file
Release 0.94.7 - 4/24/2013
Sub-task
[HBASE-7615] - Add metrics for snapshots
[HBASE-7801] - Allow a deferred sync option per Mutation.
[HBASE-8210] - Backport the LoadTest portions of HBASE-7383
[HBASE-8316] - JoinedHeap for non essential column families should reseek instead of seek
Bug
[HBASE-7401] - Remove warning message about running 'hbase migrate'
[HBASE-7658] - grant with an empty string as permission should throw an exception
[HBASE-7817] - Suggested JDWP debug options in hbase-env.sh are wrong
[HBASE-7824] - Improve master start up time when there is log splitting work
[HBASE-7925] - Back port HBASE-6881 into 0.94
[HBASE-7961] - truncate on disabled table should throw TableNotEnabledException.
[HBASE-8014] - Backport HBASE-6915 to 0.94.
[HBASE-8030] - znode path of online region servers is hard coded in rolling_restart.sh
[HBASE-8044] - split/flush/compact/major_compact from hbase shell does not work for region key with \x format
[HBASE-8081] - Backport HBASE-7213 (separate hlog for meta tables) to 0.94
[HBASE-8092] - bulk assignment in 0.94 doesn't handle ZK errors very well
[HBASE-8096] - [replication] NPE while replicating a log that is acquiring a new block from HDFS
[HBASE-8118] - TestTablePermission depends on the execution order
[HBASE-8125] - HBASE-7435 breaks BuiltInGzipDecompressor on Hadoop < 1.0.x
[HBASE-8127] - Region of a disabling or disabled table could be stuck in transition state when RS dies during Master initialization
[HBASE-8128] - HTable#put improvements
[HBASE-8131] - Create table handler needs to handle failure cases.
[HBASE-8142] - Sporadic TestZKProcedureControllers failures on trunk
[HBASE-8146] - IntegrationTestBigLinkedList does not work on distributed setup
[HBASE-8150] - server should not produce RAITE for already-opening region in 0.94 (because master retry logic handles this case poorly)
[HBASE-8151] - Decode memstoreTS in HFileReaderV2 only when necessary
[HBASE-8158] - Backport HBASE-8140 "TableMapReduceUtils#addDependencyJar fails when nested inside another MR job"
[HBASE-8160] - HMaster#move doesn't check if master initialized
[HBASE-8166] - Avoid writing the memstoreTS into HFiles when possible
[HBASE-8169] - TestMasterFailover#testMasterFailoverWithMockedRITOnDeadRS may fail due to regions randomly assigned to a RS
[HBASE-8170] - HbaseAdmin.createTable cannot handle creating three regions
[HBASE-8176] - Backport HBASE-5335 "Dynamic Schema Configurations" to 0.94
[HBASE-8179] - JSON formatting for cluster status is sort of broken
[HBASE-8188] - Avoid unnecessary row compare in StoreScanner
[HBASE-8192] - Logic errror causes infinite loop in HRegion.bulkLoadHFiles(List)
[HBASE-8207] - Replication could have data loss when machine name contains hyphen "-"
[HBASE-8208] - In some situations data is not replicated to slaves when deferredLogSync is enabled
[HBASE-8211] - Support for NN HA for 0.94
[HBASE-8212] - Introduce a new separator instead of hyphen('-') for renaming recovered queues' znodes
[HBASE-8213] - global authorization may lose efficacy
[HBASE-8215] - Removing existing .regioninfo in writeRegioninfoOnFilesystem
[HBASE-8222] - User class should implement equals() and hashCode()
[HBASE-8225] - [replication] minor code bug when registering ReplicationLogCleaner
[HBASE-8226] - HBaseTestingUtility#waitUntilAllRegionsAssigned won't return if it counts "too many" regions
[HBASE-8229] - Replication code logs like crazy if a target table cannot be found.
[HBASE-8230] - Possible NPE on regionserver abort if replication service has not been started
[HBASE-8231] - delete tests in table_tests.rb(TestShell) always running on empty table.
[HBASE-8232] - TestAccessController occasionally fails with IndexOutOfBoundsException
[HBASE-8246] - Backport HBASE-6318 to 0.94 where SplitLogWorker exits due to ConcurrentModificationException
[HBASE-8259] - Snapshot backport in 0.94.6 breaks rolling restarts
[HBASE-8266] - Master cannot start if TableNotFoundException is thrown while partial table recovery
[HBASE-8270] - Backport HBASE-8097 'MetaServerShutdownHandler may potentially keep bumping up DeadServer.numProcessing' to 0.94
[HBASE-8274] - Backport to 94: HBASE-7488 Implement HConnectionManager.locateRegions which is currently returning null
[HBASE-8276] - Backport hbase-6738 to 0.94 "Too aggressive task resubmission from the distributed log manager"
[HBASE-8285] - HBaseClient never recovers for single HTable.get() calls with no retries when regions move
[HBASE-8288] - HBaseFileSystem: Refactoring and correct semantics for createPath methods
[HBASE-8303] - Increse the test timeout to 60s when they are less than 20s
[HBASE-8313] - Add Bloom filter testing for HFileOutputFormat
[HBASE-8326] - mapreduce.TestTableInputFormatScan times out frequently
[HBASE-8352] - Rename '.snapshot' directory
[HBASE-8427] - Apache Rat is incorrectly excluding test source files
Improvement
[HBASE-7410] - [snapshots] add snapshot/clone/restore/export docs to ref guide
[HBASE-7599] - Port HBASE-6066 (low hanging read path improvements) to 0.94
[HBASE-8148] - Allow IPC to bind on a specific address
[HBASE-8152] - Avoid creating empty reference file when splitkey is outside the key range of a store file
[HBASE-8174] - Backport HBASE-8161(setting blocking file count on table level doesn't work) to 0.94
[HBASE-8198] - Backport HBASE-8063(Filter HFiles based on first/last key) into 0.94
[HBASE-8199] - Eliminate exception for ExportSnapshot against the null table snapshot (with no data in)
[HBASE-8209] - Improve LoadTest extensibility
New Feature
[HBASE-1936] - ClassLoader that loads from hdfs; useful adding filters to classpath without having to restart services
[HBASE-7415] - [snapshots] Add task information to snapshot operation
Task
[HBASE-7929] - Reapply hbase-7507 "Make memstore flush be able to retry after exception" to 0.94 branch.
Test
[HBASE-8106] - Test to check replication log znodes move is done correctly
[HBASE-8260] - create generic integration test for trunk and 94 that is more deterministic, can be run for longer and is less aggressive
Release 0.94.6.1 - 4/13/2013
Bug
[HBASE-8259] - Snapshot backport in 0.94.6 breaks rolling restarts
Release 0.94.6 - 3/14/2013
Sub-task
[HBASE-7944] - Replication leaks file reader resource & not reset currentNbOperations
Bug
[HBASE-6132] - ColumnCountGetFilter & PageFilter not working with FilterList
[HBASE-6347] - -ROOT- and .META. are stale in table.jsp if they moved
[HBASE-6748] - Endless recursive of deleteNode happened in SplitLogManager#DeleteAsyncCallback
[HBASE-7111] - hbase zkcli will not start if the zookeeper server chosen to connect to is unavailable
[HBASE-7153] - print gc option in hbase-env.sh affects hbase zkcli
[HBASE-7507] - Make memstore flush be able to retry after exception
[HBASE-7521] - fix HBASE-6060 (regions stuck in opening state) in 0.94
[HBASE-7624] - Backport HBASE-5359 and HBASE-7596 to 0.94
[HBASE-7671] - Flushing memstore again after last failure could cause data loss
[HBASE-7700] - TestColumnSeeking is mathematically bound to fail
[HBASE-7723] - Remove NameNode URI from ZK splitlogs
[HBASE-7725] - Add ability to create custom compaction request
[HBASE-7761] - MemStore.USEMSLAB_DEFAULT is false, hbase-default.xml says it's true
[HBASE-7763] - Compactions not sorting based on size anymore.
[HBASE-7768] - zkcluster in local mode not seeing configurations in hbase-{site|default}.xml
[HBASE-7777] - HBCK check for lingering split parents should check for child regions
[HBASE-7813] - Bug in BulkDeleteEndpoint kills entire rows on COLUMN/VERSION Deletes
[HBASE-7814] - Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94
[HBASE-7829] - zookeeper kerberos conf keytab and principal parameters interchanged
[HBASE-7832] - Use User.getShortName() in FSUtils
[HBASE-7833] - 0.94 does not compile with Hadoop-0.20.205 and 0.22.0
[HBASE-7851] - Include the guava classes as a dependency for jobs using mapreduce.TableMapReduceUtil
[HBASE-7866] - TestSplitTransactionOnCluster.testSplitBeforeSettingSplittingInZK failed 3 times in a row
[HBASE-7867] - setPreallocSize is different with COMMENT in setupTestEnv in MiniZooKeeperCluster.java
[HBASE-7869] - Provide way to not start LogSyncer thread
[HBASE-7876] - Got exception when manually triggers a split on an empty region
[HBASE-7883] - Update memstore size when removing the entries in append operation
[HBASE-7884] - ByteBloomFilter's performance can be improved by avoiding multiplication when generating hash
[HBASE-7913] - Secure Rest server should login before getting an instance of Rest servlet
[HBASE-7914] - Port the fix of HBASE-6748 into 0.94 branch
[HBASE-7915] - Secure ThriftServer needs to login before calling HBaseHandler
[HBASE-7916] - HMaster uses wrong InetSocketAddress parameter to throw exception
[HBASE-7919] - Wrong key is used in ServerManager#getServerConnection() to retrieve from Map serverConnections
[HBASE-7920] - Move isFamilyEssential(byte[] name) out of Filter interface in 0.94
[HBASE-7945] - Remove flaky TestCatalogTrackerOnCluster
[HBASE-7986] - [REST] Make HTablePool size configurable
[HBASE-7991] - Backport HBASE-6479 'HFileReaderV1 caching the same parent META block could cause server abort when splitting' to 0.94
[HBASE-8007] - Adopt TestLoadAndVerify from BigTop
[HBASE-8019] - Port HBASE-7779 '[snapshot 130201 merge] Fix TestMultiParallel' to 0.94
[HBASE-8025] - zkcli fails when SERVER_GC_OPTS is enabled
[HBASE-8040] - Race condition in AM after HBASE-7521 (only 0.94)
[HBASE-8055] - Null check missing in StoreFile.Reader.getMaxTimestamp()
[HBASE-8061] - Missing test from TestFlushSnapshotFromClient in 0.94
[HBASE-8069] - TestHLog is dependent on the execution order
[HBASE-8085] - Backport the fix for Bytes.toStringBinary() into 94 (HBASE-6991)
[HBASE-8099] - ReplicationZookeeper.copyQueuesFromRSUsingMulti should not return any queues if it failed to execute.
[HBASE-8103] - Fix pom so 0.94 can generate site reports
Improvement
[HBASE-7818] - add region level metrics readReqeustCount and writeRequestCount
[HBASE-7827] - Improve the speed of Hbase Thirft Batch mutation for deletes
[HBASE-8031] - Adopt goraci as an Integration test
New Feature
[HBASE-4210] - Allow coprocessor to interact with batches per region sent from a client
[HBASE-7360] - Snapshot 0.94 Backport
Task
[HBASE-8088] - Versioning site: part one, put stake in the ground for 0.94 by copying current versions of book and site
[HBASE-8090] - Versioning site; part two, publish 0.94 site and add link from main site
Release 0.94.5 - 2/7/2013
Sub-task
[HBASE-2611] - Handle RS that fails while processing the failure of another one
[HBASE-7626] - Backport portions of HBASE-7460 to 0.94
[HBASE-7687] - TestCatalogTracker.testServerNotRunningIOException fails occasionally
[HBASE-7738] - REST server should publish metrics that are available via HTTP
Bug
[HBASE-5458] - Thread safety issues with Compression.Algorithm.GZ and CompressionTest
[HBASE-6513] - Test errors when building on MacOS
[HBASE-6824] - Introduce ${hbase.local.dir} and save coprocessor jars there
[HBASE-7034] - Bad version, failed OPENING to OPENED but master thinks it is open anyways
[HBASE-7293] - [replication] Remove dead sinks from ReplicationSource.currentPeers and pick new ones
[HBASE-7423] - HFileArchiver should not use the configuration from the Filesystem
[HBASE-7468] - TestSplitTransactionOnCluster hangs frequently
[HBASE-7476] - HBase shell count command doesn't escape binary output
[HBASE-7497] - TestDistributedLogSplitting.testDelayedDeleteOnFailure times out occasionally
[HBASE-7498] - Make REST server thread pool size configurable
[HBASE-7499] - TestScannerTimeout timeout is too aggressive.
[HBASE-7502] - TestScannerTimeout fails on snapshot branch
[HBASE-7504] - -ROOT- may be offline forever after FullGC of RS
[HBASE-7505] - Server will hang when stopping cluster, caused by waiting for split threads
[HBASE-7506] - Judgment of carrying ROOT/META will become wrong when expiring server
[HBASE-7513] - HDFSBlocksDistribution shouldn't send NPEs when something goes wrong
[HBASE-7515] - Store.loadStoreFiles should close opened files if there's an exception
[HBASE-7524] - hbase-policy.xml is improperly set thus all rules in it can be by-passed
[HBASE-7530] - [replication] Work around HDFS-4380 else we get NPEs
[HBASE-7531] - [replication] NPE in SequenceFileLogReader because ReplicationSource doesn't nullify the reader
[HBASE-7534] - [replication] TestReplication.queueFailover can fail because HBaseTestingUtility.createMultiRegions is dangerous
[HBASE-7545] - [replication] Break out TestReplication into manageable classes
[HBASE-7549] - Make HTableInterface#batch() javadoc proper
[HBASE-7550] - Synchronization problem in AssignmentManager
[HBASE-7551] - nodeChildrenChange event may happen after the transition to RS_ZK_REGION_SPLITTING in SplitTransaction causing the SPLIT event to be missed in the master side.
[HBASE-7562] - ZKUtil: missing "else condition" in multi processing
[HBASE-7575] - FSUtils#getTableStoreFilePathMap should all ignore non-table folders
[HBASE-7578] - TestCatalogTracker hangs occasionally
[HBASE-7581] - TestAccessController depends on the execution order
[HBASE-7584] - Improve TestAccessController.testAppend
[HBASE-7587] - Fix two findbugs warning in RowResource
[HBASE-7592] - HConnectionManager.getHTableDescriptor() compares too much
[HBASE-7602] - TestFromClientSide.testPoolBehavior is incorrect
[HBASE-7617] - TestHRegionOnCluster.testDataCorrectnessReplayingRecoveredEdits still fails occasionally.
[HBASE-7628] - Port HBASE-6509 fast-forwarding FuzzyRowFilter to 0.94
[HBASE-7643] - HFileArchiver.resolveAndArchive() race condition may lead to snapshot data loss
[HBASE-7644] - Port HBASE-4802 'Disable show table metrics in bulk loader' to 0.94
[HBASE-7646] - Make forkedProcessTimeoutInSeconds configurable
[HBASE-7647] - 0.94 hfiles v2.1 are not backwards compatible with HFilev2.0
[HBASE-7648] - TestAcidGuarantees.testMixedAtomicity hangs sometimes
[HBASE-7654] - Add List<String> getCoprocessors() to HTableDescriptor
[HBASE-7669] - ROOT region wouldn't be handled by PRI-IPC-Handler
[HBASE-7681] - Address some recent random test failures
[HBASE-7684] - NullPointerException in SecureClient when Call is cleaned up due to RPC timeout
[HBASE-7685] - Closing socket connection can't be removed from SecureClient
[HBASE-7693] - Hostname returned by TableInputFormatBase.reverseDNS contains trailing period
[HBASE-7694] - Secure HBase should use replication call queue
[HBASE-7698] - race between RS shutdown thread and openregionhandler causes region to get stuck
[HBASE-7702] - Adding filtering to Import jobs
[HBASE-7715] - FSUtils#waitOnSafeMode can incorrectly loop on standby NN
[HBASE-7717] - Wait until regions are assigned in TestSplitTransactionOnCluster
[HBASE-7728] - deadlock occurs between hlog roller and hlog syncer
[HBASE-7729] - TestCatalogTrackerOnCluster.testbadOriginalRootLocation fails occasionally
[HBASE-7730] - HBaseAdmin#synchronousBalanceSwitch is not compatible with 0.92
[HBASE-7731] - Append/Increment methods in HRegion don't check whether the table is readonly or not
[HBASE-7740] - Recheck matching row for joined scanners
[HBASE-7771] - Secure HBase Client in MR job causes tasks to wait forever
[HBASE-7772] - clusterId is not set in conf properly if only TableMapReduceUtil.initCredentials() is called
[HBASE-7776] - Use ErrorReporter/Log instead of System.out in hbck
[HBASE-7785] - rolling-restart.sh script unable to check expiration of master znode
[HBASE-7793] - Port HBASE-5564 Bulkload is discarding duplicate records to 0.94
Improvement
[HBASE-3996] - Support multiple tables and scanners as input to the mapper in map/reduce jobs
[HBASE-5416] - Improve performance of scans with some kind of filters.
[HBASE-5498] - Secure Bulk Load
[HBASE-5664] - CP hooks in Scan flow for fast forward when filter filters out a row
[HBASE-7441] - Make ClusterManager in IntegrationTestingUtility pluggable
[HBASE-7540] - Make znode dump to print a dump of replication znodes
[HBASE-7561] - Display the total number of regions for a given table on the master webUI
[HBASE-7757] - Add web UI to REST server and Thrift server
New Feature
[HBASE-6669] - Add BigDecimalColumnInterpreter for doing aggregations using AggregationClient
[HBASE-7748] - Add DelimitedKeyPrefixRegionSplitPolicy
Wish
[HBASE-7705] - Make the method getCurrentPoolSize of HTablePool public
Release 0.94.4 - 1/2/2013
Sub-task
[HBASE-3776] - Add Bloom Filter Support to HFileOutputFormat
[HBASE-6206] - Large tests fail with jdk1.7
[HBASE-7009] - Port HBaseCluster interface/tests to 0.94
[HBASE-7042] - Master Coprocessor Endpoint
[HBASE-7282] - Backport Compaction Tool to 0.94
[HBASE-7331] - Add access control for region open and close, row locking, and stopping the regionserver
[HBASE-7336] - HFileBlock.readAtOffset does not work well with multiple threads
[HBASE-7371] - Blocksize in TestHFileBlock is unintentionally small
[HBASE-7399] - Health check chore for HMaster
[HBASE-7406] - Example health checker script
[HBASE-7431] - TestSplitTransactionOnCluster tests still flaky
[HBASE-7438] - TestSplitTransactionOnCluster has too many infinite loops
Bug
[HBASE-6175] - TestFSUtils flaky on hdfs getFileStatus method
[HBASE-6317] - Master clean start up and Partially enabled tables make region assignment inconsistent.
[HBASE-6327] - HLog can be null when create table
[HBASE-6423] - Writes should not block reads on blocking updates to memstores
[HBASE-7091] - support custom GC options in hbase-env.sh
[HBASE-7158] - Allow CopyTable to identify the source cluster (for replication scenarios)
[HBASE-7165] - TestSplitLogManager.testUnassignedTimeout is flaky
[HBASE-7166] - TestSplitTransactionOnCluster tests are flaky
[HBASE-7172] - TestSplitLogManager.testVanishingTaskZNode() fails when run individually and is flaky
[HBASE-7177] - TestZooKeeperScanPolicyObserver.testScanPolicyObserver is flaky
[HBASE-7180] - RegionScannerImpl.next() is inefficient.
[HBASE-7205] - Coprocessor classloader is replicated for all regions in the HRegionServer
[HBASE-7214] - CleanerChore logs too much, so much so it obscures all else that is going on
[HBASE-7230] - port HBASE-7109 integration tests on cluster are not getting picked up from distribution to 0.94
[HBASE-7235] - TestMasterObserver is flaky
[HBASE-7251] - Avoid flood logs during client disconnect during batch get operation
[HBASE-7252] - TestSizeBasedThrottler fails occasionally
[HBASE-7259] - Deadlock in HBaseClient when KeeperException occured
[HBASE-7260] - Upgrade hadoop 1 dependency to hadoop 1.1.1
[HBASE-7273] - Upgrade zookeeper dependency to 3.4.5 for 0.94
[HBASE-7279] - Avoid copying the rowkey in RegionScanner, StoreScanner, and ScanQueryMatcher
[HBASE-7300] - HbckTestingUtil needs to keep a static executor to lower the number of threads used
[HBASE-7301] - Force ipv4 for unit tests
[HBASE-7307] - MetaReader.tableExists should not return false if the specified table regions has been split
[HBASE-7338] - Fix flaky condition for org.apache.hadoop.hbase.TestRegionRebalancing.testRebalanceOnRegionServerNumberChange
[HBASE-7342] - Split operation without split key incorrectly finds the middle key in off-by-one error
[HBASE-7343] - Fix flaky condition for TestDrainingServer
[HBASE-7357] - HBaseClient and HBaseServer should use hbase.security.authentication when negotiating authentication
[HBASE-7376] - Acquiring readLock does not apply timeout in HRegion#flushcache
[HBASE-7398] - [0.94 UNIT TESTS] TestAssignmentManager fails frequently on CentOS 5
[HBASE-7412] - Fix how HTableDescriptor handles default max file size and flush size
[HBASE-7417] - TestReplication is flaky
[HBASE-7421] - TestHFileCleaner->testHFileCleaning has an aggressive timeout
[HBASE-7422] - MasterFS doesn't set configuration for internal FileSystem
[HBASE-7432] - TestHBaseFsck prevents testsuite from finishing
[HBASE-7435] - BuiltInGzipDecompressor is only released during full GC
[HBASE-7440] - ReplicationZookeeper#addPeer is racy
[HBASE-7442] - HBase remote CopyTable not working when security enabled
[HBASE-7455] - Increase timeouts in TestReplication and TestSplitLogWorker
[HBASE-7464] - [REST] Sending HTML for errors is unhelpful
[HBASE-7466] - Fix junit dependency typo in 0.94
[HBASE-7467] - CleanerChore checkAndDeleteDirectory not deleting empty directories
[HBASE-7483] - TestHRegionOnCluster and TestSplitTransactionOnCluster are racy with HBaseAdmin.move()
[HBASE-7485] - TestSplitLogManager is still flaky on windows
Improvement
[HBASE-4791] - Allow Secure Zookeeper JAAS configuration to be programmatically set (rather than only by reading JAAS configuration file)
[HBASE-5616] - Make compaction code standalone
[HBASE-5693] - When creating a region, the master initializes it and creates a memstore within the master server
[HBASE-5778] - Fix HLog compression's incompatibilities
[HBASE-5888] - Clover profile in build
[HBASE-6585] - Audit log messages should contain info about the higher level operation being executed
[HBASE-6775] - Use ZK.multi when available for HBASE-6710 0.92/0.94 compatibility fix
[HBASE-7190] - Add an option to hbck to check only meta and assignment
[HBASE-7197] - Add multi get to RemoteHTable
[HBASE-7199] - hbck should check lingering reference hfile and have option to sideline them automatically
[HBASE-7204] - Make hbck ErrorReporter pluggable
[HBASE-7231] - port HBASE-7200 create integration test for balancing regions and killing region servers to 0.94
[HBASE-7249] - add test name filter to IntegrationTestsDriver
[HBASE-7328] - IntegrationTestRebalanceAndKillServersTargeted supercedes IntegrationTestRebalanceAndKillServers, remove
[HBASE-7351] - Periodic health check chore
[HBASE-7359] - [REST] 'accessToken' in RemoteHTable is vestigial
[HBASE-7374] - Expose master table operations for coprocessors by way of MasterServices
[HBASE-7377] - Clean up TestHBase7051
[HBASE-7381] - Lightweight data transfer for Class Result
[HBASE-7469] - [REST] Share a HBaseAdmin instance
[HBASE-7472] - [REST] Support MIME type application/protobuf
Task
[HBASE-5258] - Move coprocessors set out of RegionLoad
[HBASE-7170] - [0.94 branch] Allow HConnectionImplementation to reconnect to master multiple times
[HBASE-7283] - Backport HBASE-6564 + HBASE-7202 to 0.94
[HBASE-7341] - Deprecate RowLocks in 0.94
Release 0.94.3 - 11/12/2012
Sub-task
[HBASE-4913] - Per-CF compaction Via the Shell
[HBASE-6305] - TestLocalHBaseCluster hangs with hadoop 2.0/0.23 builds.
[HBASE-6925] - Change socket write size from 8K to 64K for HBaseServer
[HBASE-6996] - HRegion.mutateRowsWithLocks should call checkResources/checkReadOnly
[HBASE-7076] - Add test that increment/append properly integrate with MVCC
[HBASE-7077] - Test for: CheckAndPut should properly read MVCC
[HBASE-7078] - Add a test that append is atomic
Bug
[HBASE-6389] - Modify the conditions to ensure that Master waits for sufficient number of Region Servers before starting region assignments
[HBASE-6583] - Enhance Hbase load test tool to automatically create column families if not present
[HBASE-6665] - ROOT region should not be splitted even with META row as explicit split key
[HBASE-6700] - [replication] empty znodes created during queue failovers aren't deleted
[HBASE-6728] - [89-fb] prevent OOM possibility due to per connection responseQueue being unbounded
[HBASE-6733] - [0.92 UNIT TESTS] TestReplication.queueFailover occasionally fails [Part-2]
[HBASE-6796] - Backport HBASE-5547, Don't delete HFiles in backup mode.
[HBASE-6843] - loading lzo error when using coprocessor
[HBASE-6846] - BitComparator bug - ArrayIndexOutOfBoundsException
[HBASE-6904] - In the HBase shell, an error is thrown that states replication-related znodes already exist
[HBASE-6958] - TestAssignmentManager sometimes fails
[HBASE-6974] - Metric for blocked updates
[HBASE-6978] - Minor typo in ReplicationSource SocketTimeoutException error handling
[HBASE-7017] - Backport "[replication] The replication-executor should make sure the file that it is replicating is closed before declaring success on that file" to 0.94
[HBASE-7018] - Fix and Improve TableDescriptor caching for bulk assignment
[HBASE-7021] - Default to Hadoop 1.0.4 in 0.94 and add Hadoop 1.1 profile
[HBASE-7037] - ReplicationPeer logs at WARN level aborting server instead of at FATAL
[HBASE-7048] - Regionsplitter requires the hadoop config path to be in hbase classpath
[HBASE-7051] - CheckAndPut should properly read MVCC
[HBASE-7060] - Region load balancing by table does not handle the case where a table's region count is lower than the number of the RS in the cluster
[HBASE-7069] - HTable.batch does not have to be synchronized
[HBASE-7086] - Enhance ResourceChecker to log stack trace for potentially hanging threads
[HBASE-7095] - Cannot set 'lenAsVal' for KeyOnlyFilter from shell
[HBASE-7103] - Need to fail split if SPLIT znode is deleted even before the split is completed.
[HBASE-7143] - TestMetaMigrationRemovingHTD fails when used with Hadoop 0.23/2.x
Improvement
[HBASE-5257] - Allow INCLUDE_AND_NEXT_COL in filters and use it in ColumnPaginationFilter
[HBASE-5314] - Gracefully rolling restart region servers in rolling-restart.sh
[HBASE-5898] - Consider double-checked locking for block cache lock
[HBASE-6852] - SchemaMetrics.updateOnCacheHit costs too much while full scanning a table with all of its fields
[HBASE-6942] - Endpoint implementation for bulk deletion of data
[HBASE-6951] - Allow the master info server to be started in a read only mode.
[HBASE-7073] - OperationMetrics needs to cache the value of hbase.metrics.exposeOperationTimes
[HBASE-7089] - Allow filter to be specified for Get from HBase shell
[HBASE-7097] - Log message in SecureServer.class uses wrong class name
[HBASE-7151] - Better log message for Per-CF compactions
Task
[HBASE-6032] - Port HFileBlockIndex improvement from HBASE-5987
[HBASE-7016] - port HBASE-6518 'Bytes.toBytesBinary() incorrect trailing backslash escape' to 0.94
[HBASE-7020] - Backport HBASE-6336 Split point should not be equal to start row or end row
[HBASE-7038] - Port HBASE-5970 Improve the AssignmentManager#updateTimer and speed up handling opened event to 0.94
[HBASE-7040] - Port HBASE-5867 Improve Compaction Throttle Default to 0.94
[HBASE-7053] - port blockcache configurability (part of HBASE-6312, and HBASE-7033) to 0.94
[HBASE-7087] - Add to NOTICE.txt a note on jamon being MPL
Test
[HBASE-5984] - TestLogRolling.testLogRollOnPipelineRestart failed with HADOOP 2.0.0
[HBASE-7142] - TestSplitLogManager#testDeadWorker may fail because of hard limit on the TimeoutMonitor's timeout period
Release 0.94.2 - 10/08/2012
Sub-task
[HBASE-6257] - Avoid unnecessary flush & compact on Meta in admin.rb.
[HBASE-6496] - Example ZK based scan policy
[HBASE-6792] - Remove interface audience annotations in 0.94/0.92 introduced by HBASE-6516
Bug
[HBASE-4565] - Maven HBase build broken on cygwin with copynativelib.sh call.
[HBASE-5292] - getsize per-CF metric incorrectly counts compaction related reads as well
[HBASE-5549] - Master can fail if ZooKeeper session expires
[HBASE-5997] - Fix concerns raised in HBASE-5922 related to HalfStoreFileReader
[HBASE-6165] - Replication can overrun .META. scans on cluster re-start
[HBASE-6211] - Put latencies in jmx
[HBASE-6263] - Use default mode for HBase Thrift gateway if not specified
[HBASE-6268] - Can't enable a table on a 0.94 cluster from a 0.92 client
[HBASE-6299] - RS starting region open while failing ack to HMaster.sendRegionOpen() causes inconsistency in HMaster's region state and a series of successive problems
[HBASE-6321] - ReplicationSource dies reading the peer's id
[HBASE-6340] - HBase RPC should allow protocol extension with common interfaces.
[HBASE-6359] - KeyValue may return incorrect values after readFields()
[HBASE-6364] - Powering down the server host holding the .META. table causes HBase Client to take excessively long to recover and connect to reassigned .META. table
[HBASE-6378] - the javadoc of setEnabledTable maybe not describe accurately
[HBASE-6432] - HRegionServer doesn't properly set clusterId in conf
[HBASE-6437] - Avoid admin.balance during master initialize
[HBASE-6438] - RegionAlreadyInTransitionException needs to give more info to avoid assignment inconsistencies
[HBASE-6447] - Common TestZooKeeper failures on jenkins: testMasterSessionExpired and testCreateSilentIsReallySilent
[HBASE-6450] - HBase startup should be with MALLOC_MAX_ARENA set
[HBASE-6460] - hbck "-repairHoles" usage inconsistent with "-fixHdfsOrphans"
[HBASE-6471] - Performance regression caused by HBASE-4054
[HBASE-6478] - TestClassLoading.testClassLoadingFromLibDirInJar occasionally fails
[HBASE-6488] - HBase wont run on IPv6 on OSes that use zone-indexes
[HBASE-6503] - HBase Shell Documentation For DROP Is Outdated
[HBASE-6504] - Adding GC details prevents HBase from starting in non-distributed mode
[HBASE-6512] - Incorrect OfflineMetaRepair log class name
[HBASE-6514] - unknown metrics type: org.apache.hadoop.hbase.metrics.histogram.MetricsHistogram
[HBASE-6516] - hbck cannot detect any IOException while ".tableinfo" file is missing
[HBASE-6520] - MSLab May cause the Bytes.toLong not work correctly for increment
[HBASE-6525] - bin/replication/copy_tables_desc.rb references non-existent class
[HBASE-6529] - With HFile v2, the region server will always perform an extra copy of source files
[HBASE-6537] - Race between balancer and disable table can lead to inconsistent cluster
[HBASE-6552] - TestAcidGuarantees system test should flush more aggressively
[HBASE-6561] - Gets/Puts with many columns send the RegionServer into an "endless" loop
[HBASE-6565] - Coprocessor exec result Map is not thread safe
[HBASE-6576] - HBaseAdmin.createTable should wait until the table is enabled
[HBASE-6579] - Unnecessary KV order check in StoreScanner
[HBASE-6587] - Region would be assigned twice in the case of all RS offline
[HBASE-6596] - Revert HBASE-5022; it undoes HBC.create
[HBASE-6602] - Region Server Dynamic Metrics can cause high cpu usage.
[HBASE-6603] - RegionMetricsStorage.incrNumericMetric is called too often
[HBASE-6608] - Fix for HBASE-6160, META entries from daughters can be deleted before parent entries, shouldn't compare HRegionInfo's
[HBASE-6615] - hbase.rs.evictblocksonclose seems to be ineffective
[HBASE-6616] - test failure in TestDelayedRpc#testTooManyDelayedRpcs
[HBASE-6621] - Reduce calls to Bytes.toInt
[HBASE-6623] - [replication] replication metrics value AgeOfLastShippedOp is not set correctly
[HBASE-6631] - TestHMasterRPCException in 0.92 failed twice on socket timeout
[HBASE-6632] - [0.92 UNIT TESTS] testCreateTableRPCTimeOut sets rpc timeout to 1500ms and leaves it (testHundredsOfTable fails w/ 1500ms timeout)
[HBASE-6638] - Move DaemonThreadFactory into Threads (0.94)
[HBASE-6641] - more message with DoNotRetryIOException in client
[HBASE-6647] - [performance regression] appendNoSync/HBASE-4528 doesn't take deferred log flush into account
[HBASE-6648] - [0.92 UNIT TESTS] TestMasterObserver.testRegionTransitionOperations fails occasionally
[HBASE-6649] - [0.92 UNIT TESTS] TestReplication.queueFailover occasionally fails [Part-1]
[HBASE-6662] - Region server incorrectly reports its own address as master's address
[HBASE-6663] - NPE race in HConnection if zookeeper is reset
[HBASE-6671] - Kerberos authenticated super user should be able to retrieve proxied delegation tokens
[HBASE-6679] - RegionServer aborts due to race between compaction and split
[HBASE-6685] - Thrift DemoClient.pl got NullPointerException
[HBASE-6686] - HFile Quarantine fails with missing dirs in hadoop 2.0
[HBASE-6688] - folder referred by thrift demo app instructions is outdated
[HBASE-6710] - 0.92/0.94 compatibility issues due to HBASE-5206
[HBASE-6711] - Avoid local results copy in StoreScanner
[HBASE-6713] - Stopping META/ROOT RS may take 50mins when some region is splitting
[HBASE-6714] - TestMultiSlaveReplication#testMultiSlaveReplication may fail
[HBASE-6734] - Code duplication in LoadIncrementalHFiles
[HBASE-6757] - Very inefficient behaviour of scan using FilterList
[HBASE-6762] - HBASE-6340 broke SecureRPCEngine
[HBASE-6769] - HRS.multi eats NoSuchColumnFamilyException since HBASE-5021
[HBASE-6784] - TestCoprocessorScanPolicy is sometimes flaky when run locally
[HBASE-6803] - script hbase should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH
[HBASE-6839] - Operations may be executed without holding rowLock
[HBASE-6842] - the jar used in coprocessor is not deleted in local which will exhaust the space of /tmp
[HBASE-6844] - upgrade 0.23 version dependency in 0.94
[HBASE-6847] - HBASE-6649 broke replication
[HBASE-6851] - Race condition in TableAuthManager.updateGlobalCache()
[HBASE-6853] - IllegalArgument Exception is thrown when an empty region is spliitted.
[HBASE-6854] - Deletion of SPLITTING node on split rollback should clear the region from RIT
[HBASE-6868] - Skip checksum is broke; are we double-checksumming by default?
[HBASE-6871] - HFileBlockIndex Write Error in HFile V2 due to incorrect split into intermediate index blocks
[HBASE-6888] - HBase scripts ignore any HBASE_OPTS set in the environment
[HBASE-6889] - Ignore source control files with apache-rat
[HBASE-6900] - RegionScanner.reseek() creates NPE when a flush or compaction happens before the reseek.
[HBASE-6901] - Store file compactSelection throws ArrayIndexOutOfBoundsException
[HBASE-6906] - TestHBaseFsck#testQuarantine* tests are flakey due to TableNotEnabledException
[HBASE-6912] - Filters are not properly applied in certain cases
[HBASE-6916] - HBA logs at info level errors that won't show in the shell
[HBASE-6920] - On timeout connecting to master, client can get stuck and never make progress
[HBASE-6927] - WrongFS using HRegionInfo.getTableDesc() and different fs for hbase.root and fs.defaultFS
[HBASE-6946] - JavaDoc missing from release tarballs
Improvement
[HBASE-3271] - Allow .META. table to be exported
[HBASE-5582] - "No HServerInfo found for" should be a WARNING message
[HBASE-5631] - hbck should handle case where .tableinfo file is missing.
[HBASE-5714] - Add write permissions check before any hbck run that modifies hdfs.
[HBASE-5728] - Methods Missing in HTableInterface
[HBASE-6286] - Upgrade maven-compiler-plugin to 2.5.1
[HBASE-6291] - Don't retry increments on an invalid cell
[HBASE-6308] - Coprocessors should be loaded in a custom ClassLoader to prevent dependency conflicts with HBase
[HBASE-6373] - Add more context information to audit log messages
[HBASE-6444] - Expose the ability to set custom HTTP Request Headers for the REST client used by RemoteHTable
[HBASE-6458] - new comparator twice in checkAndPut, just reuse the first one
[HBASE-6522] - Expose locks and leases to Coprocessors
[HBASE-6586] - Quarantine Corrupted HFiles with hbck
[HBASE-6643] - Accept encoded region name in compacting/spliting region from shell
[HBASE-6644] - HBaseAdmin.createTable should wait more till table is enabled.
[HBASE-6860] - [replication] HBASE-6550 is too aggressive, DDOSes .META.
[HBASE-6914] - Scans/Gets/Mutations don't give a good error if the table is disabled.
New Feature
[HBASE-6427] - Pluggable compaction and scan policies via coprocessors
[HBASE-6505] - Allow shared RegionObserver state
[HBASE-6550] - Refactoring ReplicationSink to make it more responsive of cluster health
Task
[HBASE-5042] - TestReadWriteConsistencyControl should be renamed
[HBASE-6288] - In hbase-daemons.sh, description of the default backup-master file path is wrong
[HBASE-6538] - Remove copy_table.rb script
Test
[HBASE-6507] - [hbck] TestHBaseFsck ran into TableNotEnabledException
[HBASE-6593] - TestAdmin times out sometimes
Release 0.94.1 - 7/24/2012
Sub-task
[HBASE-5342] - Grant/Revoke global permissions
[HBASE-5372] - Table mutation operations should check table level rights, not global rights
[HBASE-5385] - Delete table/column should delete stored permissions on -acl- table
[HBASE-5659] - TestAtomicOperation.testMultiRowMutationMultiThreads is still failing occasionally
[HBASE-6061] - Fix ACL "Admin" Table inconsistent permission check
[HBASE-6062] - preCheckAndPut/Delete() checks for READ when also a WRITE is performed
[HBASE-6092] - Authorize flush, split, compact operations in AccessController
[HBASE-6157] - Revoke of Global permission is not taking effect without restart.
[HBASE-6181] - TestStoreFile fails with jdk1.7
[HBASE-6188] - Remove the concept of table owner
[HBASE-6209] - ACL Corrections for AccessControllerProtocol apis
[HBASE-6224] - add Pre and Post coprocessor hooks for BulkLoad
[HBASE-6238] - Grant on META not taking effect
[HBASE-6252] - TABLE ADMIN should be allowed to relocate regions
[HBASE-6253] - Do not allow user to disable or drop ACL table
[HBASE-6292] - Compact can skip the security access control
[HBASE-6355] - Allow HBase to compile against JDK7
Bug