Skip to content

New kafka metering fix #7856

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
0fcca60
Only members of ReleaseApprovers team can approve changes in this bra…
maximyurchuk Jul 5, 2024
44a1cd0
Initial commit for stable-24-3 (#6321)
maximyurchuk Jul 5, 2024
c288738
fix query errors processing (#6441) (#6451)
adameat Jul 9, 2024
6353290
Merge #6398 #6405 from main into stable-24-3 (#6448)
alexvru Jul 9, 2024
41ce5c8
Fix test_db_counters test (#6436)
jepett0 Jul 9, 2024
f95e231
24-3 Fix tests with EnableLocalDBBtreeIndex = false (#6391)
kunga Jul 9, 2024
56b5d9a
24-3 Iterative B-Tree histograms builder (#6392)
kunga Jul 9, 2024
64fa639
24-3 Obtain UsedTableMemory from private cache stats, include histori…
kunga Jul 9, 2024
d0cc485
revert 19bed6c19f373cc26a3b8d1d4e4d1ff1126a56ce (#6469)
iddqdex Jul 9, 2024
7c2c3cd
24-3: Fix bugs in coordinator state migration (#6460)
snaury Jul 10, 2024
0711d51
Merge some fixes (#6490)
gridnevvvit Jul 10, 2024
0e4b669
set predicate-extract config default (#6456)
ssmike Jul 10, 2024
35253da
24-3: Fix bugs in: change exchange split, removing schema snapshots &…
CyberROFL Jul 14, 2024
09c3cad
24.3: Fix null dereference in node broker (KIKIMR-21693) (#6516) (#6623)
pixcc Jul 15, 2024
14c79b8
Use the whole TTableDescription to describe an indexImplTable in TInd…
jepett0 Jul 16, 2024
dec025f
Changed memory calculation for TEvFreeItems (merge from main #6625) (…
alexvru Jul 16, 2024
749bd51
fix drain compatability (#6613) (#6716)
vporyadke Jul 17, 2024
3aec0fb
fix neighbours count (#6409) (#6718)
vporyadke Jul 17, 2024
df15684
fix TabletsTotal counter (#6492) (#6717)
vporyadke Jul 17, 2024
56c68e1
do not trigger emergency balancer when all nodes have high usage (#65…
vporyadke Jul 19, 2024
7792457
24-3: schemeshard: preserialize Table.SplitBoundary for describe resu…
ijon Jul 22, 2024
4515805
24-3: schemeshard: reject operations with too big local tx commit (#6…
ijon Jul 22, 2024
b87fc88
24-3: Fix read requirements on init (#6948)
Enjection Jul 22, 2024
6dbec9f
build: refresh Embedded UI (v6.11.0) (#6968)
alexv-smirnov Jul 23, 2024
bf5f3d7
Extend DisabledOnSchemeShard FF for column tables on dedicated bases …
zverevgeny Jul 23, 2024
66d836f
Merge Fix LWTrace leaking HTTP request string to HTML page (#7011) (#…
the-ancient-1 Jul 24, 2024
4ba1b11
deprioritise system tablets in balancer (#6840) (#7047)
vporyadke Jul 25, 2024
2e59d50
use potential max thread count in local (#7050)
vporyadke Jul 25, 2024
7bc362e
merge memory limitations features and staff to stable-24-3 (#6803)
gridnevvvit Jul 25, 2024
8c26a9c
Fix scope id handling (#7093)
Enjection Jul 25, 2024
90805a4
YQ-3345 support load cpu threshold (#6790)
GrigoriyPA Jul 25, 2024
f7695a0
YQ WM fixed build errors (#7128)
GrigoriyPA Jul 26, 2024
90223b3
Disable modification in cs by default (#7161)
zverevgeny Jul 27, 2024
a196e19
CS improvements (#7013)
zverevgeny Jul 28, 2024
e8f2390
Dont create delete flags column if not necessary (#7169)
zverevgeny Jul 29, 2024
3606e07
24-3: Enable/disable ssl connections, return connection_string in API…
CyberROFL Jul 29, 2024
c1bcd71
24-3: Check shard state at TTxCdcStreamEmitHeartbeats (#7148)
CyberROFL Jul 29, 2024
312992d
24-3: Allow streams on index tables, replicate index tables (#7150)
CyberROFL Jul 29, 2024
690f5e8
add autopartitioning by load (#7124)
nshestakov Jul 29, 2024
19756b2
fix viewer redirects (#7103) (#7120)
adameat Jul 29, 2024
3c55a62
24-3 Freeze event spaces ids (#7192)
maximyurchuk Jul 29, 2024
d96c0fd
Added metadata flag to track if stats for optimizer were loaded (#7190)
pavelvelikhov Jul 29, 2024
ee07055
fix compaction intervals construction (#7176) (#7208)
zverevgeny Jul 29, 2024
06b43aa
add enable implicit params flag to table service config (#6943)
VPolka Jul 30, 2024
63e04e6
24-3 Fix using uninitialized value error. (#7224)
maximyurchuk Jul 30, 2024
725b0df
24-3 [CBO] Warning FIX (#6420) (#7241)
maximyurchuk Jul 30, 2024
b99f854
fix segfault and memory leaks in CS (#7288)
zverevgeny Jul 31, 2024
e2113ec
24-3 Rescue asan tests (remove NO_EXPORT_DYNAMIC_SYMBOLS for them) (#…
maximyurchuk Jul 31, 2024
57fe13a
Enable sequences (#7297)
shnikd Jul 31, 2024
900ca74
YDB-7262 Add default permille ICB configuration for vdisk garbage com…
SammyVimes Aug 1, 2024
2f21060
WM fixed bugs and performance (#7254)
GrigoriyPA Aug 2, 2024
070399b
hotfix for hotkeys (#7425)
adameat Aug 2, 2024
4876ec0
Fix actor system usage after it was freed (#7316) (#7404)
UgnineSirdis Aug 5, 2024
32218fe
Disable vpatch 24-3 (#7320)
kruall Aug 5, 2024
3fb7fa2
PushLeftStage fix (#7349)
shnikd Aug 5, 2024
ccf98e2
Ignore stored GCBarrierPreparation (#7473)
zverevgeny Aug 5, 2024
4e8a96c
add config option to specify TTL for user logins (#7083) (#7486)
adameat Aug 6, 2024
07a2be0
fix for dead nodes always passing filter (#6912) (#7522)
adameat Aug 7, 2024
315fac0
stable-24-3: Enable COUNT in view queries (#6820) (#7523)
jepett0 Aug 7, 2024
0466744
Fix trim duration (change microseconds to milliseconds) (#7302)
va-kuznecov Aug 7, 2024
02b4c2d
24-3: Sinks improvements (#6856)
nikvas0 Aug 8, 2024
68915a1
24-3: CTAS fixes (#6857)
nikvas0 Aug 8, 2024
72e974f
24-3: Datashard + Columnshard Reads (#6858)
nikvas0 Aug 8, 2024
7beef2e
storage healthcheck fixes (#7212) (#7394)
vporyadke Aug 9, 2024
d65a0a9
control inflight pings in hive (#6916) (#7238)
vporyadke Aug 9, 2024
9d83402
Delete empty portions normalizer (#7596) (#7600)
zverevgeny Aug 9, 2024
282df40
fix suspended read session of a topic (#7635)
nshestakov Aug 12, 2024
087ff93
Allow logging AST with free arguments. (#7573) (#7653)
spuchin Aug 13, 2024
c85f845
YDB-2568 Enable match_recognize in ydb / stable-24-3 (#7540)
kardymonds Aug 13, 2024
b12cda0
24-3: Fix unexpected read iterator stream reset (#7710)
snaury Aug 13, 2024
ef7e2a9
Allow multiple join-broadcasts in single stage (#7556) (#7713)
ssmike Aug 13, 2024
12a1ece
[Http] Reply with structured issues when client accepts json data (#7…
UgnineSirdis Aug 13, 2024
74a9fd5
fix LockedPartitions without session (#7736)
nshestakov Aug 14, 2024
65add49
fix query id for recompilation (#7599)
VPolka Aug 14, 2024
aa85c35
[CDC] Do not lose presition during float/double to json serialization…
dcherednik Aug 14, 2024
f31bfa8
Fix json float/double print format (#7572) (#7776)
dcherednik Aug 14, 2024
aa5a493
Double free when accessing .AsBoxed() on Pod with 0 refcount (#7659) …
spuchin Aug 15, 2024
310ffaa
Fix RU for kafka read
niksaveliev Jul 3, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
26 changes: 1 addition & 25 deletions .github/CODEOWNERS
Original file line number Diff line number Diff line change
@@ -1,25 +1 @@
/*.md @ydb-platform/docs

/ydb/core/fq/ @ydb-platform/fq
/ydb/core/public_http/ @ydb-platform/fq

/ydb/docs/ @ydb-platform/docs

/ydb/library/yql/ @ydb-platform/yql
/ydb/library/yql/dq @ydb-platform/yql @ydb-platform/qp
/ydb/library/yql/providers/generic @ydb-platform/fq
/ydb/library/yql/providers/pq @ydb-platform/fq
/ydb/library/yql/providers/s3 @ydb-platform/fq
/ydb/library/yql/providers/solomon @ydb-platform/fq

/ydb/library/yql/yt @Krock21 @Krisha11 @zlobober @gritukan

/ydb/services/fq/ @ydb-platform/fq

/ydb/core/kafka_proxy @ydb-platform/Topics
/ydb/core/persqueue @ydb-platform/Topics
/ydb/services/datastreams @ydb-platform/Topics
/ydb/services/deprecated/persqueue_v0 @ydb-platform/Topics
/ydb/services/persqueue_v1 @ydb-platform/Topics

/ydb/core/config/ut @ydb-platform/core
* @ydb-platform/ReleaseApprovers
5 changes: 2 additions & 3 deletions .github/config/muted_ya.txt
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,10 @@ ydb/core/external_sources *
ydb/core/quoter/ut QuoterWithKesusTest.PrefetchCoefficient
ydb/core/keyvalue/ut_trace TKeyValueTracingTest.*
ydb/core/kqp/provider/ut KikimrIcGateway.TestLoadBasicSecretValueFromExternalDataSourceMetadata
ydb/core/kqp/ut/olap KqpOlapIndexes.IndexesActualization
ydb/core/kqp/ut/olap KqpOlapBlobsSharing.*
ydb/core/kqp/ut/olap KqpOlap.ScanQueryOltpAndOlap
ydb/core/kqp/ut/olap KqpOlapStatistics.StatsUsageWithTTL
ydb/core/kqp/ut/olap KqpOlap.YqlScriptOltpAndOlap
ydb/core/kqp/ut/olap KqpOlapAggregations.Aggregation_ResultCountAll_FilterL
ydb/core/kqp/ut/olap KqpOlapWrite.WriteDeleteCleanGC
ydb/core/kqp/ut/pg KqpPg.CreateIndex
ydb/core/kqp/ut/query KqpLimits.QueryReplySize
ydb/core/kqp/ut/query KqpQuery.QueryTimeout
Expand Down Expand Up @@ -98,6 +96,7 @@ ydb/tests/fq/yds *
ydb/tests/fq/control_plane_storage *
ydb/tests/functional/audit *
ydb/tests/functional/blobstorage test_replication.py.TestReplicationAfterNodesRestart.test_replication*
ydb/tests/functional/clickbench test.py.test_plans[column]
ydb/tests/functional/kqp/kqp_indexes ConsistentIndexRead.InteractiveTx
ydb/tests/functional/kqp/kqp_query_session KqpQuerySession.NoLocalAttach
ydb/tests/functional/restarts test_restarts.py.*
Expand Down
10 changes: 5 additions & 5 deletions library/cpp/lwtrace/mon/mon_lwtrace.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -301,7 +301,7 @@ struct TLogQuery {
}
} catch (...) {
ythrow yexception()
<< CurrentExceptionMessage()
<< EncodeHtmlPcdata(CurrentExceptionMessage())
<< " while parsing track log query: "
<< Text;
}
Expand Down Expand Up @@ -1853,7 +1853,7 @@ class TTracesHtmlPrinter {
try {
Os << src->GetStartTime().ToStringUpToSeconds();
} catch (...) {
Os << "error: " << CurrentExceptionMessage();
Os << "error: " << EncodeHtmlPcdata(CurrentExceptionMessage());
}
Os << "</td>"
<< "<td><div class=\"dropdown\">"
Expand Down Expand Up @@ -3821,17 +3821,17 @@ class TLWTraceMonPage : public NMonitoring::IMonPage {
}
} catch (TPageGenBase& gen) {
out.Clear();
out << gen.what();
out << EncodeHtmlPcdata(gen.what());
} catch (...) {
out.Clear();
if (request.GetParams().Get("error") == "text") {
// Text error reply is helpful for ajax requests
out << NMonitoring::HTTPOKTEXT;
out << CurrentExceptionMessage();
out << EncodeHtmlPcdata(CurrentExceptionMessage());
} else {
WWW_HTML(out) {
out << "<h2>Error</h2><pre>"
<< CurrentExceptionMessage()
<< EncodeHtmlPcdata(CurrentExceptionMessage())
<< Endl;
}
}
Expand Down
17 changes: 14 additions & 3 deletions ydb/apps/version/version_definition.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,21 @@

NKikimrConfig::TCurrentCompatibilityInfo NKikimr::TCompatibilityInfo::MakeCurrent() {
using TCurrentConstructor = NKikimr::TCompatibilityInfo::TProtoConstructor::TCurrentCompatibilityInfo;
// using TVersionConstructor = NKikimr::TCompatibilityInfo::TProtoConstructor::TVersion;
// using TCompatibilityRuleConstructor = NKikimr::TCompatibilityInfo::TProtoConstructor::TCompatibilityRule;
using TVersionConstructor = NKikimr::TCompatibilityInfo::TProtoConstructor::TVersion;
using TCompatibilityRuleConstructor = NKikimr::TCompatibilityInfo::TProtoConstructor::TCompatibilityRule;

return TCurrentConstructor{
.Application = "ydb",
.Version = TVersionConstructor{
.Year = 24,
.Major = 3,
},
.CanConnectTo = {
TCompatibilityRuleConstructor{
.Application = "nbs",
.LowerLimit = TVersionConstructor{ .Year = 23, .Major = 3 },
.UpperLimit = TVersionConstructor{ .Year = 24, .Major = 3 },
}
}
}.ToPB();
}
}
4 changes: 3 additions & 1 deletion ydb/apps/ydbd/ya.make
Original file line number Diff line number Diff line change
@@ -1,6 +1,8 @@
PROGRAM(ydbd)

NO_EXPORT_DYNAMIC_SYMBOLS()
IF (NOT SANITIZER_TYPE) # for some reasons some tests with asan are failed, see comment in CPPCOM-32
NO_EXPORT_DYNAMIC_SYMBOLS()
ENDIF()

IF (OS_LINUX)
ALLOCATOR(TCMALLOC_256K)
Expand Down
Loading
Loading