Skip to content

[ExternalCatalog](fix) external catalog meta data inconsistent when frequent refreshing #63033

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
qzsee wants to merge 2 commits into
base: master
Choose a base branch
from
+23 −7
Open

[ExternalCatalog](fix) external catalog meta data inconsistent when frequent refreshing #63033

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
61495a7
[ExternalCatalog](fix) external catalog meta data inconsistent when f…
Apr 29, 2026
7da2460
1
May 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 23 additions & 7 deletions fe/fe-core/src/main/java/org/apache/doris/datasource/ExternalDatabase.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -177,7 +177,7 @@ private void buildMetaCache() {
}
}

private List<Pair<String, String>> listTableNames() {
private synchronized List<Pair<String, String>> listTableNames() {
List<Pair<String, String>> tableNames;
lowerCaseToTableName.clear();
if (name.equals(InfoSchemaDb.DATABASE_NAME)) {
Expand Down Expand Up @@ -420,9 +420,17 @@ public boolean isTableExist(String tableName) {
remoteTblName = lowerCaseToTableName.get(tableName.toLowerCase());
if (remoteTblName == null) {
// Here we need to execute listTableNames() once to fill in lowerCaseToTableName
// to prevent lowerCaseToTableName from being empty in some cases
listTableNames();
remoteTblName = lowerCaseToTableName.get(tableName.toLowerCase());
// to prevent lowerCaseToTableName from being empty in some cases.
// Use double-checked locking against the same monitor used by listTableNames()
// so that we don't keep repeating a remote list call and don't race with
// a concurrent listTableNames() that is swapping the map.
synchronized (this) {
remoteTblName = lowerCaseToTableName.get(tableName.toLowerCase());
if (remoteTblName == null) {
listTableNames();
remoteTblName = lowerCaseToTableName.get(tableName.toLowerCase());
}
}
if (remoteTblName == null) {
return false;
}
Expand Down Expand Up @@ -504,9 +512,17 @@ private String getLocalTableName(String tableName, boolean isReplay) {
return null;
}
// Here we need to execute listTableNames() once to fill in lowerCaseToTableName
// to prevent lowerCaseToTableName from being empty in some cases
listTableNames();
finalName = lowerCaseToTableName.get(tableName.toLowerCase());
// to prevent lowerCaseToTableName from being empty in some cases.
// Use double-checked locking against the same monitor used by listTableNames()
// so that concurrent callers don't wipe each other's results and don't issue
// redundant remote list calls.
synchronized (this) {
finalName = lowerCaseToTableName.get(tableName.toLowerCase());
if (finalName == null) {
listTableNames();
finalName = lowerCaseToTableName.get(tableName.toLowerCase());
}
}
if (finalName == null) {
if (LOG.isDebugEnabled()) {
LOG.debug("failed to get final table name from: {}.{}.{}",
Expand Down