Skip to content

Commit

Permalink
Optimized.
Browse files Browse the repository at this point in the history
  • Loading branch information
yuqi1129 committed Oct 31, 2024
1 parent 58efcf6 commit 77785e9
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 10 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -782,7 +782,7 @@ FileSystem getFileSystem(Path path, Map<String, String> config) throws IOExcepti
(int)
propertiesMetadata
.catalogPropertiesMetadata()
.getOrDefault(config, HadoopCatalogPropertiesMetadata.REQUEST_TIMEOUT_SECONDS);
.getOrDefault(config, HadoopCatalogPropertiesMetadata.GET_FILESYSTEM_TIMEOUT_SECONDS);
try {
AtomicReference<FileSystem> fileSystem = new AtomicReference<>();
Awaitility.await()
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -52,8 +52,8 @@ public class HadoopCatalogPropertiesMetadata extends BaseCatalogPropertiesMetada
*/
public static final String DEFAULT_FS_PROVIDER = "default-filesystem-provider";

static final String REQUEST_TIMEOUT_SECONDS = "request-timeout-seconds";
static final int DEFAULT_REQUEST_TIMEOUT_SECONDS = 10;
static final String GET_FILESYSTEM_TIMEOUT_SECONDS = "get-filesystem-timeout-seconds";
static final int DEFAULT_GET_FILESYSTEM_TIMEOUT_SECONDS = 10;

public static final String BUILTIN_LOCAL_FS_PROVIDER = "builtin-local";
public static final String BUILTIN_HDFS_FS_PROVIDER = "builtin-hdfs";
Expand Down Expand Up @@ -85,12 +85,12 @@ public class HadoopCatalogPropertiesMetadata extends BaseCatalogPropertiesMetada
BUILTIN_LOCAL_FS_PROVIDER, // please see LocalFileSystemProvider#name()
false /* hidden */))
.put(
REQUEST_TIMEOUT_SECONDS,
GET_FILESYSTEM_TIMEOUT_SECONDS,
PropertyEntry.integerOptionalPropertyEntry(
REQUEST_TIMEOUT_SECONDS,
"Timeout to wait for to create the Hadoop file system",
GET_FILESYSTEM_TIMEOUT_SECONDS,
"Timeout to wait for to create the Hadoop file system client instance.",
false /* immutable */,
DEFAULT_REQUEST_TIMEOUT_SECONDS,
DEFAULT_GET_FILESYSTEM_TIMEOUT_SECONDS,
false /* hidden */))
// The following two are about authentication.
.putAll(KERBEROS_PROPERTY_ENTRIES)
Expand Down
7 changes: 4 additions & 3 deletions docs/hadoop-catalog.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,9 +25,10 @@ Hadoop 3. If there's any compatibility issue, please create an [issue](https://g

Besides the [common catalog properties](./gravitino-server-config.md#gravitino-catalog-properties-configuration), the Hadoop catalog has the following properties:

| Property Name | Description | Default Value | Required | Since Version |
|---------------|-------------------------------------------------|---------------|----------|---------------|
| `location` | The storage location managed by Hadoop catalog. | (none) | No | 0.5.0 |
| Property Name | Description | Default Value | Required | Since Version |
|----------------------------------|----------------------------------------------------------------------------|---------------|----------|------------------|
| `location` | The storage location managed by Hadoop catalog. | (none) | No | 0.5.0 |
| `get-filesystem-timeout-seconds` | The timeout of getting the file system client instance. Time unit: seconds.| 10 | No | 0.7.0-incubating |

Apart from the above properties, to access fileset like HDFS, S3, GCS, OSS or custom fileset, you need to configure the following extra properties.

Expand Down

0 comments on commit 77785e9

Please sign in to comment.