troubleshooting
Why does S3 fail to find a file in a subfolder under the bucket for Protobuf parsing?
I'm encountering an issue where S3 fails to find a file in a subfolder under the bucket for Protobuf parsing, but works fine when the file is in the root of the bucket. The error message indicates a key not found issue. What could be causing this problem?
Ne
Neil
Asked on Mar 07, 2024
- When specifying the
schema.location
for Protobuf parsing in S3, the path should include the full path to the file, including the folder structure. - S3 may have issues parsing the
/
in the path if not properly formatted. - Ensure that the path to the file in the subfolder is correctly specified in the S3 descriptor file.
Example:
FORMAT PLAIN ENCODE PROTOBUF (
message = 'ProtoClass',
schema.location = '<s3://my-bucket/protobuf/descriptorset.pb>',
access_key ='...', secret_key='...', region='...'
);```
Mar 08, 2024Edited by