troubleshooting

Why does S3 fail to find a file in a subfolder under the bucket for Protobuf parsing?

I'm encountering an issue where S3 fails to find a file in a subfolder under the bucket for Protobuf parsing, but works fine when the file is in the root of the bucket. The error message indicates a key not found issue. What could be causing this problem?

Ne

Neil

Asked on Mar 07, 2024

  • When specifying the schema.location for Protobuf parsing in S3, the path should include the full path to the file, including the folder structure.
  • S3 may have issues parsing the / in the path if not properly formatted.
  • Ensure that the path to the file in the subfolder is correctly specified in the S3 descriptor file.

Example:

FORMAT PLAIN ENCODE PROTOBUF (
    message = 'ProtoClass',
    schema.location = '<s3://my-bucket/protobuf/descriptorset.pb>',
    access_key ='...', secret_key='...', region='...'
);```
Mar 08, 2024Edited by