Skip to content

Commit 8d68205

Browse files
authored
emit a log message before processing begins (#19)
* emit a log message before processing begins we have a number of files that seem to be causing timeout issues, but can't really tell which. this change will at least allow us to look more closely, and if necessary download and break apart these chunks to get them through * upgrade dependencies
1 parent 26f48cf commit 8d68205

File tree

2 files changed

+112
-110
lines changed

2 files changed

+112
-110
lines changed

main.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,8 @@ def process_fastly_log(data, context):
3939
identifier = os.path.basename(data["name"]).split("-", 3)[-1].rstrip(".log.gz")
4040
default_partition = datetime.datetime.utcnow().strftime("%Y%m%d")
4141

42+
print(f"Beginning processing for gs://{data['bucket']}/{data['name']}")
43+
4244
bob_logs_log_blob = storage_client.bucket(data["bucket"]).get_blob(data["name"])
4345
if bob_logs_log_blob is None:
4446
return # This has already been processed?

0 commit comments

Comments
 (0)