Any idea how to define log configs for batch through step functions's definition? I am getting build error - 'SCHEMA_VALIDATION_FAILED: The field "LogConfiguration" is not supported by Step Functions. My step definition- "ContainerOverrides": { "LogConfiguration": { "LogDriver": "awslogs", "Options": { "awslogs-group": "${PipelineLogGroup}", "awslogs-stream-prefix": "canonical-" } } }
Thank u for the video! I haven’t finished it yet, but do u mention how much data u were processing? I hear u mention u process rows of data ‘line by line’. What are the size of these files and how fast do u process them? Thank u again!!
Hi Jamie , thank you for awesome explanation and your efforts , one small request , can you please make a video of integration sqs and Sns with aws lambda if possible with python , thank you once again in advance
Jamie - excellent presentation , I like that you used a real world scenario in this example. Thank you for sharing !!
Any idea how to define log configs for batch through step functions's definition?
I am getting build error - 'SCHEMA_VALIDATION_FAILED: The field "LogConfiguration" is not supported by Step Functions.
My step definition-
"ContainerOverrides": {
"LogConfiguration": {
"LogDriver": "awslogs",
"Options": {
"awslogs-group": "${PipelineLogGroup}",
"awslogs-stream-prefix": "canonical-"
}
}
}
Thank u for the video! I haven’t finished it yet, but do u mention how much data u were processing? I hear u mention u process rows of data ‘line by line’. What are the size of these files and how fast do u process them? Thank u again!!
Hi Jamie , thank you for awesome explanation and your efforts , one small request , can you please make a video of integration sqs and Sns with aws lambda if possible with python , thank you once again in advance