1,628 questions
0
votes
0
answers
27
views
Unable to transform request AWS Gateway VTL
I have the following pulumi go code which uses AWS Integration to start a StepFunction.
func DealRequestTemplate(stateMachineArn pulumi.StringInput) pulumi.StringInput {
return pulumi.Sprintf(`#...
0
votes
1
answer
37
views
ECS RunTask Error: States/ECS RunTask/Arguments: The field 'TaskDefinition' is required but was missing
I defined my ECS RunTask like this, but i keep getting this error when saving: States/ECS RunTask/Arguments: The field 'TaskDefinition' is required but was missing even when my Task definition isnt ...
0
votes
1
answer
45
views
Variable flow in parallel execution of AWS step function
I have a step function definition as below:
{
"StartAt": "Assign Variables",
"QueryLanguage": "JSONata",
"States": {
"Assign ...
0
votes
1
answer
49
views
How to merge two objects in Amazon States language
The context is the design of an AWS Step Function, using the Amazon States language.
I want to call a lambda Task as a step. The state output of this step should be the merger of state input and a ...
0
votes
1
answer
50
views
Wait for User Input in AWS Step Function
Looking into AWS Step Functions. I'd like to have a flow that stops at some point and waits for the user to open up some web form and enter some additional data before continuing the step function ...
0
votes
1
answer
168
views
AWS Step Functions JSONata regex expression fails with 'threw an internal error during evaluation'
Objective
I have the following JSONata expression (which works fine with JSONata v1.3.3 and above).
The aim of the code is to remove all keys that start with 'somatic'
$states.input ~>
$sift(...
1
vote
1
answer
50
views
StepFunction assume role unable to execute the StepFunction
I have a StepFunction that has a map state, that just has a lambda in it that executes through the entries of a JSON in a S3.
However, when the execution gets to this state I get the following error
...
0
votes
1
answer
57
views
How can I pass the input parameter of the AWS Step Function StartExecutionCommand into the event of the first lambdaInvoke state using sst?
I've been facing an issue deploying AWS Lambda Step Functions with sst. I created this minimal GitHub Project to demonstrate the issue. It's not clear to me if this is a bug in the SST implementation ...
0
votes
1
answer
66
views
Set MessageGroupId and MessageDeduplicationId in SQS in a JSONata step function
I am trying to use JSONata for my new step function and I am having issues setting the MessageGroupId and MessageDeduplicationId, for some reason they are not taken into account so it deduplicates the ...
0
votes
1
answer
36
views
Is there a way to get the child process current index (1 <= n <= 10k ) in an AWS SFN Distributed Map in JSONata (not JSONPath)?
I want to perform a MultiPart Upload in S3 via a Distributed Map in an aws stepfunction ( since im performing some transformation on an already existing s3 dataset through some lambdas ). I need to ...
1
vote
1
answer
167
views
AWS Step Functions AccessDeniedException
I am facing a persistent AccessDeniedException when trying to execute nested AWS Step Functions in my test environment. The same setup works perfectly in my Integration environment.
child-state-...
0
votes
1
answer
76
views
Is it possible to customize the SFN execution name when triggering SFN using SQS + Eventbridge Pipes?
I am trying to trigger an SFN using SQS + Pipes, and I wanted to know if it's possible to configure the name of the SFN execution based on the payload.
Example:
If the event is as follows:
{"...
1
vote
1
answer
287
views
How to create EventBridge rule that triggers Lambda/Step function on another account?
I have two AWS accounts named A and B. I want to create an EventBridge rule on A that will run Lambda/Step function on B, and on runtime I don't have access to B, only to A.
The problem with lambda ...
0
votes
0
answers
17
views
How to pass extra paramter to Map Function in Aws State Machine
In AWS Step Functions, I need to perform a batch operation, so I am using Map. I am passing a token as an input parameter to the Step Function so it's accessible for the first Lambda (DEID-FF). ...
1
vote
2
answers
123
views
Aggregating stats in Json nata - i.e. in Step Functions Map
I have spent an embarrassing amount of time trying to achieve something that I believe should be quite trivial.
The question is about JSONata because I want to use this in the context of an AWS Step ...
0
votes
1
answer
59
views
How to flatten arrays in StepFunctions?
I need to merge two arrays into a single array without nesting them. I want to merge $.LifecyclePolicy.LifecyclePolicy.rules and $.updatedRules into one array.
I tried:
"MergeRules": {
&...
0
votes
0
answers
143
views
AWS Step Functions: States.Format Fails with "matching '}' not found for '{'"
I'm using States.Format in AWS Step Functions to generate a JSON lifecycle policy dynamically, but I keep getting this error:
An error occurred while executing the state 'PutLifecyclePolicy' (entered ...
0
votes
1
answer
182
views
Starting Glue job from Step Functions with JobRunQueuingEnabled set to true
I have a Step Functions that starts a Glue job run. This step functions is invoked via Event Bridge when new files are created at a specific S3 location. Sometimes 2 or more files are created in quick ...
0
votes
1
answer
112
views
AWS Batch: Running ECSProperties Job with AWS Stepfunction
I have AWS Stepfunction that starts with a Lambda function to prepare the execution of an AWS Batch Job, of which the Job Definition specifies to use Fargate (ecsProperties Job). This stepfunction ...
-1
votes
1
answer
44
views
How to Map an Array in AWS Step Functions While Keeping Parent ID?
Description:
I am using AWS Step Functions and need to process an input JSON that looks like this:
{
"id": "123456",
"bubble": [
{
"type": "...
0
votes
1
answer
193
views
Step function not deployable through terraform
I am trying to deploy AWS Step Function using Terraform but the deployment is failing with the below error
Failed to execute "terraform init"
fork/exec /usr/local/bin/terraform: argument ...
1
vote
1
answer
129
views
Why isn’t my EventBridge Pipe scaling with increased SQS FIFO messages
I’m facing an issue with a webhook system built using AWS SQS FIFO queues, EventBridge Pipes, Step Functions, and Lambda. Here’s the setup:
• SQS FIFO Queue:
• Receives webhook messages containing ...
0
votes
0
answers
169
views
How to terminate the execution of an AWS Step Functions Map on any error and return the error as the map execution result?
I am using AWS Step Functions with a Map state and I am facing an issue where, when an error occurs in the iterations of the map, the execution continues further, and the result of the map execution ...
0
votes
0
answers
20
views
Step function CFT error, Getting error "variable SubnetsParameter in Fn::Sub expression doesn't resolve to string
Below is my statemachine resource template.
Failing with template failed variable SubnetsParameter in Fn::Sub expression doesn't resolve to string.
Any help would be appreciated.
DefinitionString: !...
1
vote
0
answers
55
views
AWS state function: remember which steps succeeded in a map
I want to have a state machine, with a loop over an array. A loop is just a sequential map state (concurrency = 1). If one item of the array fails being processed, the map stops, and somehow I want to ...
0
votes
0
answers
55
views
Issue with AWS Glue job arguments
Can we pass arguments to glue job with the conditions in aws step function.
{
"JobName": "test-job-name",
"Arguments":{
"--FILE_PATH.$": "$.FILE_PATH",...
0
votes
0
answers
94
views
How to set dynamic variables in AWS Step Functions
I want to assign a variable from one of the state in AWS Step functions.
The value of this variable has to be dynamic. I tried various syntax (as suggested in AWS documentation) to achieve this. These ...
0
votes
1
answer
201
views
Conditional Expression in JSONPath for AWS Step Function
I am working with AWS Step Functions and trying to send an event to an EventBridge event bus using the PutEvents API. However, I am encountering an issue with the following Step Function configuration ...
0
votes
1
answer
80
views
AWS step function/cdk: cannot add output to catcher
With this smallest example I could come up with:
from aws_cdk import aws_stepfunctions_tasks as tasks
from aws_cdk import aws_stepfunctions as sfn
states = tasks.GlueStartJobRun.jsonata( # actual ...
0
votes
0
answers
62
views
What policies does a StateMachine need to execute the SendTaskSuccess and SendTaskFailure back to an EventBridge Rule/Bus
I have an architecture divided in 2 different AWS Accounts. Using AWS SAM, I have a StateMachine (lets call it the parent function) in Account A; and an EventBus, EventRule, and StateMachine (lets ...
0
votes
1
answer
86
views
Configure output of a wait state in AWS step functions
I have the standard (simplified) pattern, in a step machine:
start a glue job
get job satus
if status is running:
wait
go back to get job status
My issue is with the connection between the wait ...
3
votes
1
answer
1k
views
AWS Step Function JSONata how to combine input and result from task
When using JSONPath, I knew how to combine input to some task(for instance lambda) and just add the result to additional property. For instance:
{
"input_1" : "value_1",
"...
0
votes
1
answer
137
views
AWS step functions and replication across regions
I want to have AWS step functions created in two different regions.
Let's say us-east-1 and eu-central-1.
When I invoke the step functions they run in their own region and will have their execution ...
0
votes
0
answers
20
views
Need help in designing solution to read Step function distributed Mode ( map ) result
We have use case where we need to create workflow which takes csv file from user via tool and then read data from file and process records and make some internal api call and return result in another ...
0
votes
0
answers
68
views
How do I get logs for a particular lambda execution using AWS CLI?
Using aws stepfunctions get-execution-history, I can see all the events in a particular execution. It lists, among other things, lambda function executions. How do I get the logs associated with a ...
0
votes
1
answer
279
views
How to pass data from the initial Input to be part of the Map state
Hello I have an AWS Step Function that is triggered by a webhook event.
The initial Input is an array of objects and I am using Map to split the input and from each to run the rest of the workflow.
My ...
0
votes
1
answer
64
views
Remove fields from previous step
I am trying to remove a field from the previous step used only in the choice task.
I have this StepFunction
{
"StartAt": "ConversionStep",
"States": {
"...
0
votes
1
answer
686
views
Can AWS Step Functions be deployed within a VPC to communicate with private resources?
I am working on a use case where I need to deploy AWS Step Functions within a Virtual Private Cloud (VPC). The scenario involves having a VPC with private endpoints for various resources, such as EKS ...
0
votes
1
answer
158
views
Having trouble passing environmental variables into a batch job triggered by a step function
Basically I'm building a integration that runs a ECR image on ECS via a AWS batch job definition. This piece of the code works atm, and we're now moving to running the job definitions via a AWS step ...
0
votes
0
answers
440
views
Is it possible to query an Amazon RDS instance directly from Step function?
I have some step function that in case of failure, I want to update a rds record (generally run an sql query) in Aurora serverless data base in the same aws account.
Is it possible? Or should I create ...
0
votes
1
answer
83
views
Can AWS Step Functions host code they execute?
Can I create an AWS Step Function that will not only define the steps it takes, but also defines the code it executes in each step? Or do I need to have a separate resource that is called by the step ...
2
votes
2
answers
2k
views
How do I evaluate JSONata expression in key in json?
I want to evaluate jsonata expression in key in AWS Step functions. I tried this:
{
"ApplicationId": "ID",
"SendUsersMessageRequest": {
"MessageConfiguration&...
0
votes
1
answer
104
views
AWS Step Function: Terminating nested workflows
I have a AWS step function defined in the C# CDK where one of the states is a task as defined as such:
var executeGlueJobStepFunction = new CustomState(this, "ExecuteGlueJobStepFunction", ...
1
vote
1
answer
225
views
StepFunction to Lambda to EKS
I have a requirement to run the EKS job to perform certain task. The flow is like this, StepFunction has 3 stages (stage1, stage2, stage3). Each stage has specific task to do and has an docker image ...
2
votes
1
answer
810
views
Step Functions JSONata MapIterator Bug
When I have this input
{
"input": {
"bucket_name": "ml-platform-qa-us-east-1",
"object_keys": [
{
"Key": "aws/lambda/...
0
votes
1
answer
170
views
How to find out step function external IP address
I have a step function that is running in an AWS account that connects into an RDS database in another account.
I need to reduce the scope of the RDS security group rule but I can find the external IP ...
1
vote
0
answers
184
views
Set Execution Name to Step Function Triggered by EventBridge Rule and Target
I am triggering a step function with and event bridge rule and target. I would like to set a custom event name for the state machine. I am able to do this if I use a Scheduled run but not a Rule with ...
0
votes
2
answers
309
views
How to Share Links to AWS Resources?
I am trying to keep note of certain Step Function executions by copying their URL but when I log out and log back in, the URL stops working and I get the error:
This session is invalid or has expired. ...
1
vote
1
answer
1k
views
Evaluating an embedded JSONata string in Amazon State Language
How can I ensure that a nested JSONata expression resolves in AWS Step Functions?
I have the following input to a state:
{ "value1": "something", "value2": "{% $...
1
vote
0
answers
71
views
Using AWS Step Functions to Dynamically write DynamoDB records
I'm working with AWS Step Functions to save records to DynamoDB. I am trying to control the name of the DynamoDB record based on the input
Based on an input of number1, the record should be 'lesser' ...