AWS Step Functions

What is AWS Step functions?

✓ It's is an serverless orchestration service that allows you to integrate with various other AWS service so easily.

Example: You can connect series of lambda function in a step function and you can define when or in which order the lambda functions should execute.

✓ Using AWS console you can easily, visualize the steps associated and understand failed step quickly and can take action.

✓ Step function runs based on state machine and task.

✓ Step functions allows you to create starting from simple workflow (eg: like call an lambda function ) to complex workflow (eg: like call 100 lambda function in parallel and once 100 lambda execution completes, call 200 glue jobs in series and publish success or failure message to SNS topic).

✓ Step functions reduces that extra lines code that you need to write for system/service integration, wait and error handling.

✓ Right from the AWS step functions you can able to call the AWS SDK's to perform extra operations on hundreds of AWS service, right inside from your step function without writting any piece of code.

Two types of step functions you can create while am writing this post in Sep'2023.

✓ Standard:

~ For standard workflows.

~ 2,000 per second execution rate.

~ 4,000 per second state transition rate.

~ Priced by state transition.

✓ Express

~ For quick workflows.

~ 100,000 per second execution rate.

~ Unlimited state transition rate.

~ Priced by number and duration of executions.

Benefits of using AWS Step functions?

#1: Function orchestration

#2: Branching

#3: Error handling

#4: Iteration or looping

#5: Parallel processing

To know this kind of interesting tech stuff's follow / subscribe / Bookmark 👉Tech Bird👈

Have a Great Day

Comments

BIG DATA ANALYTICS

BIG DATA ANALYTICS Have you ever hit upon how Amazon and Flip kart could possible verdict what we want; how the Google auto completes our search; how the YouTube looks into videos we want to watch? When we open YouTube, we will be at sixes and sevens, when we find ads related to what we have searched earlier in the past days. This is where we find ourselves in the era of big data analytics. More than 3 trillion bytes of information are being generated everyday through our smart phones, tablets, GPS devices, etc. Have we thought about what can be done with all these information? This is where the data analytics comes into play. Big data analytics is just the study of future build up to store data in order to extract the behaviour patterns. The entire social networking website gathers our data which are related to our interest which is usually done by using our past search or any other social information. Data analytics will lead to a walkover in near future....

Power of AWS Step Functions

Are you writing Python or Node.js code to do Automation or Pull Reports or Inventory in AWS? 💯 If yes, this post is for you and probably you may end up like this read and learn something new today. 🚨 Spoiler Alert 😅:- Am going to talk about AWS Step Functions. ⭐ Yes, with recent advances rolled out in step functions, we can do lot more than, what we thought it does and what we are doing with it. 🧐 Previously we would have used step functions for cases like :- ✍️Lambda can't run beyond 15 mins, so if we want more wait time for some task, we used to call step functions and wait there and re-trigger lambda to process same event. ✍️To call multiple lambda in sequence or parallel, we would have used it. 🖇️Basically what we do is, always we keep our core logic in lambda and just used step functions for so called "orchestration" to call lambda in different patterns. If you agree with me, then below are some real time use cases, you can try and unleash the real p...

Hidden things About Amazon SageMaker Studio

Did you know about Amazon SageMaker Studio❓ 🤔 Like you, I initially believed that this service was only for data-related tasks and that regular engineers/developers weren't supposed to use it. ✒️ However, after using it for a while, I would suggest that it can help you with more than just data related tasks. In fact, an organization can use SageMaker Studio to bring their entire SDLC 💪. 😬 Because of its data'ish ness like gimick we (normal non-data developers) always felt, "Oh, SageMaker, it's expensive 😱 so no, no don't go that side 🤐." 😷 As a result, we shrank and missed the hidden gem 💎 and its possibilities, as well as the opportunity to utilize such a fantastic and powerful tool 🔥. ✒️ Let me give you some glimpse with a preview of what SageMaker Studio is capable of. ✒️ SageMaker is big service, but in this post am limiting my context towards SageMaker Studio only. ✒️ And mostly, this write-up is for developers who enjoy writin...

Tech Bird

Search This Blog