AWS Step Functions

What is AWS Step functions?

✓ It's is an serverless orchestration service that allows you to integrate with various other AWS service so easily.

Example: You can connect series of lambda function in a step function and you can define when or in which order the lambda functions should execute.

✓ Using AWS console you can easily, visualize the steps associated and understand failed step quickly and can take action.

✓ Step function runs based on state machine and task.

✓ Step functions allows you to create starting from simple workflow (eg: like call an lambda function ) to complex workflow (eg: like call 100 lambda function in parallel and once 100 lambda execution completes, call 200 glue jobs in series and publish success or failure message to SNS topic).

✓ Step functions reduces that extra lines code that you need to write for system/service integration, wait and error handling.

✓ Right from the AWS step functions you can able to call the AWS SDK's to perform extra operations on hundreds of AWS service, right inside from your step function without writting any piece of code.

Two types of step functions you can create while am writing this post in Sep'2023.

✓ Standard:

~ For standard workflows.

~ 2,000 per second execution rate.

~ 4,000 per second state transition rate.

~ Priced by state transition.

✓ Express

~ For quick workflows.

~ 100,000 per second execution rate.

~ Unlimited state transition rate.

~ Priced by number and duration of executions.

Benefits of using AWS Step functions?

#1: Function orchestration

#2: Branching

#3: Error handling

#4: Iteration or looping

#5: Parallel processing

To know this kind of interesting tech stuff's follow / subscribe / Bookmark 👉Tech Bird👈

Have a Great Day

Comments

BIG DATA ANALYTICS

BIG DATA ANALYTICS Have you ever hit upon how Amazon and Flip kart could possible verdict what we want; how the Google auto completes our search; how the YouTube looks into videos we want to watch? When we open YouTube, we will be at sixes and sevens, when we find ads related to what we have searched earlier in the past days. This is where we find ourselves in the era of big data analytics. More than 3 trillion bytes of information are being generated everyday through our smart phones, tablets, GPS devices, etc. Have we thought about what can be done with all these information? This is where the data analytics comes into play. Big data analytics is just the study of future build up to store data in order to extract the behaviour patterns. The entire social networking website gathers our data which are related to our interest which is usually done by using our past search or any other social information. Data analytics will lead to a walkover in near future....

Hidden things About Amazon SageMaker Studio

Did you know about Amazon SageMaker Studio❓ 🤔 Like you, I initially believed that this service was only for data-related tasks and that regular engineers/developers weren't supposed to use it. ✒️ However, after using it for a while, I would suggest that it can help you with more than just data related tasks. In fact, an organization can use SageMaker Studio to bring their entire SDLC 💪. 😬 Because of its data'ish ness like gimick we (normal non-data developers) always felt, "Oh, SageMaker, it's expensive 😱 so no, no don't go that side 🤐." 😷 As a result, we shrank and missed the hidden gem 💎 and its possibilities, as well as the opportunity to utilize such a fantastic and powerful tool 🔥. ✒️ Let me give you some glimpse with a preview of what SageMaker Studio is capable of. ✒️ SageMaker is big service, but in this post am limiting my context towards SageMaker Studio only. ✒️ And mostly, this write-up is for developers who enjoy writin...

Python #23-Regex findall() and sub() in Python

Previous Post : Python #22-Regex match() and search() in Python Next Post : Coming soon........ re.findall(): It find all sub strings where the RE matches, and return them as a list. This function is used to catch all the matching patterns in the strings. Note Worthy: re.match() + re.search() = re.findall() Syntax: re.findall(pattern, string) Source Code: import re variable = re.findall(r"Google", "Google Bird learn around Google and gives the best contents to the viewrs") print variable Output: ['Google', 'Google'] re.sub(): This is used to search a pattern in the string an replace with the new sub string. Syntax: re.sub(pattern, replac...

Tech Bird

Search This Blog