Cloud โ˜๏ธ AI ๐Ÿง  DevOps - CS grad @UNTsocial ๐ŸŽ“

Texas, USA
Joined April 2024
Whoa thatโ€™s a full rainbow, all the way, double rainbow ohmygod, itโ€™s a double rainbow all the way
48
171
18
1,983
84,976
10 GitHub repos that will set you up for a career in AI engineering (100% free):
15
167
4
1,342
257,674
Full Course: MCP for Beginners Build #AIAgents with #MCP (powerful framework for building secure, scalable, and real-world #AI apps). Explore core concepts, hands-on dev, advanced implementation, and how to build and deploy AI agents with MCP in #VSCode youtu.be/VfZlglOWWZw?si=gw4-โ€ฆ
1
62
306
28,609
Learn how to supercharge #generativeAI workflows with NVIDIA DGX Cloud on #AWS & #AmazonBedrock Custom Model Import ๐Ÿ‘‰ go.aws/44YoyQw
1
4
1
39
1,865
New advanced AI features coming to Search: Gemini 2.5 Pro and Deep Search are rolling out in AI Mode to help with more complex questions and research - available now to Google AI Pro/Ultra subscribers. Plus, a new agentic capability directly in Search: AI-powered calling to local businesses, rolling out to all users in the US.
161
277
48
3,211
223,629
Docker Model Runner - really a game changer ๐Ÿ™Œ @Docker
66
Today is the start of a new era of natively multimodal AI innovation. Today, weโ€™re introducing the first Llama 4 models: Llama 4 Scout and Llama 4 Maverick โ€” our most advanced models yet and the best in their class for multimodality. Llama 4 Scout โ€ขย 17B-active-parameter model with 16 experts. โ€ขย Industry-leading context window of 10M tokens. โ€ขย Outperforms Gemma 3, Gemini 2.0 Flash-Lite and Mistral 3.1 across a broad range of widely accepted benchmarks. Llama 4 Maverick โ€ขย 17B-active-parameter model with 128 experts. โ€ขย Best-in-class image grounding with the ability to align user prompts with relevant visual concepts and anchor model responses to regions in the image. โ€ข Outperforms GPT-4o and Gemini 2.0 Flash across a broad range of widely accepted benchmarks. โ€ข Achieves comparable results to DeepSeek v3 on reasoning and coding โ€” at half the active parameters. โ€ขย Unparalleled performance-to-cost ratio with a chat version scoring ELO of 1417 on LMArena. These models are our best yet thanks to distillation from Llama 4 Behemoth, our most powerful model yet. Llama 4 Behemoth is still in training and is currently seeing results that outperform GPT-4.5, Claude Sonnet 3.7, and Gemini 2.0 Pro on STEM-focused benchmarks. Weโ€™re excited to share more details about it even while itโ€™s still in flight. Read more about the first Llama 4 models, including training and benchmarks โžก๏ธ go.fb.me/gmjohs Download Llama 4 โžก๏ธ go.fb.me/bwwhe9
810
2,333
1,172
12,606
3,671,582
Llama 4 Herd is here! It brings a lot of goodies, like MoE architecture and native multimodality, enabling developers to build personalized multimodal experiences. With Day 0 support in vLLM, you can deploy Llama 4 with @vllm_project now! Let's dig into it. (a thread)
5
46
10
182
148,615
๐—”๐—ฃ๐—œ ๐—š๐—ฎ๐˜๐—ฒ๐˜„๐—ฎ๐˜† ๐˜ƒ๐˜€ ๐—Ÿ๐—ผ๐—ฎ๐—ฑ ๐—•๐—ฎ๐—น๐—ฎ๐—ป๐—ฐ๐—ฒ๐—ฟ ๐˜ƒ๐˜€ ๐—ฅ๐—ฒ๐˜ƒ๐—ฒ๐—ฟ๐˜€๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐˜…๐˜† When designing a system, we often need clarification about the roles of a Load Balancer and an API Gateway. Most of our resources focus on their implementation rather than real-life use cases. ๐Ÿ”น ๐—”๐—ฃ๐—œ ๐—š๐—ฎ๐˜๐—ฒ๐˜„๐—ฎ๐˜† sits between a client and a group of backend services. It performs the function of a reverse proxy by accepting all application programming interface (API) calls, aggregating the different services needed to fulfill them, and returning the right outcome. ๐—จ๐˜€๐—ฒ๐—ฟ ๐—ฎ๐˜‚๐˜๐—ต๐—ฒ๐—ป๐˜๐—ถ๐—ฐ๐—ฎ๐˜๐—ถ๐—ผ๐—ป, ๐—ฟ๐—ฎ๐˜๐—ฒ ๐—น๐—ถ๐—บ๐—ถ๐˜๐˜€, ๐—ฎ๐—ป๐—ฑ ๐˜€๐˜๐—ฎ๐˜๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ are typical duties that API gateways take care of on behalf of a system of API services. Also, the API gateway can handle faults (circuit breaker) and log and monitor. ๐Ÿ”น ๐—Ÿ๐—ผ๐—ฎ๐—ฑ ๐—•๐—ฎ๐—น๐—ฎ๐—ป๐—ฐ๐—ฒ๐—ฟ is a service that distributes incoming traffic across many servers or resources. Usually, we have two or more web servers on the backend, and it ๐—ฑ๐—ถ๐˜€๐˜๐—ฟ๐—ถ๐—ฏ๐˜‚๐˜๐—ฒ๐˜€ ๐—ป๐—ฒ๐˜๐˜„๐—ผ๐—ฟ๐—ธ ๐˜๐—ฟ๐—ฎ๐—ณ๐—ณ๐—ถ๐—ฐ ๐—ฏ๐—ฒ๐˜๐˜„๐—ฒ๐—ฒ๐—ป ๐˜๐—ต๐—ฒ๐—บ. Its primary purpose is to use resources optimally. A more equal task allocation and increased capacity can enhance the system's responsiveness and reliability. There are three high-level load balancers: hardware-based, cloud-based, and software-based. ๐Ÿ”น ๐—ฅ๐—ฒ๐˜ƒ๐—ฒ๐—ฟ๐˜€๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐˜…๐˜† server resides in front of backend servers and transfers client requests to these servers. Reverse proxies are typically used to increase security, speed, and dependability. A reverse proxy receives a request from a client, forwards it to another server, and then returns it to the client, giving the impression that the first proxy server handled the request. These proxies ensure that users don't access the origin server directly, giving the web server anonymity. They are usually used for Load balancing, where we need to deal with incoming traffic flow so that we may distribute that traffic between multiple backend servers or use them for caching. So, the main thing that differs these two is that an ๐—”๐—ฃ๐—œ ๐—š๐—ฎ๐˜๐—ฒ๐˜„๐—ฎ๐˜† ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฐ๐˜‚๐˜€๐—ฒ๐—ฑ ๐—ผ๐—ป ๐—ฟ๐—ผ๐˜‚๐˜๐—ถ๐—ป๐—ด ๐—ฟ๐—ฒ๐—พ๐˜‚๐—ฒ๐˜€๐˜๐˜€ to the appropriate service and it handles requests for APIs, while a ๐—Ÿ๐—ผ๐—ฎ๐—ฑ ๐—ฏ๐—ฎ๐—น๐—ฎ๐—ป๐—ฐ๐—ฒ๐—ฟ ๐—ถ๐˜€ ๐—ณ๐—ผ๐—ฐ๐˜‚๐˜€๐—ฒ๐—ฑ ๐—ผ๐—ป ๐—ฑ๐—ถ๐˜€๐˜๐—ฟ๐—ถ๐—ฏ๐˜‚๐˜๐—ถ๐—ป๐—ด ๐—ฟ๐—ฒ๐—พ๐˜‚๐—ฒ๐˜€๐˜๐˜€ ๐—ฒ๐˜ƒ๐—ฒ๐—ป๐—น๐˜† between a group of servers and handles requests that are sent to a single IP address, which works at protocol or socket level (TCP, HTTP). Some ๐—ฒ๐˜…๐—ฎ๐—บ๐—ฝ๐—น๐—ฒ๐˜€ of API Gateways are Amazon API Gateway, Ocelot (.NET-based), Tyk, or Apache APISIX, while Load Balancers are Azure Load Balancer, HAProxy, or Seesaw. An example of reverse proxy services is ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—ฃ๐—ฟ๐—ผ๐˜…๐˜†, ๐—ก๐—ด๐—ถ๐—ป๐˜… ๐—ผ๐—ฟ ๐—œ๐—œ๐—ฆ with additional modules (Url Rewrite). #technology #softwareengineering #programming
7
92
594
37,675
A fantastic example of AI's impact on agriculture.
397
2,073
316
11,864
7,374,607
RIP Google and LinkedIn! Deepsearch in Grok 3 is the future of job hunting. Hereโ€™s a step~by~step guide ๐Ÿ‘‡ (Bookmarkย forย later)
47
406
7
2,927
554,356
Kubernetes Security (where to focus)๐Ÿ”ฅ๐Ÿ”ฅ 1. RBAC 2. Network Policies 3. Secrets Manager 4. PSD & PSA 5. Image Security & Runtime Protection
4
35
247
13,697
AWS + Terraform : 3-Tier Architectures (Practical Guide)
2
56
1
347
53,203
Challenges of Using Different IaC Tools and Role of Terraform ๐Ÿ‘‰Using different Infrastructure as Code (IaC) tools for different cloud providers presents several challenges. โžก๏ธHere's a breakdown of the issues: ๐Ÿ‘‰Vendor Lock-In and Script Incompatibility: 1.When an organization uses tools specific to a cloud provider, such as AWS CloudFormation Templates (CFT) for AWS or Azure Resource Manager for Azure, the scripts created for one cloud platform are not compatible with others. 2.This means that if the organization decides to switch cloud providers, all of the existing automation scripts must be rewritten for the new platform. This can be very time-consuming and require a lot of effort. ๐Ÿ‘‰Increased Complexity in Hybrid Cloud Environments: Many companies operate in a hybrid cloud model, utilizing multiple cloud platforms such as AWS and Azure. In this model, if different tools are used for each cloud, a DevOps engineer has to learn multiple tools to manage the infrastructure across these different cloud providers. ๐Ÿ‘‰Need to Learn Multiple Tools: The variety of tools for different platforms means that DevOps engineers need to learn multiple tools, such as AWS CFT, Azure Resource Manager, and Heat templates for Openstack, depending on the platforms the organization uses. This increases the learning curve and the complexity of managing infrastructure. ๐Ÿ‘‰Difficult Migrations: The need to rewrite scripts when migrating from one cloud provider to another is a major problem. The scripts written for one cloud provider can not be used on another, requiring significant effort to rewrite them. โžก๏ธTerraform addresses these issues by acting as a common interface that translates instructions into API calls for each specific cloud provider. โžก๏ธThis tool can manage infrastructure across different cloud providers using a single language and set of scripts.
1
17
628
๐Ÿš€ Choosing the Right AWS Database: RDS vs. DynamoDB vs. ElastiCache! ๐Ÿš€ ๐Ÿ’ก Struggling to decide which database is best for your workload? โœ… Need structured SQL data with transactions? โ†’ RDS โœ… Looking for high-speed, serverless NoSQL? โ†’ DynamoDB โœ… Want ultra-fast caching to boost performance? โ†’ ElastiCache โšก Each has its strengths - pick the right one for your needs! Letโ€™s break it down. โฌ‡๏ธ
5
7
65
6,449
Agile + DevOps = Speed + Stability Break silos, build faster, and deliver value continuously. #DevOps #Agile #CICD
1
1
1
9
731
this is how i learn gpu programming and CUDA to make it easier for me: - the most important part is to really understand how the GPU is structured and the memory hierarchy within it i.e. global memory, constant memory, caches, shared memory, registers, and so on. - secondly, stop thinking sequentially. i mean think about how the execution of your operation will look like in parallel. think about the data flow and the operations involved. - CUDA relies on grid of blocks, and blocks of threads. understand the distinction between when to map your data to the threads, and when to map the threads to your data. - before jumping to writing any kernels, take a pen and a paper and just start visualizing the threads (and blocks) of the kernel and what you want them to do. - for CUDA, make sure you understand pointers and how you can play around with the indices to fetch/write data. - really pay attention while reading the book below, and also watch the corresponding video. read the code of others to try and understand what's happening there. - practice, practice, practice.
learning gpu programming has humbled me so much, everyday i am giving 2-3 hrs after work to read theory and code in cuda/triton. this shiz is tough and has a steep learning curve
16
143
6
1,559
121,772
Amazon provides three primary options for running containers: ECS (Elastic Container Service), EKS (Elastic Kubernetes Service), and Fargate. Let's understand them one by one ๐Ÿ‘‡๐Ÿ‘‡
11
87
3
713
101,960
6 Key guidelines for building GenAI Apps (White Paper with quick Case Study)
1
3
16
2,035