← all repositories
awslabs/generative-ai-cdk-constructs

AWS's pre-built Lego kit for generative AI infrastructure

Skip wiring Bedrock, SageMaker, and OpenSearch by hand—these CDK constructs package common GenAI patterns into reusable infrastructure blocks.

537 stars TypeScript LLMOps · EvalRAG · SearchAgents
generative-ai-cdk-constructs
Velocity · 7d
+0.5
★ / day
Trend
steady
star history

What it does

This library is a set of AWS CDK constructs—pre-built, multi-service infrastructure patterns for generative AI workloads. You import them in TypeScript, Python, Go, Java, or C# and instantiate things like “deploy a Hugging Face model to SageMaker” or “monitor Bedrock with a CloudWatch dashboard” without hand-rolling IAM roles or VPC configs.

The interesting bit

The constructs are organized into L2 and L3 abstraction layers. L3 constructs are essentially full recipes (SageMaker endpoint + model + permissions in one go), while L2s are more composable building blocks. Notably, the Bedrock L2 constructs are being migrated into the core AWS CDK repository itself—this repo served as a proving ground.

Key highlights

  • Ships in five languages via JSII (TypeScript, Python, Java, C#, Go)
  • Covers SageMaker JumpStart/Hugging Face/custom model deployment, Bedrock batch inference via Step Functions, Bedrock data automation, and vector stores (OpenSearch Serverless, Aurora DSQL, S3 vectors)
  • Includes a separate samples repo with full-stack demo apps
  • Backed by two AWS workshops and a re:Invent 2023 keynote mention
  • Experimental stability: AWS warns of possible breaking changes between versions

Caveats

  • Explicitly marked experimental; no SemVer guarantees, so upgrades may require code changes
  • Bedrock L2 constructs here are deprecated and migrating to the main CDK repo
  • The README is vague on exact version compatibility beyond “check CHANGELOG.md”

Verdict

Worth a look if you’re already in the AWS CDK ecosystem and tired of copy-pasting CloudFormation for Bedrock or SageMaker endpoints. Skip it if you’re on Terraform (though AWS offers parallel modules) or if you need battle-tested, stable APIs right now.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.