[DeepDive] Infrastructure as Code (IaC), Deployment, CI/CD, etc

[0xdevalias]

Cloud Development Kit (CDK)

• https://cdk.dev/

  • The community driven hub around the Cloud Development Kit (CDK) ecosystem. This site brings together all the latest blogs, videos, and educational content. Connect with the community of AWS CDK, CDK for Kubernetes (cdk8s) and CDK for Terraform (cdktf).

  • https://github.com/cdk-dev
• https://www.cdkday.com/

  • Over a year has passed since AWS CDK went GA and it has now grown into a family of products (AWS CDK, CDK for Terraform, CFK8s)

  • A small group of community members from across the globe thought this was something worth celebrating so we are going to take one day and showcase the brightest and best of cdk from across the whole product family. Let's talk serverless, kubernetes and multi cloud all in the same day!

AWS CDK

• https://aws.amazon.com/cdk/

  • The AWS Cloud Development Kit (AWS CDK) is an open source software development framework to define your cloud application resources using familiar programming languages.

• https://github.com/aws/aws-cdk

  • The AWS Cloud Development Kit is a framework for defining cloud infrastructure in code

• https://docs.aws.amazon.com/cdk/api/latest/
  • https://docs.aws.amazon.com/cdk/api/latest/docs/aws-construct-library.html
  • https://docs.aws.amazon.com/cdk/latest/guide/home.html
• https://cdkworkshop.com/
  • https://github.com/aws-samples/aws-cdk-intro-workshop
• https://awscdk.io/
  • https://github.com/construct-catalog/catalog

    • The CDK Construct Catalog is an index of multi-language AWS CDK libraries.

    • This is a community project and is not officially supported by AWS.
      -> The service watches npmjs and every time it discovers a new npm jsii module with the keyword cdk, it will automatically render a reference documentation web page for it and tweet about it through the @awscdkio handle.

CDK8s

• https://cdk8s.io/

  • cdk8s is an open-source software development framework for defining Kubernetes applications and reusable abstractions using familiar programming languages and rich object-oriented APIs. cdk8s apps synthesize into standard Kubernetes manifests which can be applied to any Kubernetes cluster.

• https://github.com/awslabs/cdk8s

  • Define Kubernetes native apps and abstractions using object-oriented programming

• https://github.com/dungahk/awesome-cdk8s

  • This repository curates the best ckd8s resources.

• Articles
  • https://aws.amazon.com/blogs/containers/introducing-cdk-for-kubernetes/

CDK for Terraform (CDKtf)

• https://github.com/hashicorp/terraform-cdk

  • Define infrastructure resources using programming constructs and provision them using HashiCorp Terraform

• Articles:
  • https://www.hashicorp.com/blog/cdk-for-terraform-enabling-python-and-typescript-support
• See Also:
  • Terraform (below)

Pulumi

• https://www.pulumi.com/

  • Create, deploy, and manage infrastructure on any cloud using familiar programming languages and tools.

  • https://www.pulumi.com/pricing/

    • COMMUNITY ($0): The basics of infrastructure as code for unlimited individual use.

  • https://www.pulumi.com/docs/
  • https://www.pulumi.com/blog/
• https://github.com/pulumi/pulumi

  • Pulumi's Infrastructure as Code SDK is the easiest way to create and deploy cloud software that use containers, serverless functions, hosted services, and infrastructure, on any cloud.

  • Simply write code in your favorite language and Pulumi automatically provisions and manages your AWS, Azure, Google Cloud Platform, and/or Kubernetes resources, using an infrastructure-as-code approach. Skip the YAML, and use standard language features like loops, functions, classes, and package management that you already know and love.

• Articles:
  • https://www.pulumi.com/blog/automation-api/

    • Today we’re excited to announce the Pulumi Automation API, a robust programmatic layer on top of Pulumi’s declarative Infrastructure as Software. The Automation API exposes Pulumi programs and stacks as strongly-typed and composable building blocks.

    • Pulumi can be fully embedded inside your software projects - to power a wide range of custom cloud infrastructure automation projects. No CLI, no human-in-the-loop, just code.

Terraform

• https://www.terraform.io/
  • https://www.terraform.io/docs/
• https://github.com/hashicorp/terraform

  • Terraform enables you to safely and predictably create, change, and improve infrastructure. It is an open source tool that codifies APIs into declarative configuration files that can be shared amongst team members, treated as code, edited, reviewed, and versioned.

AWS CloudFormation

• https://aws.amazon.com/cloudformation/

  • AWS CloudFormation gives you an easy way to model a collection of related AWS and third-party resources, provision them quickly and consistently, and manage them throughout their lifecycles, by treating infrastructure as code. A CloudFormation template describes your desired resources and their dependencies so you can launch and configure them together as a stack. You can use a template to create, update, and delete an entire stack as a single unit, as often as you need to, instead of managing resources individually. You can manage and provision stacks across multiple AWS accounts and AWS Regions.

• https://github.com/aws-cloudformation

  • AWS CloudFormation provides a common language for you to describe and provision all the infrastructure resources in your cloud environment.

  • https://github.com/aws-cloudformation/cloudformation-cli

    • The CloudFormation CLI (cfn) allows you to author your own resource providers that can be used by CloudFormation.

  • https://github.com/aws-cloudformation/rain

    • A development workflow tool for working with AWS CloudFormation.

    • https://github.com/aws-cloudformation/rain#other-cloudformation-tools
  • https://github.com/aws-cloudformation/cloudformation-guard

    • A set of tools to check AWS CloudFormation templates for policy compliance using a simple, policy-as-code, declarative syntax

  • https://github.com/aws-cloudformation/awesome-cloudformation

    • A curated list of resources and projects for working with AWS CloudFormation.

• See Also:
  • AWS CDK (above)

Continuous Integration / Continuous Delivery (CI/CD)

GoCD

• https://www.gocd.org/

  • Free and open source CI/CD server

  • https://www.gocd.org/plugins/
• https://github.com/gocd/gocd

  • GoCD helps you automate and streamline the build-test-release cycle for worry-free, continuous delivery of your product.

Argo

• https://argoproj.github.io/

  • Open source Kubernetes native workflows, events, CI and CD

  • https://blog.argoproj.io/
  • https://argoproj.github.io/projects/argo/

    • Argo Workflows is an open source container-native workflow engine for orchestrating parallel jobs on Kubernetes. Argo Workflows is implemented as a Kubernetes CRD.

  • https://argoproj.github.io/projects/argo-cd/

    • Argo CD is a declarative, GitOps continuous delivery tool for Kubernetes.

  • https://argoproj.github.io/argo-rollouts/

    • Argo Rollouts is a Kubernetes controller and set of CRDs which provide advanced deployment capabilities such as blue-green, canary, canary analysis, experimentation, and progressive delivery features to Kubernetes.

  • https://argoproj.github.io/projects/argo-events/

    • Argo Events is an event-based dependency manager for Kubernetes which helps you define multiple dependencies from a variety of event sources like webhook, s3, schedules, streams etc. and trigger Kubernetes objects after successful event dependencies resolution.

• https://github.com/argoproj/argo

  • Argo Workflows: Get stuff done with Kubernetes.

• https://github.com/argoproj/argo-cd

  • Declarative continuous deployment for Kubernetes.

• https://github.com/argoproj/argo-rollouts

  • Progressive Delivery for Kubernetes

• https://github.com/argoproj/argo-events
  -> Event-driven workflow automation framework

InfraCost

• https://www.infracost.io/

  • Developers don't know how much their cloud resources cost until they get the invoice at the end of the month. We integrate with developers' existing workflows to show them costs as they code.

  • Infracost is free and open-source

• https://github.com/infracost/infracost

  • Cloud cost estimates for Terraform in your CLI and pull requests

OctoDNS

• https://github.com/github/octodns

  • In the vein of infrastructure as code OctoDNS provides a set of tools & patterns that make it easy to manage your DNS records across multiple providers. The resulting config can live in a repository and be deployed just like the rest of your code, maintaining a clear history and using your existing review & workflow.

Unsorted

• https://www.waypointproject.io/

  • Waypoint provides a modern workflow to build, deploy, and release across platforms.

• https://cloud.google.com/solutions/infrastructure-as-code
  • https://cloud.google.com/deployment-manager

    • Create and manage cloud resources with simple templates.

• https://github.com/google/go-cloud

  • The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.

  • https://gocloud.dev/

    • The Go Cloud Development Kit (Go CDK) is an open source project building libraries and tools to improve the experience of developing for the cloud with Go.

    • Go CDK provides commonly used, vendor-neutral generic APIs that you can deploy across cloud providers. The idea is to support hybrid cloud deployments while combining on-prem (local) and cloud tools.

  • Articles:
    • https://blog.golang.org/go-cloud

      • Today, the Go team at Google is releasing a new open source project, Go Cloud, a library and tools for developing on the open cloud. With this project, we aim to make Go the language of choice for developers building portable cloud applications.

        • https://cloud.google.com/open-cloud/

          • Openness enables faster innovation, tighter security, and offers freedom from vendor lock-in. Google believes openness matters more in the cloud than ever.

See Also

• https://github.com/topics/infrastructure-as-code
• https://github.com/topics/continuous-delivery
• https://github.com/topics/continuous-integration
• https://github.com/topics/continuous-deployment
• https://github.com/topics/continuous-testing
• https://www.cncf.io/

  • The Cloud Native Computing Foundation (CNCF) hosts critical components of the global technology infrastructure. CNCF brings together the world’s top developers, end users, and vendors and runs the largest open source developer conferences. CNCF is part of the nonprofit Linux Foundation.

  • CNCF serves as the vendor-neutral home for many of the fastest-growing open source projects, including Kubernetes, Prometheus, and Envoy.

  • https://www.cncf.io/projects/
  • https://www.cncf.io/sandbox-projects/
  • https://www.cncf.io/archived-projects/
• [DeepDive] 'Exo-cortex', event systems, enriching human intelligence, automation, workflows, etc #19

  • [DeepDive] 'Exo-cortex', event systems, enriching human intelligence, automation, workflows, etc