Website Technology Profiler

{
  "PageContent": "<h3>Zittatech Blog – Ramblings of a time traveler</h3>Why Your Cloud is a MessAny sizable cloud infrastructure maintained manually is usually a mess.    What I’ve seen happen is this: A developer manually sets up an instance or two to get his/her project going.  He/she manually set up firewall rules (security group on AWS) and subnets to go with this.   Then someone else comes along and brings up some other instances, and adds some other subnets and firewall rules.  Once this goes on a few times, you have lots of firewall rules and subnet configurations.  If you let this go on, this grows to the point where you have a big mess that no one knows how anything is connected to what.  Quite often, everyone is too scared of touching anything because it might break something.   So we keep inserting compute/DB instances and subnets and firewall rules making matters worse.How do I know all this?  Well, because I’m often that guy who set things up by hand in the very beginning.  The cliché, of course, is I’ll just get by for now, we can do it right later.   Guilty as charged, but I’m sure you’ve been there too, no?Start Off RightSo how do we I avoid ending up with this mess? The root cause is that the initial setup is not automated and you start off creating instances by hand.   We all know DevOps automation is a tremendous help in maintaining Cloud infrastructure.  You really need to start off using automation from the start.  It really isn’t that hard.We all area lazy creatures, but if we make this so it’s easier to just add a few lines of code to automation script than to futz with the cloud console UI, we probably will do the right thing.So I wrote a simple set of TerraForm scripts to bootstrap a generic environment, so no manual setup is ever needed.  What follows is an example using TerraForm on Google Cloud Platform.  In the example below, we bootstrap a multi-region network (VPC) with public/private subnets and instances.   Creating EnvironmentThe example creates a standalone environment that contains the following on Google Cloud Platform:A VPC Network Two public subnets, one in region 1 and another in region 2Two private subnets, one in region 1 and another in region 2A firewall rule to allow traffic between all subnetsFirewall rules to allow ssh and httpA compute instance-1 in region 1 on public-subnet-1A compute instance-1 in region 2 on public-subnet-2TerraForm ScriptsPre-requisiteIn order to run the TerraForm scripts, you need Google Cloud Platform account, and  TerraForm and Google Cloud SDK installed.  There are many tutorials on this so I won’t go into it here.You also need a service account with proper permission and its credentials downloaded locally.  The credential file is referred to in main.tf.Directory OrganizationTo make things easier, TerraForm scripts are separated into:main.tf – loads TerraForm configuration providers for GCPvariables.tf –  defines variables used by scriptsmain.tf – loads TerraForm configuration providers for GCPvpc.tf  – Defines VPC and firewall rulesr1_network.tf – Defines the subnets for region 1r2_network.tf – Defines the subnets for region 2r1_instance.tf – Defines the instance to start in region 1r2_instance.tf – Defines the instance to start in regoin 2TerraForm scriptsmain.tfWe define two providers for GCP.   A lot of features Google Cloud SDK are made available while in beta.   This requires us to define the beta provider in order to access these beta features.The credential is for the service account that is allowed to create/delete the compute resources in the GCP project.   provider \"google\" {\r\n  project     = \"${var.project}\"\r\n  credentials = \"${file(\"your_service_acct.json\")}\"\r\n}\r\n\r\nprovider \"google-beta\" {\r\n  project     = \"${var.project}\"\r\n  credentials = \"${file(\"your_service_acct.json\")}\"\r\n}variables.tfThe variables should be pretty obvious.   Note that these can be overriden from the command line.variable \"project\" {\r\n        default = \"gcp-project-id\"\r\n    }\r\nvariable \"region1\" {\r\n        default = \"us-west2\"\r\n}\r\nvariable \"region2\" {\r\n        default = \"us-central1\"\r\n}\r\nvariable \"env\" {\r\n        default = \"dev\"\r\n    }\r\nvariable \"company\" {\r\n        default = \"akiatoji\"\r\n    }\r\nvariable \"r1_private_subnet\" {\r\n        default = \"10.26.1.0/24\"\r\n    }\r\nvariable \"r1_public_subnet\" {\r\n        default = \"10.26.2.0/24\"\r\n    }\r\nvariable \"r2_private_subnet\" {\r\n        default = \"10.28.1.0/24\"\r\n    }\r\nvariable \"r2_public_subnet\" {\r\n        default = \"10.28.2.0/24\"\r\n    }vpc.tfWe create the global VPC network.  We also define and assign firewall rules to it. resource \"google_compute_network\" \"vpc\" {\r\n  name          =  \"${format(\"%s\",\"${var.company}-${var.env}-vpc\")}\"\r\n  auto_create_subnetworks = \"false\"\r\n  routing_mode            = \"GLOBAL\"\r\n}\r\n\r\nresource \"google_compute_firewall\" \"allow-internal\" {\r\n  name    = \"${var.company}-fw-allow-internal\"\r\n  network = \"${google_compute_network.vpc.name}\"\r\n  allow {\r\n    protocol = \"icmp\"\r\n  }\r\n  allow {\r\n    protocol = \"tcp\"\r\n    ports    = [\"0-65535\"]\r\n  }\r\n  allow {\r\n    protocol = \"udp\"\r\n    ports    = [\"0-65535\"]\r\n  }\r\n  source_ranges = [\r\n    \"${var.r1_private_subnet}\",\r\n    \"${var.r1_public_subnet}\",\r\n    \"${var.r2_private_subnet}\",\r\n    \"${var.r2_public_subnet}\"\r\n  ]\r\n}\r\n\r\nresource \"google_compute_firewall\" \"allow-http\" {\r\n  name    = \"${var.company}-fw-allow-http\"\r\n  network = \"${google_compute_network.vpc.name}\"\r\nallow {\r\n    protocol = \"tcp\"\r\n    ports    = [\"80\"]\r\n  }\r\n  target_tags = [\"http\"]\r\n}\r\n\r\nresource \"google_compute_firewall\" \"allow-bastion\" {\r\n  name    = \"${var.company}-fw-allow-bastion\"\r\n  network = \"${google_compute_network.vpc.name}\"\r\n  allow {\r\n    protocol = \"tcp\"\r\n    ports    = [\"22\"]\r\n  }\r\n  target_tags = [\"ssh\"]\r\n}r1_network.tfAs you most likely already know, with GCP you can create multiple VPC networks within a project.  If you are coming from AWS, this looks the same at first, but there is a big difference.  VPC network is global on GCP where VPC is regional on AWS.  This means your environment is multi-regional from the very beginning on GCP.  To place resources in multiple regions, you need to create subnets in each region.   All subnets route to each other globally by default, all you have to do is create subnets in regions of your choice.  (As a side note, each project comes with a default network that covers every GCP region.) In this example, we create two networks (private/public) in two regions (r1/r2).   Regions are defined in variables.tf.The idea here is to attach private instances (with no public IP address) to private subnet, while public instances are assigned to the public subnet.   This is one area where we often see manual configurations get out of hand because intended network topology isn’t always followed.   Having these subnets and instances defined in the Terraform script makes it far easier to maintain this. resource \"google_compute_subnetwork\" \"public_subnet_r1\" {\r\n  name          =  \"${format(\"%s\",\"${var.company}-${var.env}-${var.region1}-pub-net\")}\"\r\n  ip_cidr_range = \"${var.r1_public_subnet}\"\r\n  network       = \"${google_compute_network.vpc.name}\"\r\n  region        = \"${var.region1}\"\r\n}\r\nresource \"google_compute_subnetwork\" \"private_subnet_r1\" {\r\n  name          =  \"${format(\"%s\",\"${var.company}-${var.env}-${var.region1}-pri-net\")}\"\r\n  ip_cidr_range = \"${var.r1_private_subnet}\"\r\n  network      = \"${google_compute_network.vpc.name}\"\r\n  region        = \"${var.region1}\"\r\n}r1_instance.tfA compute instance is brought up in each region, and Nginx is installed.   These instances are handy when developing TerraForm script.  We can log into these instances to test the network configuration, and also these instances can serve as boilerplate code for creating more instances.  GCP does give you a pretty good indication of applied firewall rules in the console, so you can do away with these instances as well.resource \"google_compute_instance\" \"web_ssh_r1\" {\r\n  name = \"${format(\"%s\",\"${var.company}-${var.env}-${var.region1}-instance1\")}\"\r\n  machine_type = \"n1-standard-1\"\r\n  #zone         =   \"${element(var.var_zones, count.index)}\"\r\n  zone = \"${format(\"%s\",\"${var.region1}-b\")}\"\r\n  tags = [\r\n    \"ssh\",\r\n    \"http\"]\r\n  boot_disk {\r\n    initialize_params {\r\n      image = \"debian-9-stretch-v20190326\"\r\n    }\r\n  }\r\n  labels {\r\n    webserver = \"true\"\r\n  }\r\n  metadata {\r\n    startup-script = &lt;&lt;SCRIPT\r\n        apt-get -y update\r\n        apt-get -y install nginx\r\n        export HOSTNAME=$(hostname | tr -d '\\n')\r\n        export PRIVATE_IP=$(curl -sf -H 'Metadata-Flavor:Google' http://metadata/computeMetadata/v1/instance/network-interfaces/0/ip | tr -d '\\n')\r\n        echo \"Welcome to $HOSTNAME - $PRIVATE_IP\" &gt; /usr/share/nginx/www/index.html\r\n        service nginx start\r\n        SCRIPT\r\n  }\r\n  network_interface {\r\n    subnetwork = \"${google_compute_subnetwork.public_subnet_r1.name}\"\r\n    access_config {\r\n      // Ephemeral IP\r\n    }\r\n  }\r\n  scheduling {\r\n    preemptible = true\r\n    automatic_restart = false\r\n  }\r\n}Running TerraFormOnce the TerraForm scripts are in place, bringing up the environment is easy:$&gt; terraform init\r\n$&gt; terraform applyThis also executes really fast on GCP.  It took mere just 70s…!Once created, you can see in the console that two sets of subnets are created in two regions.Also, two instances are created in two regions.   At this point you can SSH to one instance and access the other.  You can delete this environment with: $&gt; terraform destroySummaryThere aren’t as many examples of setting up a GCP environment with TerraForm. So initially, I had some issues and was a bit skeptical as to how well TerraForm would work with GCP.   Once I got the basics up and running though, I was pleasantly surprised by how well it worked, and also how fast GCP created resources and spinned up instances.These TerraForm scripts also allow you to create a completely separate clone VPC with a mere command line argument.  You can now build dev, test, integration or production environments with ease.All this, of course, is possible if you start off your project with an automated build of the cloud environment.Cheers,",
  "Url": "https://blog.zittatech.com",
  "IpAddress": "23.23.73.150",
  "ReverseDns": "ec2-23-23-73-150.compute-1.amazonaws.com",
  "Asn": null,
  "Http2": false,
  "Http3": false,
  "ResponseTimeMs": 1944,
  "StatusCode": 200,
  "ServerHeaders": [
    "Apache"
  ],
  "Ssl": {
    "Issuer": "CN=Amazon RSA 2048 M01, O=Amazon, C=US",
    "Subject": "CN=zittatech.com",
    "NotBefore": "2025-09-16T17:00:00-07:00",
    "NotAfter": "2026-10-16T16:59:59-07:00",
    "SubjectAltNames": [
      "DNS Name=zittatech.com",
      "DNS Name=*.zittatech.com"
    ],
    "Hsts": false,
    "Ciphers": [],
    "Protocol": "Tls12",
    "DaysUntilExpiry": 258
  },
  "Cdns": [],
  "HostingHints": [],
  "Cms": [
    "WordPress",
    "WordPress (robots.txt)"
  ],
  "Frameworks": [],
  "JsLibraries": [],
  "Analytics": [
    "Google Analytics UA",
    "Google Analytics GA4",
    "Segment"
  ],
  "AdsAndMarketing": [
    "Google AdSense"
  ],
  "PaymentGateways": [],
  "EcommerceHints": [
    "Magento",
    "PrestaShop"
  ],
  "SocialSignals": [],
  "MediaProviders": [],
  "SeoTags": [
    "content-type: text/html; charset=UTF-8"
  ],
  "HtmlLanguage": "en-US",
  "HasRobots": true,
  "HasSitemap": true,
  "SecurityHeaders": [],
  "CookiesObserved": [
    "PHPSESSID=affad4916fb875c5bf5b9aa47e79a6de; path=/"
  ],
  "XhrApiHints": [],
  "SitemapCounts": {
    "total_urls": 3
  },
  "ChatWidgets": [],
  "ABTesting": [],
  "PrivacyConsent": [],
  "EmailMarketing": [],
  "WebFonts": [],
  "DynamicJs": [
    "Bootstrap (CDN Detection)",
    "ES6+ JavaScript Features",
    "Web Server: Apache",
    "React (Script Analysis)"
  ],
  "ResourceHosts": [
    "pagead2.googlesyndication.com",
    "blog.zittatech.com",
    "gmpg.org"
  ],
  "CssFrameworks": [],
  "BuildTools": [],
  "ServerTech": [
    "Generator: WordPress 6.9",
    "PHP"
  ],
  "DatabaseHints": [],
  "PageTitle": "Zittatech Blog &#8211; Ramblings of a time traveler",
  "MetaDescription": null,
  "ImageCount": 6,
  "ScriptCount": 10,
  "LinkCount": 10,
  "Errors": [],
  "UiFrameworks": [
    "Slate",
    "Angular Material (Class Names)"
  ]
}