Cloudify 6.0.0 Release Notes

  • 6.0 New Functionality
  • Environment as a Service (EaaS) 2.0
    • Hierarchy based environments view
    • Map View
    • Embedded Actions
  • Orchestration at Scale
    • Labels & Filters
    • Bulk Actions
    • Environments Discovery
  • Operability
    • Scheduled Workflows
    • Deployment Display Name
    • Menu Updates
    • Getting Started Wizard
    • StarlingX
  • Developer Enhancements
    • The ‘Apply’ Command
    • Intrinsic Functions
    • Propagation of workflow parameters to sub-components
    • Blueprint Labels
  • Security & Compliance
    • ISO compliance
  • Maintenance
    • Cloudify Cluster Manager
    • Agents
    • LDAP Authentication improvements
    • Okta IdP SSO support
  • Other Improvements
  • Deploying Cloudify 6.0
    • v6.0 New installation
    • Download Cloudify 6.0
  • Support
    • Support Discontinuance
    • Product Features
    • Supported Versions

6.0 New Functionality

The key theme of v6.0 is Workload Orchestration at Scale.
Providing complete governance over single service or environment orchestration had been the focus of Cloudify in previous versions, and we take pride in our abilities to provide complete automation and Day 2 management to any service, simple or complex, over every combination of infrastructure, platform, and scenario.
Real life scenarios, however, don’t stop at that. With new Cloud-native and agile approaches, services are deployed over thousands of locations and require ongoing maintenance regardless of the underlay.
Cloudify 6.0 takes that to the next level with the ability to deploy, manage, and maintain workloads over thousands of locations in one action. Installation, update, configuration, modification, removal, and all other workflows can be executed over any number of services, based on a smart placement policy that takes into account any meaningful criteria – OS, architecture, location, version are just a few examples.

Environment as a Service 2.0
Hierarchy-based environments/services new pages allow for a clear view of your entire system, with the ability to tune it to your organization’s needs and set it up automatically.
Automatic discovery of environments and the ability to deploy a service onto multiple environments (potentially tens of thousands) unleash the operator’s power to run multi-geography services as easily as deploying a local one.

Characterize your services and environments and apply smart placement policies.
This major theme introduces enhancements to the way services and environments are described in the Cloudify database. By automatically/manually assigning labels to the objects, one may assign any set of criteria to their deployments and use that info to slice and dice their objects by any criteria that make sense. This allows for smart placement policies as well as mass Day 2 operations over any group of services.

Operability
With Cloudify 6.x, managing Cloudify is more granular and easy than before. Recurrent workflows, usability improvements, onboarding wizard, and extended developer options are just some of the enhancements applied.

Cloudify 6.0 is a major Cloudify release containing over 300 developed stories and 350 resolved issues and tasks, improving all aspects from functionality to robustness and security.

Environment as a Service (EaaS) 2.0

Building on top of the foundations set in previous releases, Cloudify v6.0 includes dedicated `Environments` views and actions.

Hierarchy based environments view

The new environments page was designed to be the operator’s one-stop-shop for data, monitoring and actions. It features three synchronized panes allowing quick identification of any service requiring attention based on its state, detecting data-center or regional issues, quick access to the complete details of the environment or service deployment details, and immediate action and workflow execution.

PHOTO

Each environment shares the aggregated state of all of its sub-environments and services which allows quick identification of issues. Drill-down to the root cause is done via the same page, and corrective actions are taken via the embedded workflow/action options.

PHOTO

Map View

The map view was adjusted to support tens of thousands of locations and hundreds of thousands of services and environments. It is optimized for anything from several regions, branches or data centers, to huge edge networks.
The operator view allows quick focus on the area or location of interest while reducing map clutter by aggregating and grouping items.

PHOTO

Embedded Actions

Run any Day 1 or Day 2 operation directly from the main view. See your updates take place in real-time. Resolve issues and track the impact from a single view.

PHOTO

Learn more about the new Deployments View.

Orchestration at Scale

Installing a single instance of an application or a service can be as easy or as complex as the service design and the infrastructure used. Running that service or app over 10K locations is more challenging.
With Cloudify 6.0 you can build your own placement policies by any criteria, and push both day1 and day 2 operations over any set of environments and services.
Installing a new service in all of your US branches, or running a certificate refresh over all of your production load balancers are just two examples of the new bulk actions.

Labels & Filters

Labels are sets of key+value which can be assigned with every Cloudify deployment.
Labels are completely granular and any set of labels can be assigned to a deployment or to a set of deployments.
For example: one may assign labels to characterize the geo-details (region=”US East”, location=NY), the architecture (platform=K8S, OS=linux), metadata (type=environment, upgrade-group=green), and so on.

PHOTO

Labels can be assigned and maintained at any phase of the lifecycle – A developer may set them as part of the blueprint, a user may specify them during deployment, and an admin may manage labels post-deployment during its existence.

PHOTO

Labels allow easy characterization and make Cloudify a single source of truth regarding the criteria, removing the need to maintain tables/files with various lists of services.
Learn more about labels and the different options to manage them.

Once labels are applied, Filters allow the user to group deployments by any combination of properties and thus slice and dice their services and environments to detect all items that comply with the filter’s logic.
Filters support multiple rules by various aspects such as labels, site, blueprint & owner, and a complete set of operators and logic. The user may save the filters and reuse them.

PHOTO

Filters can be used in the environments and Services views, but more importantly, filters are the basis for the bulk actions, allowing the user to deploy a service onto multiple environments or run a day2 operation over multiple services.
By selecting a filter, the user defines the list of systems onto which they wish to run the bulk actions, which makes for an extremely flexible placement policy.

Learn more about filters.

Bulk Actions

6.0 introduces two types of bulk actions – Deploy on & Run workflow

PHOTO

Deploy on allows the user to deploy a service onto multiple environments. For example, the user may select all of their EKS clusters that are used for staging as the list of environments, and use the Deploy on bulk action to deploy the latest version of their application using a helm chart over these clusters.

Cloudify will leverage the filter and the labels to generate the list of target environments, and then iterate the installation of the service while making the correlation between each environment and the service deployed on it. Using this approach, the user will not need to maintain the different environments credentials or details. Each environment will declare its properties such that the placement will be done automatically.

PHOTO

Run Workflow allows the user to apply a day2 operation over a large set of services/environments. After selecting the target list of deployments leveraging the new filters, the user selects the required day 2 operation, for example – run a security patch, and Cloudify will apply the relevant workflow on each of the environments based on the specific workflow defined for that service/environment.

Deploy on & Run Workflow bulk actions are available through API, CLI, and Web UI. The results of both can be tracked via the execution widget.

Learn more about bulk actions.

Environments Discovery

Populating the Cloudify DB with hundreds or thousands of existing environments is an important step on the path towards large-scale orchestration. Of course, such actions can be done manually or via a scripted flow, however, these options are cumbersome and error-prone. Cloudify 6.0 extends the options for auto-population of environments by adding an environment discovery automated workflow.

The new workflow scans existing services and retrieves the environment information into the Cloudify DB, thus allowing the user to discover their set of Amazon Kubernetes clusters (for example) and creating an environment in Cloudify per EKS cluster. Each discovered system is then labeled automatically for its region, location, flavor, and more. Information such as the connection token is also retrieved and securely stored to allow direct and seamless orchestration of services over this environment.

Once environment discovery is done, the system has all the required details to allow for a smart placement policy over these clusters (by criteria), and the required credentials allowing seamless installation or day 2 operation over these environments.

Discovery can be executed as a recurrent workflow, it will detect newly added systems and import them into Cloudify while identifying already imported systems to keep an updated picture at all times.

Version 6.0 provides out-of-the-box support for EKS and StarlingX discovery. These can easily be extended for more platforms and infrastructures via their dedicated plugins and follow-up releases will include support for AKS discovery, OpenShift discovery, and multiple more platforms.

Operability

Scheduled Workflows

Scheduling a workflow had been introduced in Cloudify 4.6, allowing users to set expiration time to installed systems (scheduled uninstall), run workflows at specific time windows, and more.
Cloudify 6.x adds recurrent schedules – allowing the user to setup any workflow to be executed on a regular basis at a specified time. Backing up systems, refreshing keys and tokens, scheduling maintenance patches, or setting up systems to be deployed and removed every weekend can now be easily set.
This provides both additional required functionality, and potentially a large cost reduction by using resources only at the time they are needed.

PHOTO

6.0 further extends the developer abilities to set the scheduling as part of the blueprint definition, thus any deployment generated from that blueprint will spawn its scheduled workflows during its deployment.

The scheduling structure is extremely flexible and allows for frequent (every
minute) recurrences, minutely, hourly, daily, weekly, and monthly options with smart flags (e.g. last monday of the month, how to handle failure and retry, how to handle downtime during scheduled execution, and more).
The workflow scheduling mechanism was updated and it is now running as a dedicated service.

Deployment Display Name

Cloudify deployment objects are identified by a unique ID through which other deployments may access the details of this deployment, users may search and detect that deployment.
In version 6.0 an additional property – Display Name – is added to the deployment and presented next to the ID.
The display name may consist of any UTF8 character and contain spaces and special characters that are not allowed as part of the ID.
In various reports and views, the user may now filter by the display name as well as the ID.

PHOTO

Upon deployment creation, it is optional for the user to submit a unique ID for the deployment. If they do not, the system allocates a UUID.

PHOTO

Menu Updates

Version 6.0 introduces an update to the settings and resources options on the left menu.
All system resources options are now grouped and managed as tabs under the Resources menu option. The tabs include Secrets, Plugins, Sites, Agents, and Filters.

PHOTO

The new System Setup menu item includes tabs for the following: Users, Groups, Tenant Management, System Health, System Logs, and Snapshots.

PHOTO

Getting Started Wizard

For first time users, Cloudify 6.x includes a Getting Started wizard, designed to simplify the first time experience of setting up the Cloudify manager.

The wizard walks the users through selecting the target infrastructures, uploading the relevant plugins, setting up the proper secrets (for access credentials), and uploading example blueprints.
The wizard appears upon login, unless opted out by the user. The admin may set this option to enabled/disabled.

PHOTO

StarlingX

PHOTO

The StarlingX plugin is introduced as part of Cloudify 6.0. The new plugin provides discovery capabilities over StarlingX based platforms, with the ability to scan central controllers for subcloud objects, retrieve all related subcloud platforms, import their details into Cloudify, and label them based on existing properties. It further allows deployment of Kubernetes/Openstack based services over the relevant platforms.

Learn more about the StarlingX plugin.

Developer Enhancements

The ‘Apply’ Command

The cfy apply command simplifies the development lifecycle by providing an easy update & testing flow in one command. It is used to install/update a deployment using Cloudify manager without having to manually go through the process of uploading a blueprint, creating a deployment, and executing a workflow.
Upon introduced changes, the apply command will either deploy & install the new blueprint if such an instance does not exist yet, or will take the existing instance and update it with the new changes.

Learn more about the apply command.

Intrinsic Functions

Cloudify v6.0 provides two new intrinsic functions allowing the blueprint developers to extract more information during deployment/runtime. get_label retrieves labels value based on its referred key, and get_environment _capability retrieves a capability from the parent environment onto which that service is being deployed.

PHOTO

Using these intrinsic functions, the developer can set services to auto retrieve environment details and seamlessly deploy itself over that environment with zero user inputs. It allows for easy placement policy over different systems with different credentials or onboarding flows, by letting the service pick up the required info automatically from the environment.

PHOTO

Learn more about the intrinsic functions.

Propagation of Workflow Parameters to Sub-components

When executing a workflow that is propagated to deployment components, The workflow parameters are propagated as well. This is true for all workflows and all workflow parameters. If such parameters do not exist they are ignored.

Blueprint Labels

Similar to the deployment labels, a developer may now assign labels blueprints, which allows for search through the blueprints by category or any criteria.

Learn more about blueprint labels.

Security & Compliance

As with every Cloudify release, security improvements are included in v6.0. All used packages have been updated to accommodate all latest security patches, and all known issues handled in all previous Cloudify patches have been resolved in v6.0.

ISO Compliance

PHOTO – CAPTION – Cloudify is ISO 27001 (Security) and ISO 27701 (Data Privacy) certified.

Maintenance

Cloudify Cluster Manager

The Cloudify cluster manager is a tool simplifying the installation and upgrade of a Cloudify management cluster. Using a configuration file, the entire installation flow and setup (SSL certificates and more) is applied automatically. Once used for the installation, all following upgrades can be applied using the cluster manager running just a few commands executed from one node to upgrade the entire cluster.
It is capable of installing fully distributed clusters (>9 nodes) and compact clusters (3 nodes) with both embedded and external Database.

Learn more about the cluster manager.

Agents

Cloudify 5.2 extends the agents OS support to include:

  • RHEL 8.x agent.
  • CentOS 8.x agent.

LDAP Authentication Improvements

LDAP properties can now be configured allowing support for non-standard user directories through customization of:

  • Base DN
  • Group DN
  • Bind format
  • User filter
  • Group member filter
  • Attributes used for first name, last name, email, group membership, and uid
    Providing admin credentials is no longer required. If credentials are configured they will be used, otherwise, the user login credentials are used to retrieve the group info.
    Learn more.

Okta IdP SSO support

Cloudify supports several methods of user authentication to the Cloudify Management Console. One of the methods is allowing Single Sign-On (SSO) experience leveraging Identity Providers (IdP).
In v5.1.2 the framework was updated to accommodate the latest changes and Okta’s latest release is now fully supported.

Learn more.

Other Improvements

v6.0 includes many medium/minor enhancements and improvements.

  • Helm plugin – add support for verify_ssl.
  • Sites map widget updated to reflect new states – Good, In progress, Requires attention.
  • Asynchronous deployment creation – starting v6.0 nodes and node instances are generated using a workflow in an asynchronous mode.
  • Performance enhancements.
    • Asynchronous blueprint upload
      • Blueprint upload to the system is now done in an asynchronous manner.
        The upload state is updated in the UI and can be queried through the CLI.
        The change is backward compatible.
    • API results caching was introduced for repeatable UI requests.
    • Index optimization was applied.
  • Deployment groups (API/CLI only) – Deployments may be grouped leveraging a filter or through manual addition, and the groups can be used for bulk actions.
  • Jenkins logging – Improved visibility to errors in Jenkins nodes.
  • White labeling and customization
    • Composer customization was added
    • String localization support was added

Deploying Cloudify 6.0

v6.0 can be deployed as a new installation only. Upgrades from 5.1.x/5.2.x will be supported with v6.1.0.

v6.0 New Installation

Download Cloudify 6.0

Manager Install:

  • RPM
  • OpenStack image – cloudify-manager-6.3.1.qcow2
  • Docker containers
    • All-in-one manager – Cloudify manager aio
    • Manager – Cloudify manager worker
    • Database – Cloudify postgresql
    • Messaging queue – Cloudify rabbitmq

Premium CLI Packages:

  • RPM (CentOS/RHEL) – Cloudify cli centos (.rpm)
  • Debian – Cloudify cli debian (.dep)
  • Windows – Cloudify cli Windows (.exe)

Support Discontinuance

Product Features

  1. Tours – The option for UI tours was removed in v6.0.
  2. Diamond Plugin – Cloudify declared the end-of-life of the Diamond plugin with the release of Cloudify v5.0, hence it is no longer supported in v6.0.
    That said, customers running Cloudify v4.6 or earlier and using the Diamond plugin via their agents should not be concerned about modifying their blueprints to remove such support when upgrading to 6.0.
    While the Diamond functionality will not be available, a stub mechanism was put in place to guarantee the successful operation of all historic blueprints.
    Cloudify strongly recommends that newly introduced blueprints will not mention the Diamond options.
  3. The PSUtil plugin is no longer supported by Cloudify starting v5.x.
  4. Cloudify Deployment Proxy functionality is declared as deprecated with Cloudify v5.x. All existing functionality will remain active and supported, however no new functionality will be added to the deployment proxy, and only critical issues will be resolved.
    Cloudify recommends using Service components and Shared resources, introduced with Cloudify v5.0, replacing and improving the deployment proxy functionality instead.

Supported Versions

Listed below are the support discontinuance dates for the recent Cloudify versions. As of these dates, the respective versions will no longer be supported under the standard Cloudify support agreement.

Version

Cloudify Premium & Community Editions v4.6.x

Cloudify Premium & Community Editions v5.0.5

Cloudify Premium & Community Editions v5.1.x

Cloudify Premium & Community Editions v5.2.x

Cloudify Premium & Community Editions v6.0.x

Support Discontinuance Date

April 17th, 2021

February 3rd, 2022

October 19th, 2022

April 5th, 2023

May 26th, 2023

comments

    Leave a Reply

    Your email address will not be published.

    Back to top