cnf_testsuite

Tool to check for and provide feedback on the use of K8s + cloud native best practices in networking applications and platforms cloud-native cnf k8s telecom testing testsuite
0.7.0-beta1 released

CNF Conformance

| Master | |---| |Build Status|

The CNF Conformance program enables interoperability of Cloud native Network Functions (CNFs) from multiple vendors running on top of Kubernetes supplied by different vendors. The goal is to provide an open source test suite to demonstrate conformance and implementation of best practices for both open and closed source Cloud native Network Functions.

The CNF Conformance Test Suite will inspect CNFs for the following characteristics:

  • Compatibility - CNFs should work with any Certified Kubernetes product and any CNI-compatible network that meet their functionality requirements.
  • Statelessness - The CNF's state should be stored in a custom resource definition or a separate database (e.g. etcd) rather than requiring local storage. The CNF should also be resilient to node failure.
  • Security - CNF containers should be isolated from one another and the host.
  • Microservice - The CNF should be developed and delivered as a microservice.
  • Scalability - CNFs should support horizontal scaling (across multiple machines) and vertical scaling (between sizes of machines).
  • Configuration and Lifecycle - The CNF's configuration and lifecycle should be managed in a declarative manner, using ConfigMaps, Operators, or other declarative interfaces.
  • Observability - CNFs should externalize their internal states in a way that supports metrics, tracing, and logging.
  • Installable and Upgradeable - CNFs should use standard, in-band deployment tools such as Helm (version 3) charts.
  • Hardware Resources and Scheduling - The CNF container should access all hardware and schedule to specific worker nodes by using a device plugin.
  • Resilience - CNFs should be resilient to failures inevitable in cloud environments. CNF Resilience should be tested to ensure CNFs are designed to deal with non-carrier-grade shared cloud HW/SW platform.

See the Conformance Test Categories Documentation for a complete overview of the tests.

Implementation overview

The CNF Conformance Test Suite leverages upstream tools such as OPA Gatekeeper, Helm linter, and Promtool for testing CNFs. The upstream tool installation, configuration and versioning has been made repeatable.

The test framework and tests (using the upstream tools) are written in the human readable, compiled language, Crystal. Common capabilities like dependencies between tests and categories are supported.

Setup of vanilla upstream K8s on Packet is done with the CNF Testbed platform tool chain, which includes k8s-infra, Kubespray. To add support for other providers, please submit a Pull Request to the CNF Testbed repo.

Installation

See the installation guide for more details on installing and running the CNF Conformance Test Suite.

Contributing

  1. Fork it (https://github.com/cncf/cnf-conformance/fork)
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create a new Pull Request

Get involved

License terms

CNF Conformance is available under the Apache 2 license.

cnf_testsuite:
  github: cncf/cnf-testsuite
  version: ~> 0.7.0-beta1
License MIT
Crystal 0.33.0

Authors

Dependencies 5

  • commander ~> 0.3.5
    {'github' => 'mrrooijen/commander', 'version' => '~> 0.3.5'}
  • halite 0.10.4
    {'github' => 'icyleaf/halite', 'version' => '0.10.4'}
  • icr master
    {'branch' => 'master', 'github' => 'crystal-community/icr'}
  • sam~vulk 117b5b2
    {'commit' => '117b5b2', 'github' => 'vulk/sam.cr'}
  • totem 0.6.0
    {'github' => 'icyleaf/totem', 'version' => '0.6.0'}

Development Dependencies 0

Dependents 0

Last synced .
search fire star recently