at Financial Technnology Year
Please contact them if you have any questions.
Features in DevOps Toolchains
for IT and Infrastructure
Integrated development and operations tools supporting continuous integration/continuous deployment (CI/CD) for rapid and reliable application delivery.
We ask vendors to mark their product against our feature list. It is not available for all products and in some cases we have derived data from publicly available sources. The list of features follows. Vendors can add a further 10 key features of their own.
CI/CD Pipeline Management
Features related to configuring, monitoring, and optimizing continuous integration and continuous deployment processes.
- Automatic Rollbacks
- Automatic rollback functionality in case of failed deployments.
- Manual Pipeline Triggers
- Option for manual approval or trigger of pipeline stages.
- Multiple Pipeline Support
- Capacity to manage multiple pipelines concurrently for different projects or branches.
- Parallel Stage Execution
- Ability to run different stages of the pipeline in parallel to reduce build times.
- Pipeline Analytics
- Analytical insights on pipeline performance and failure points.
- Pipeline Caching
- Support for caching build dependencies to speed up subsequent pipeline runs.
- Pipeline Execution Speed
- Average time required to run a complete pipeline from start to finish.
- Pipeline Logs
- Detailed logging of pipeline execution and outcomes.
- Pipeline Visualization
- Visual representation of the entire CI/CD pipeline for better understanding and management.
- Pipeline as Code
- Ability to define pipelines using source-controlled configuration files (e.g., YAML).
Collaboration and Accountability
Facilitating team collaboration and providing accountability tracking in the development process.
- Access Control Lists
- Granular permissions for resources and actions.
- Activity Feed
- Chronological feed of all relevant actions and system events.
- Audit Trails
- Immutable logs of changes, actions, and access for accountability.
- Commenting and Discussion Threads
- Inline comments and discussions within pipelines and code reviews.
- Integrated ChatOps
- Integration with chat platforms (e.g., Slack, Teams) for DevOps automation.
- Notifications and Subscriptions
- Customizable notifications via email, chat, or other channels.
- Ownership Assignment
- Ability to assign owners or responsible parties to resources/stages.
- Shared Dashboards
- Collaborative dashboards that can be shared among users or teams.
- Team/Project Organization
- Features for logically organizing users into teams or projects.
- User Activity Tracking
- Tracking individual user actions in the platform for transparency.
Infrastructure Automation
Tools and functionalities for automating infrastructure provisioning, configuration, and scaling.
- Autoscaling
- Automated resource scaling based on workload or policies.
- Change Rollback
- Ability to rollback infrastructure changes to a previous state.
- Cloud Provider Integration
- Ability to connect and manage resources across multiple cloud platforms.
- Idempotent Deployments
- Ensures repeated executions achieve the same state without errors.
- Infrastructure Provisioning Speed
- Average time taken to provision infrastructure using the tool.
- Infrastructure as Code Support
- Support for managing infrastructure using code (e.g., Terraform, CloudFormation).
- Multi-Environment Support
- Manage infrastructure across different environments (dev, QA, prod).
- Orchestration Tools Integration
- Support for integration with tools like Kubernetes, Ansible, Chef, Puppet, etc.
- Policy as Code
- Enforce compliance and security policies through code.
- Resource Inventory Management
- Detailed inventory tracking of deployed resources.
Integration and Extensibility
Ease of integrating with other tools, APIs, and customization through plugins or scripts.
- API Access
- Comprehensive APIs for automating and customizing workflows.
- CLI Tooling
- Availability of command-line tools for scripting and automation.
- Custom Script Support
- Ability to run custom scripts at various pipeline stages.
- Custom UI Widgets
- Ability to extend/modify interface with custom UI components.
- Event Hooks
- Configurability of actions triggered by custom events or pipeline states.
- Event-Driven Workflows
- Support for triggering pipelines and integrations based on external events.
- Integrations Library
- Pre-built connectors/integrations with popular DevOps and IT tools.
- Plugin Marketplace
- Availability of a marketplace for third-party integrations and plugins.
- RESTful API Coverage
- Proportion of functionality exposed via REST API.
- Support for Multiple Programming Languages
- Compatibility with different languages and build tools.
Monitoring, Logging, and Alerting
Integrated observability tools for monitoring system health, collecting logs, and configuring alerts.
- Alert Escalation Policies
- Configurable escalation chains for unresolved alerts.
- Anomaly Detection
- Automatic identification of unusual patterns or behaviors.
- Automated Alerting
- Customizable alerts triggered by events or thresholds.
- Custom Metrics Collection
- Support for user-defined metrics tracking.
- Incident Tracking
- Integrated tools for creating and managing incidents.
- Log Aggregation
- Centralized collection and search of application/infrastructure logs.
- Log Retention Period
- Maximum duration logs are retained.
- Metrics Dashboard
- Customizable visual dashboards for system/application metrics.
- Real-Time Monitoring
- Live health/status monitoring of all relevant services.
- Third-Party Monitoring Integration
- Compatible with external monitoring platforms (e.g., Datadog, Prometheus).
Performance and Scalability
Capabilities ensuring that the toolchain can handle increasing workloads and remain performant.
- Concurrent Builds/Deployments
- Maximum number of concurrent build or deployment jobs supported.
- Disaster Recovery Support
- Built-in disaster recovery and failover mechanisms.
- Elastic Scaling Policies
- Configuration of scaling policies based on real-time metrics.
- Geographically Distributed Deployments
- Support for deployment across different regions or data centers.
- High-Availability Architecture
- Designed for minimal downtime and fault-tolerance.
- Horizontal Scalability
- Ability to increase capacity by adding more nodes/instances.
- Job Queue Length Limit
- Maximum number of jobs allowed in the queue.
- Latency
- Typical response time for key user operations.
- Resource Auto-Allocation
- Automatic allocation of computational resources as needed.
- Self-Healing Systems
- Automated remediation of common failures or disruptions.
Security and Compliance
Features to ensure the security of pipelines, infrastructure, code, and data integrity, including regulatory compliance.
- Audit Logs
- Detailed event logs for security and compliance auditing.
- Compliance Benchmarking
- Automated checking of infrastructure against compliance frameworks (e.g., CIS benchmarks).
- Compliance Reports
- Ability to generate standardized compliance reports (e.g., SOC2, PCI).
- Credential Rotation
- Automated scheduled rotation of credentials.
- Encrypted Communications
- Encryption for data in transit and at rest.
- Policy Enforcement
- Enforcement of security policies at every stage.
- Role-Based Access Control
- Support for defining roles and permissions at granular levels.
- Secrets Management
- Built-in tools or integrations for handling and storing secrets securely.
- Two-Factor Authentication
- 2FA/MFA support for console and API access.
- Vulnerability Scanning
- Automated scanning for code, dependencies, or container vulnerabilities.
Testing and Quality Assurance
Support for integrating and automating various test suites to ensure code quality and reliability.
- Automated Unit Testing
- Built-in support for running automated unit tests.
- Integration Test Support
- Ability to run integration tests as part of the pipeline.
- Manual Testing Support
- Features to facilitate and document manual QA processes.
- Parallel Test Execution
- Ability to execute multiple test suites in parallel.
- Performance/Load Testing Integration
- Capability to execute and analyze performance/load tests.
- Pre-Production Environment Simulation
- Environments closely replicating production for QA/testing.
- Static Analysis Integration
- Integration with static code analysis/security tools.
- Test Coverage Analysis
- Calculation and display of code test coverage metrics.
- Test Data Management
- Tools to create, manage, and anonymize test datasets.
- Test Result Reporting
- Detailed, accessible reports and dashboards for test runs.
Usability and Support
Features improving ease of use, access, and availability of technical assistance.
- Accessibility Compliance
- Conforms to accessibility standards (e.g., WCAG, ADA).
- Community Support
- Active user community, forums, and third-party resources.
- Comprehensive Documentation
- Extensive online guides, reference manuals, and tutorials.
- Customer Support Availability
- Level of customer support provided (hours per day/week).
- In-Product Help System
- Contextual help, support links, and guided tours.
- Intuitive User Interface
- Clean, well-designed UI with helpful hints/tooltips.
- Multi-Language UI
- User interface available in multiple languages.
- Onboarding Workflow
- Step-by-step onboarding, setup wizards, and sample configurations.
- Product Training Programs
- Formal training, certifications, or workshops offered.
- Role-Based Dashboards
- Custom dashboards depending on user roles (developer, admin, etc.).
Version Control Integration
Capabilities related to seamless interaction with repositories and version control systems.
- Access Control per Repo
- Granular access and permission control for each repository.
- Branch Management
- Advanced branch and merge management features.
- Code Review Integration
- Built-in or integrated code review workflow support.
- Commit Triggered Pipelines
- Automatic pipeline initiation upon code commits or pull requests.
- Multi-VCS Support
- Integration with multiple version control systems like Git, SVN, Mercurial, etc.
- Pull Request Automation
- Support for automations on pull/merge requests (e.g., auto-merge, status checks).
- Repo Size Limit
- Maximum repository size supported.
- Tag & Release Management
- Comprehensive tagging and release creation features.
- Webhooks
- Support for webhooks to integrate repository events with external systems.