Jul 27 19:23:39.013046 ip-10-0-136-113 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 27 19:23:39.013056 ip-10-0-136-113 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 27 19:23:39.013063 ip-10-0-136-113 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 27 19:23:39.013271 ip-10-0-136-113 systemd[1]: Failed to start Kubernetes Kubelet. Jul 27 19:23:49.204318 ip-10-0-136-113 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 27 19:23:49.204342 ip-10-0-136-113 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c89126fe5a5345b4966109a6ec2b8455 -- Jul 27 19:25:42.071854 ip-10-0-136-113 systemd[1]: Starting Kubernetes Kubelet... Jul 27 19:25:42.443479 ip-10-0-136-113 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 19:25:42.443479 ip-10-0-136-113 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 19:25:42.443479 ip-10-0-136-113 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 19:25:42.443479 ip-10-0-136-113 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 19:25:42.443479 ip-10-0-136-113 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 19:25:42.444128 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.443536 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 19:25:42.447462 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447446 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 19:25:42.447462 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447462 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447466 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447469 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447472 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447475 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447478 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447481 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447484 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447486 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447489 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447491 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447499 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447502 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447504 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447507 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447509 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447512 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447514 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447517 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447519 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 19:25:42.447528 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447522 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447526 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447530 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447534 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447538 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447541 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447543 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447546 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447548 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447551 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447554 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447556 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447558 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447561 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447563 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447566 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447568 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447570 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447573 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 19:25:42.448007 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447575 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447590 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447593 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447601 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447604 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447606 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447608 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447611 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447613 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447615 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447618 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447620 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447622 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447625 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447628 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447631 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447634 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447637 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447639 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447642 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 19:25:42.448448 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447644 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447647 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447650 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447652 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447655 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447657 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447659 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447662 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447664 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447667 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447669 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447672 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447674 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447676 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447679 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447682 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447685 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447688 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447690 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447693 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 19:25:42.448952 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447695 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447698 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447700 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447703 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447705 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447708 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447710 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447715 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447718 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447721 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447724 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447726 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447729 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447732 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447734 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447737 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447739 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447742 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 19:25:42.449416 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.447744 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 19:25:42.450627 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450615 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 19:25:42.450627 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450626 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450629 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450633 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450636 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450639 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450642 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450645 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450647 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450650 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450661 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450665 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450668 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450671 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450674 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450677 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450680 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450683 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450686 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450688 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450692 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 19:25:42.450685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450695 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450698 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450701 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450703 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450706 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450708 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450712 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450716 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450719 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450721 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450724 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450727 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450729 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450731 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450734 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450736 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450739 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450741 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450743 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450746 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 19:25:42.451158 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450748 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450750 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450755 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450758 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450760 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450763 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450765 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450769 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450772 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450775 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450778 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450780 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450783 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450787 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450789 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450793 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450796 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450799 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450802 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 19:25:42.451649 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450804 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450807 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450810 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450813 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450815 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450817 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450820 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450822 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450824 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450827 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450829 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450832 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450834 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450837 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450839 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450842 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450844 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450847 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450850 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450853 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 19:25:42.452088 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450856 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450858 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450861 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450865 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450868 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450871 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450873 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450876 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450878 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450881 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450883 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450886 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450888 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450891 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450893 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450896 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450898 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450901 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.450904 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451256 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 19:25:42.452569 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451261 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451263 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451266 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451269 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451271 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451274 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451277 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451279 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451282 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451285 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451287 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451291 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451294 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451297 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451300 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451305 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451308 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451311 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451315 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 19:25:42.453076 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451318 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451320 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451323 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451325 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451328 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451330 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451332 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451335 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451337 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451339 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451342 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451344 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451347 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451349 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451352 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451355 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451357 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451360 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451362 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451364 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 19:25:42.453524 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451367 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451370 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451373 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451375 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451379 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451382 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451385 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451388 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451392 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451394 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451396 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451399 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451402 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451405 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451408 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451411 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451414 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451416 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451418 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 19:25:42.454041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451421 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451423 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451426 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451428 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451431 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451433 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451435 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451437 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451440 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451442 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451445 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451447 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451451 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451453 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451456 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451458 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451461 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451463 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451465 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 19:25:42.454485 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451468 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451470 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451474 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451476 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451479 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451481 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451484 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451486 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451488 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451491 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451493 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451496 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451498 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451500 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451502 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451505 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451507 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451510 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451512 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451514 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 19:25:42.454938 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.451517 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451595 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451602 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451608 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451612 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451618 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451621 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451625 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451629 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451632 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451635 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451638 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451642 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451644 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451649 2584 flags.go:64] FLAG: --cgroup-root="" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451652 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451655 2584 flags.go:64] FLAG: --client-ca-file="" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451658 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451661 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451665 2584 flags.go:64] FLAG: --cluster-domain="" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451668 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451671 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451673 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451677 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 19:25:42.455427 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451680 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451683 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451686 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451688 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451691 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451694 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451697 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451700 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451702 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451708 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451711 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451714 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451716 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451721 2584 flags.go:64] FLAG: --enable-server="true" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451724 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451728 2584 flags.go:64] FLAG: --event-burst="100" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451731 2584 flags.go:64] FLAG: --event-qps="50" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451734 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451736 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451740 2584 flags.go:64] FLAG: --eviction-hard="" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451743 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451746 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451749 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451752 2584 flags.go:64] FLAG: --eviction-soft="" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451755 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 19:25:42.456017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451757 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451760 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451763 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451765 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451768 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451771 2584 flags.go:64] FLAG: --feature-gates="" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451774 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451777 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451780 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451783 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451786 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451788 2584 flags.go:64] FLAG: --help="false" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451791 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451794 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451797 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451799 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451802 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451806 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451808 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451811 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451815 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451817 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451820 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451823 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 19:25:42.456774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451826 2584 flags.go:64] FLAG: --kube-reserved="" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451829 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451832 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451835 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451838 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451841 2584 flags.go:64] FLAG: --lock-file="" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451843 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451846 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451849 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451854 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451857 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451859 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451862 2584 flags.go:64] FLAG: --logging-format="text" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451864 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451867 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451870 2584 flags.go:64] FLAG: --manifest-url="" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451873 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451877 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451879 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451883 2584 flags.go:64] FLAG: --max-pods="110" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451886 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451889 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451892 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451895 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451898 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 19:25:42.457337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451901 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451903 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451910 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451914 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451917 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451920 2584 flags.go:64] FLAG: --pod-cidr="" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451922 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451927 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451929 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451932 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451935 2584 flags.go:64] FLAG: --port="10250" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451939 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451941 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d9fb5d4a6344fc3" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451944 2584 flags.go:64] FLAG: --qos-reserved="" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451947 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451950 2584 flags.go:64] FLAG: --register-node="true" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451952 2584 flags.go:64] FLAG: --register-with-taints="" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451955 2584 flags.go:64] FLAG: --registry-burst="10" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451958 2584 flags.go:64] FLAG: --registry-qps="5" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451960 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451963 2584 flags.go:64] FLAG: --reserved-memory="" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451966 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451969 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451971 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451974 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 19:25:42.457928 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451976 2584 flags.go:64] FLAG: --runonce="false" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451979 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451981 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451984 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451988 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451990 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451993 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451995 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.451998 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452001 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452004 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452007 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452010 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452013 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452015 2584 flags.go:64] FLAG: --system-cgroups="" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452018 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452023 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452025 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452028 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452036 2584 flags.go:64] FLAG: --tls-min-version="" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452039 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452041 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452044 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452046 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452049 2584 flags.go:64] FLAG: --v="2" Jul 27 19:25:42.458665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452057 2584 flags.go:64] FLAG: --version="false" Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452061 2584 flags.go:64] FLAG: --vmodule="" Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452066 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.452070 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452187 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452192 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452194 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452197 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452199 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452202 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452204 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452207 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452209 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452211 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452214 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452216 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452218 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452222 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452225 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452227 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 19:25:42.459674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452230 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452232 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452234 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452238 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452240 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452243 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452246 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452251 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452253 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452255 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452258 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452260 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452263 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452265 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452267 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452271 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452274 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452277 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452280 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452282 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 19:25:42.460181 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452285 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452287 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452290 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452292 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452295 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452297 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452300 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452302 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452305 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452309 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452311 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452313 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452316 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452318 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452320 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452324 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452327 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452329 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452331 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452334 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 19:25:42.460685 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452336 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452339 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452342 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452346 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452349 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452351 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452354 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452356 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452359 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452362 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452364 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452367 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452370 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452372 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452375 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452377 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452380 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452382 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452385 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 19:25:42.461153 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452387 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452390 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452394 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452396 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452399 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452402 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452404 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452407 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452410 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452413 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452415 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452417 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452420 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452423 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452428 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452430 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452433 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452435 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452438 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 19:25:42.461705 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452440 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452442 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452445 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452447 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.452449 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.453015 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.460416 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.460431 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.460450 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.460456 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460511 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460517 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460521 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460524 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 19:25:42.462154 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460527 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460530 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460533 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460535 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460538 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460541 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460543 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460546 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460548 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460550 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460553 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460555 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460558 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460561 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460563 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460566 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460569 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460571 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460573 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 19:25:42.462495 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460576 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460594 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460599 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460603 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460605 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460616 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460620 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460623 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460625 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460628 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460631 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460634 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460636 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460638 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460641 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460643 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460646 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460648 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460651 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 19:25:42.462943 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460653 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460656 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460658 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460660 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460663 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460665 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460668 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460671 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460673 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460676 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460678 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460681 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460683 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460686 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460689 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460691 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460693 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460696 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460698 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 19:25:42.463424 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460701 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460704 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460706 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460709 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460711 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460713 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460716 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460718 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460720 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460722 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460725 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460727 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460730 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460732 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460734 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460737 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460740 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460743 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460746 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460749 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 19:25:42.463914 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460751 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460753 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460756 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460759 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460761 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460764 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460766 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460769 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460771 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460774 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460776 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460778 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460781 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460784 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460786 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460789 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460791 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 19:25:42.464368 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460793 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.460798 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460908 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460913 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460916 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460919 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460922 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460925 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460927 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460930 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460932 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460935 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460937 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460940 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460943 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 19:25:42.464826 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460946 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460949 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460952 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460954 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460957 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460976 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460979 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460982 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460984 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460987 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460989 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460992 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460994 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.460997 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461000 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461002 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461004 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461007 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461009 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461012 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 19:25:42.465185 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461014 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461016 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461019 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461021 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461023 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461026 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461028 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461030 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461033 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461035 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461038 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461041 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461044 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461047 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461049 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461052 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461054 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461057 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461059 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 19:25:42.465674 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461061 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461065 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461069 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461071 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461074 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461077 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461080 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461082 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461085 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461088 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461090 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461093 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461095 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461097 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461099 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461102 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461104 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461106 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461108 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461111 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 19:25:42.466104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461113 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461116 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461118 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461120 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461124 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461127 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461132 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461135 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461138 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461141 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461144 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461146 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461149 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461151 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461154 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461157 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461160 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461162 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461165 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 19:25:42.466567 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461168 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461170 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461173 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461176 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461178 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461181 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461183 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:42.461185 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.461189 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.461288 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.463249 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.464367 2584 server.go:1019] "Starting client certificate rotation" Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.464460 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 19:25:42.467041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.464497 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 19:25:42.467350 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.466694 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 19:25:42.467821 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.467805 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 19:25:42.475266 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.475250 2584 log.go:25] "Validated CRI v1 runtime API" Jul 27 19:25:42.478548 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.478533 2584 log.go:25] "Validated CRI v1 image API" Jul 27 19:25:42.480074 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.480060 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 19:25:42.482295 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.482273 2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af546bb5-020d-45c6-b68a-0088a3f359bf:/dev/nvme0n1p4 e02ca034-c107-4c7e-9b16-7b469038bf5b:/dev/nvme0n1p3] Jul 27 19:25:42.482371 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.482290 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 19:25:42.488824 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.488700 2584 manager.go:216] Machine: {Timestamp:2026-07-27 19:25:42.487370665 +0000 UTC m=+0.306623291 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204328 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2242d3e21ffb2102d4bfd35a0881a2 SystemUUID:ec2242d3-e21f-fb21-02d4-bfd35a0881a2 BootID:c89126fe-5a53-45b4-9661-09a6ec2b8455 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3a:16:ff:d7:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3a:16:ff:d7:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:41:9d:f4:e2:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 19:25:42.488824 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.488821 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 19:25:42.488933 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.488899 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 19:25:42.489532 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.489518 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 19:25:42.491477 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.491455 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 19:25:42.491626 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.491480 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 19:25:42.492078 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.492068 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 19:25:42.492113 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.492080 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 19:25:42.492113 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.492088 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 19:25:42.492625 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.492614 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 19:25:42.493622 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.493612 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 19:25:42.495927 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.495916 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 27 19:25:42.496036 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.496027 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 19:25:42.496064 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.496054 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 27 19:25:42.496098 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.496065 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 19:25:42.496098 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.496082 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 19:25:42.496098 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.496090 2584 kubelet.go:398] "Adding apiserver pod source" Jul 27 19:25:42.496098 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.496098 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 19:25:42.497839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.497790 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 19:25:42.497921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.497851 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 19:25:42.500320 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.500302 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 19:25:42.501782 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.501769 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 19:25:42.501833 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.501800 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 19:25:42.502478 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502468 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 19:25:42.502507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502483 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 19:25:42.502507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502489 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 19:25:42.502507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502495 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 19:25:42.502507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502502 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 19:25:42.502507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502507 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 19:25:42.502677 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502540 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 19:25:42.502677 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502545 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 19:25:42.502677 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502553 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 19:25:42.502677 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502558 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 19:25:42.502677 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502565 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 19:25:42.502677 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.502572 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 19:25:42.503446 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.503435 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 19:25:42.503481 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.503446 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 19:25:42.506812 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.506797 2584 server.go:1268] "Started kubelet" Jul 27 19:25:42.506915 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.506888 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 19:25:42.506988 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.506880 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 19:25:42.507043 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.507032 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 19:25:42.507720 ip-10-0-136-113 systemd[1]: Started Kubernetes Kubelet. Jul 27 19:25:42.507961 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.507940 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 19:25:42.508130 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.508107 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 19:25:42.508284 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.508194 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 19:25:42.509361 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.509345 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 27 19:25:42.510536 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.510510 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 19:25:42.511206 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.511191 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 19:25:42.511925 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.511002 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-113.ec2.internal.18c63c102f204731 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-113.ec2.internal,UID:ip-10-0-136-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-113.ec2.internal,},FirstTimestamp:2026-07-27 19:25:42.506768177 +0000 UTC m=+0.326020803,LastTimestamp:2026-07-27 19:25:42.506768177 +0000 UTC m=+0.326020803,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-113.ec2.internal,}" Jul 27 19:25:42.515868 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.515853 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tfscl" Jul 27 19:25:42.516226 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516215 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 19:25:42.516318 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516296 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 19:25:42.516477 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.516451 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:42.516813 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516795 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 19:25:42.516900 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516865 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 19:25:42.516900 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516880 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 19:25:42.516995 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516955 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 27 19:25:42.516995 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.516961 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 27 19:25:42.517063 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517032 2584 factory.go:55] Registering systemd factory Jul 27 19:25:42.517063 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517047 2584 factory.go:223] Registration of the systemd container factory successfully Jul 27 19:25:42.517289 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517272 2584 factory.go:153] Registering CRI-O factory Jul 27 19:25:42.517289 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517289 2584 factory.go:223] Registration of the crio container factory successfully Jul 27 19:25:42.517385 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517339 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 19:25:42.517385 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517360 2584 factory.go:103] Registering Raw factory Jul 27 19:25:42.517385 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517374 2584 manager.go:1196] Started watching for new ooms in manager Jul 27 19:25:42.517915 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.517902 2584 manager.go:349] Starting recovery of all containers Jul 27 19:25:42.518186 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.518130 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 19:25:42.518448 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.518425 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 19:25:42.522933 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.522908 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tfscl" Jul 27 19:25:42.529685 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.529523 2584 manager.go:354] Recovery completed Jul 27 19:25:42.531259 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.530914 2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 27 19:25:42.533886 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.533874 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.535723 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.535708 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.535806 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.535737 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.535806 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.535752 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.536276 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536262 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 19:25:42.536276 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536272 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.536372 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536275 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 19:25:42.536372 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536303 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 27 19:25:42.536913 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536898 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.536993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536927 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.536993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.536941 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.537180 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.537167 2584 policy_none.go:49] "None policy: Start" Jul 27 19:25:42.537231 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.537184 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 19:25:42.537231 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.537194 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 19:25:42.537940 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.537930 2584 policy_none.go:47] "Start" Jul 27 19:25:42.582168 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582151 2584 manager.go:337] "Starting Device Plugin manager" Jul 27 19:25:42.582260 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.582180 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 19:25:42.582260 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582191 2584 server.go:87] "Starting device plugin registration server" Jul 27 19:25:42.582451 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582435 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 19:25:42.582546 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582450 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 19:25:42.582546 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582531 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 19:25:42.582748 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582716 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 19:25:42.582748 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.582726 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 19:25:42.583156 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.583140 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 19:25:42.583209 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.583181 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:42.649259 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.649232 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 19:25:42.650507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.650485 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 19:25:42.650611 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.650521 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 19:25:42.650611 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.650540 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 19:25:42.650611 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.650573 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 19:25:42.653002 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.652985 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 19:25:42.682852 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.682835 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.683569 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.683555 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.683665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.683600 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.683665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.683614 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.683665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.683634 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.692506 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.692492 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.692553 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.692513 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-113.ec2.internal\": node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:42.709003 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.708955 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:42.751000 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.750977 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal"] Jul 27 19:25:42.751080 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.751030 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.752393 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.752377 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.752466 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.752408 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.752466 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.752418 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.753563 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.753550 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.753667 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.753655 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.753712 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.753680 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.754284 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.754260 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.754363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.754292 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.754363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.754304 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.754363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.754272 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.754363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.754355 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.754363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.754364 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.755301 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.755288 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.755368 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.755310 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 19:25:42.756009 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.755993 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientMemory" Jul 27 19:25:42.756102 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.756021 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 19:25:42.756102 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.756035 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeHasSufficientPID" Jul 27 19:25:42.770110 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.770092 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-113.ec2.internal\" not found" node="ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.773885 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.773870 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-113.ec2.internal\" not found" node="ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.809851 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.809830 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:42.819164 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.819144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b21792b782558305c8012893bc9790e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-113.ec2.internal\" (UID: \"1b21792b782558305c8012893bc9790e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.819254 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.819170 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c0ea14aaf4d4e2f37195236b9f9e25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal\" (UID: \"1c0ea14aaf4d4e2f37195236b9f9e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.819254 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.819189 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c0ea14aaf4d4e2f37195236b9f9e25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal\" (UID: \"1c0ea14aaf4d4e2f37195236b9f9e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.910241 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:42.910220 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:42.919555 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.919526 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c0ea14aaf4d4e2f37195236b9f9e25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal\" (UID: \"1c0ea14aaf4d4e2f37195236b9f9e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.919633 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.919560 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c0ea14aaf4d4e2f37195236b9f9e25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal\" (UID: \"1c0ea14aaf4d4e2f37195236b9f9e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.919633 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.919600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b21792b782558305c8012893bc9790e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-113.ec2.internal\" (UID: \"1b21792b782558305c8012893bc9790e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.919633 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.919618 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1c0ea14aaf4d4e2f37195236b9f9e25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal\" (UID: \"1c0ea14aaf4d4e2f37195236b9f9e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.919720 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.919633 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c0ea14aaf4d4e2f37195236b9f9e25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal\" (UID: \"1c0ea14aaf4d4e2f37195236b9f9e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:42.919720 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:42.919626 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1b21792b782558305c8012893bc9790e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-113.ec2.internal\" (UID: \"1b21792b782558305c8012893bc9790e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" Jul 27 19:25:43.011173 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:43.011121 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:43.072591 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.072548 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:43.077509 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.077493 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" Jul 27 19:25:43.111213 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:43.111185 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:43.211651 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:43.211621 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:43.312207 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:43.312145 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:43.412655 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:43.412623 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:43.464159 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.464126 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 19:25:43.464533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.464267 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 19:25:43.506030 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.506009 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 19:25:43.513157 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:43.513137 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-113.ec2.internal\" not found" Jul 27 19:25:43.526895 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.526867 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 19:20:43 +0000 UTC" deadline="2028-04-20 01:51:08.981909344 +0000 UTC" Jul 27 19:25:43.526895 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.526890 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15174h25m25.455022073s" Jul 27 19:25:43.602027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.600753 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 19:25:43.617171 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.617146 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" Jul 27 19:25:43.629673 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.629656 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 19:25:43.631259 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.631246 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" Jul 27 19:25:43.640769 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.640747 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 19:25:43.644228 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:43.644194 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b21792b782558305c8012893bc9790e.slice/crio-a3673d91b0ba10974c78535baca08335deb6fe8aa37ba28bf5bcd47fc3ee5f58 WatchSource:0}: Error finding container a3673d91b0ba10974c78535baca08335deb6fe8aa37ba28bf5bcd47fc3ee5f58: Status 404 returned error can't find the container with id a3673d91b0ba10974c78535baca08335deb6fe8aa37ba28bf5bcd47fc3ee5f58 Jul 27 19:25:43.644811 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:43.644790 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0ea14aaf4d4e2f37195236b9f9e25f.slice/crio-0651df5f3a38528bd4a75c9a7cd085b524edb0ecd8b463afc22b4b410529437e WatchSource:0}: Error finding container 0651df5f3a38528bd4a75c9a7cd085b524edb0ecd8b463afc22b4b410529437e: Status 404 returned error can't find the container with id 0651df5f3a38528bd4a75c9a7cd085b524edb0ecd8b463afc22b4b410529437e Jul 27 19:25:43.649328 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.649314 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 19:25:43.653494 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.653456 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" event={"ID":"1c0ea14aaf4d4e2f37195236b9f9e25f","Type":"ContainerStarted","Data":"0651df5f3a38528bd4a75c9a7cd085b524edb0ecd8b463afc22b4b410529437e"} Jul 27 19:25:43.654535 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.654518 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" event={"ID":"1b21792b782558305c8012893bc9790e","Type":"ContainerStarted","Data":"a3673d91b0ba10974c78535baca08335deb6fe8aa37ba28bf5bcd47fc3ee5f58"} Jul 27 19:25:43.709730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:43.709711 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 19:25:44.436608 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.436574 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 19:25:44.497548 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.497515 2584 apiserver.go:52] "Watching apiserver" Jul 27 19:25:44.507287 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.507256 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 19:25:44.507700 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.507669 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-wkm2t","kube-system/konnectivity-agent-m4z6w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh","openshift-dns/node-resolver-x7k4j","openshift-multus/multus-additional-cni-plugins-vdgkx","openshift-multus/multus-cmdr6","openshift-network-diagnostics/network-check-target-t4gbd","openshift-ovn-kubernetes/ovnkube-node-vwtcx","kube-system/global-pull-secret-syncer-4rj6l","kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4kl4c","openshift-image-registry/node-ca-8v285","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal","openshift-multus/network-metrics-daemon-c9sj9"] Jul 27 19:25:44.510702 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.510660 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:44.510810 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.510759 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:44.513019 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.512991 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.517489 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.517468 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.517596 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.517543 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lqbgk\"" Jul 27 19:25:44.517733 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.517713 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.517845 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.517736 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.518134 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.518118 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 19:25:44.518877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.518863 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.520033 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.520016 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.520451 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.520432 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.520560 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.520542 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.521699 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.521724 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qtkg7\"" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.521976 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x95fj\"" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.522168 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.522340 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.522713 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.523182 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.523115 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jnpg\"" Jul 27 19:25:44.523558 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.523384 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 19:25:44.523558 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.523402 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.523742 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.523722 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.523847 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.523830 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 19:25:44.524947 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.524832 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 19:25:44.526809 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.526785 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 19:25:44.526809 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.526785 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-956lq\"" Jul 27 19:25:44.526963 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.526902 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.527046 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.527021 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:44.529293 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529269 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysctl-d\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529390 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529301 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-host\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529390 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529318 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhbgw\" (UniqueName: \"kubernetes.io/projected/b24d741d-f083-4762-af81-d83322a782c6-kube-api-access-hhbgw\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529390 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.529390 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529350 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq4r4\" (UniqueName: \"kubernetes.io/projected/f71941dc-722c-451d-8eae-93421d8f2d26-kube-api-access-nq4r4\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.529390 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529364 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-hosts-file\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.529390 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529380 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hj2\" (UniqueName: \"kubernetes.io/projected/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-kube-api-access-v5hj2\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529398 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-system-cni-dir\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529420 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-kubernetes\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529456 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysctl-conf\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529470 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b24d741d-f083-4762-af81-d83322a782c6-tmp\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529484 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529507 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529533 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529549 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysconfig\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529563 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529584 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-sys-fs\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529606 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-systemd\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529644 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-sys\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529666 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-lib-modules\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529700 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b24d741d-f083-4762-af81-d83322a782c6-etc-tuned\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.529746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529727 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-registration-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzlc6\" (UniqueName: \"kubernetes.io/projected/03661298-acdd-469e-b8fc-830b18b39439-kube-api-access-xzlc6\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-modprobe-d\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529805 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-run\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-socket-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-device-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529852 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-tmp-dir\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529867 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-cnibin\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529888 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-os-release\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529906 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-var-lib-kubelet\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.530309 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.529921 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.530701 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.530371 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:44.530701 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.530434 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:44.532001 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.531981 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.533596 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.533352 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 19:25:44.535260 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.535241 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-424sf\"" Jul 27 19:25:44.535549 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.535533 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 19:25:44.535694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.535651 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 19:25:44.535798 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.535724 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.537698 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.537678 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.539528 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.539505 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.539933 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.539912 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.540735 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.540713 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-r29b5\"" Jul 27 19:25:44.540994 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.540973 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 19:25:44.541202 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.541186 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 19:25:44.541386 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.541370 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.541602 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.541586 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 19:25:44.541848 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.541828 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 19:25:44.542044 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.542026 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.542485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.542468 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.542871 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.542824 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 19:25:44.542871 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.542867 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 19:25:44.543023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.542949 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rd8fr\"" Jul 27 19:25:44.543023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.542973 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 19:25:44.543300 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.543158 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xgw9f\"" Jul 27 19:25:44.543406 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.543316 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 19:25:44.560833 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.560802 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jg96z" Jul 27 19:25:44.586414 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.586388 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jg96z" Jul 27 19:25:44.617673 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.617622 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 19:25:44.630752 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630723 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknwf\" (UniqueName: \"kubernetes.io/projected/dd1b71ac-b1ae-47f8-974d-33a86d358c30-kube-api-access-dknwf\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.630752 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630755 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd79f2-9940-40f6-89b1-4677150981e5-konnectivity-ca\") pod \"konnectivity-agent-m4z6w\" (UID: \"f7cd79f2-9940-40f6-89b1-4677150981e5\") " pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.630926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630780 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-run-ovn-kubernetes\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.630926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630835 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysctl-d\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.630926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630888 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhbgw\" (UniqueName: \"kubernetes.io/projected/b24d741d-f083-4762-af81-d83322a782c6-kube-api-access-hhbgw\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.630926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630919 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ff3a55d-1bb0-45de-a8b7-730509df76ab-cni-binary-copy\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631081 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630946 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq4r4\" (UniqueName: \"kubernetes.io/projected/f71941dc-722c-451d-8eae-93421d8f2d26-kube-api-access-nq4r4\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.631081 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.630991 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-hosts-file\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.631081 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631015 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hj2\" (UniqueName: \"kubernetes.io/projected/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-kube-api-access-v5hj2\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.631081 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631038 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysctl-d\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631081 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631039 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.631326 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631160 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-conf-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631326 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631180 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q78dg\" (UniqueName: \"kubernetes.io/projected/3ff3a55d-1bb0-45de-a8b7-730509df76ab-kube-api-access-q78dg\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631326 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:44.631326 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631227 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gvzn\" (UniqueName: \"kubernetes.io/projected/3a0328b5-c52a-438e-a301-6c23bbac4a90-kube-api-access-2gvzn\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:44.631326 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631271 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b24d741d-f083-4762-af81-d83322a782c6-tmp\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631339 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-cni-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631390 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-daemon-config\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631409 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-etc-kubernetes\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631423 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-kubelet\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631438 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631459 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-env-overrides\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631482 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysconfig\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631508 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-cni-multus\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631536 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-ovn\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-cni-binary-copy\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vbql\" (UniqueName: \"kubernetes.io/projected/275ca8c0-e814-498c-bcaa-36fa1cf06adb-kube-api-access-9vbql\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631689 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-systemd\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631713 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-sys\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631732 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-lib-modules\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631747 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b24d741d-f083-4762-af81-d83322a782c6-etc-tuned\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631762 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-registration-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzlc6\" (UniqueName: \"kubernetes.io/projected/03661298-acdd-469e-b8fc-830b18b39439-kube-api-access-xzlc6\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-os-release\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631826 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-cni-bin\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631862 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-modprobe-d\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.631877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631883 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-run\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631909 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-cnibin\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631921 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631989 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-os-release\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632041 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-systemd\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632083 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-sys\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632195 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-lib-modules\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632272 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-cnibin\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632297 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-run\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632336 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-registration-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632348 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-modprobe-d\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632450 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.631928 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-os-release\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632560 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysconfig\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632596 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-kubelet\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632627 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-multus-certs\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632629 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-hosts-file\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632677 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f37b558-ccba-4fd8-8470-43dd2024e5f4-dbus\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632705 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7cd79f2-9940-40f6-89b1-4677150981e5-agent-certs\") pod \"konnectivity-agent-m4z6w\" (UID: \"f7cd79f2-9940-40f6-89b1-4677150981e5\") " pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632742 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-var-lib-kubelet\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632802 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-var-lib-kubelet\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632820 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632863 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd1b71ac-b1ae-47f8-974d-33a86d358c30-iptables-alerter-script\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632893 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-slash\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632917 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-run-netns\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632944 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-etc-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.632972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632966 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-cni-netd\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.632985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovn-node-metrics-cert\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-host\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633029 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-system-cni-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-k8s-cni-cncf-io\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633069 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633072 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-host\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovnkube-script-lib\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275ca8c0-e814-498c-bcaa-36fa1cf06adb-host\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633141 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275ca8c0-e814-498c-bcaa-36fa1cf06adb-serviceca\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633174 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-system-cni-dir\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633229 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-cnibin\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633254 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-systemd\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633269 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-etc-selinux\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633277 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-node-log\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633303 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnstt\" (UniqueName: \"kubernetes.io/projected/dd381359-11ca-4c1a-8f9e-4f555dbeecad-kube-api-access-hnstt\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.633694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633330 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-kubernetes\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-system-cni-dir\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633356 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysctl-conf\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633392 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633422 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd1b71ac-b1ae-47f8-974d-33a86d358c30-host-slash\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633440 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-sysctl-conf\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633435 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b24d741d-f083-4762-af81-d83322a782c6-etc-kubernetes\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633447 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-cni-bin\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633498 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovnkube-config\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633527 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633554 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-systemd-units\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633615 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633647 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-sys-fs\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-socket-dir-parent\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633698 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633715 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-socket-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633740 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-device-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633764 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-tmp-dir\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633778 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-sys-fs\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633787 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-netns\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633813 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-var-lib-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633833 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-device-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633837 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-log-socket\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633898 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633902 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03661298-acdd-469e-b8fc-830b18b39439-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-hostroot\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633956 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f71941dc-722c-451d-8eae-93421d8f2d26-socket-dir\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.633957 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f37b558-ccba-4fd8-8470-43dd2024e5f4-kubelet-config\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.634039 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-tmp-dir\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.634965 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.634077 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03661298-acdd-469e-b8fc-830b18b39439-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.635535 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.635514 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b24d741d-f083-4762-af81-d83322a782c6-tmp\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.636025 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.636006 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b24d741d-f083-4762-af81-d83322a782c6-etc-tuned\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.646492 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.646468 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:25:44.646616 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.646497 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:25:44.646616 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.646512 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:44.646728 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.646631 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:45.146573994 +0000 UTC m=+2.965826635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:44.649396 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.649318 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hj2\" (UniqueName: \"kubernetes.io/projected/5b04d6f9-bc80-4da8-af55-25fc9e46c8f0-kube-api-access-v5hj2\") pod \"node-resolver-x7k4j\" (UID: \"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0\") " pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.649606 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.649581 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhbgw\" (UniqueName: \"kubernetes.io/projected/b24d741d-f083-4762-af81-d83322a782c6-kube-api-access-hhbgw\") pod \"tuned-4kl4c\" (UID: \"b24d741d-f083-4762-af81-d83322a782c6\") " pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.649709 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.649627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzlc6\" (UniqueName: \"kubernetes.io/projected/03661298-acdd-469e-b8fc-830b18b39439-kube-api-access-xzlc6\") pod \"multus-additional-cni-plugins-vdgkx\" (UID: \"03661298-acdd-469e-b8fc-830b18b39439\") " pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.653947 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.653921 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq4r4\" (UniqueName: \"kubernetes.io/projected/f71941dc-722c-451d-8eae-93421d8f2d26-kube-api-access-nq4r4\") pod \"aws-ebs-csi-driver-node-bx7qh\" (UID: \"f71941dc-722c-451d-8eae-93421d8f2d26\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.734482 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734406 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd1b71ac-b1ae-47f8-974d-33a86d358c30-iptables-alerter-script\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.734482 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-slash\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734482 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734469 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-run-netns\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-etc-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734513 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-cni-netd\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734536 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovn-node-metrics-cert\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734545 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-run-netns\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-system-cni-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734579 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-etc-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-cni-netd\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734545 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-slash\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734623 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-k8s-cni-cncf-io\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734639 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-system-cni-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734647 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734665 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovnkube-script-lib\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734680 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275ca8c0-e814-498c-bcaa-36fa1cf06adb-host\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734683 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-k8s-cni-cncf-io\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734702 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275ca8c0-e814-498c-bcaa-36fa1cf06adb-serviceca\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734727 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734750 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/275ca8c0-e814-498c-bcaa-36fa1cf06adb-host\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.734779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734783 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-cnibin\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734811 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-systemd\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734836 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-node-log\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734855 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-cnibin\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnstt\" (UniqueName: \"kubernetes.io/projected/dd381359-11ca-4c1a-8f9e-4f555dbeecad-kube-api-access-hnstt\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734899 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd1b71ac-b1ae-47f8-974d-33a86d358c30-host-slash\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734910 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-systemd\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734927 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-cni-bin\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734930 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-node-log\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734961 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovnkube-config\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734966 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-cni-bin\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.734983 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dd1b71ac-b1ae-47f8-974d-33a86d358c30-host-slash\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735008 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-systemd-units\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735041 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-socket-dir-parent\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735068 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-netns\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-systemd-units\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-var-lib-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735134 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-var-lib-openvswitch\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.735649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735149 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-log-socket\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735152 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/275ca8c0-e814-498c-bcaa-36fa1cf06adb-serviceca\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735187 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-hostroot\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-netns\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-socket-dir-parent\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735217 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-log-socket\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735220 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-hostroot\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735215 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f37b558-ccba-4fd8-8470-43dd2024e5f4-kubelet-config\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f37b558-ccba-4fd8-8470-43dd2024e5f4-kubelet-config\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735263 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknwf\" (UniqueName: \"kubernetes.io/projected/dd1b71ac-b1ae-47f8-974d-33a86d358c30-kube-api-access-dknwf\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735290 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd79f2-9940-40f6-89b1-4677150981e5-konnectivity-ca\") pod \"konnectivity-agent-m4z6w\" (UID: \"f7cd79f2-9940-40f6-89b1-4677150981e5\") " pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735306 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovnkube-script-lib\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735315 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-run-ovn-kubernetes\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ff3a55d-1bb0-45de-a8b7-730509df76ab-cni-binary-copy\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735354 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-run-ovn-kubernetes\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-conf-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q78dg\" (UniqueName: \"kubernetes.io/projected/3ff3a55d-1bb0-45de-a8b7-730509df76ab-kube-api-access-q78dg\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:44.736507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735450 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gvzn\" (UniqueName: \"kubernetes.io/projected/3a0328b5-c52a-438e-a301-6c23bbac4a90-kube-api-access-2gvzn\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735461 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovnkube-config\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735490 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-cni-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735518 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-daemon-config\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735521 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-conf-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-etc-kubernetes\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735578 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-kubelet\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-env-overrides\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735696 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-etc-kubernetes\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735733 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-cni-multus\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735762 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-ovn\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.735771 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735786 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vbql\" (UniqueName: \"kubernetes.io/projected/275ca8c0-e814-498c-bcaa-36fa1cf06adb-kube-api-access-9vbql\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-os-release\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.735830 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:45.23581045 +0000 UTC m=+3.055063088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735857 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-cni-bin\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735872 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-os-release\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.737314 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735917 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ff3a55d-1bb0-45de-a8b7-730509df76ab-cni-binary-copy\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735933 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7cd79f2-9940-40f6-89b1-4677150981e5-konnectivity-ca\") pod \"konnectivity-agent-m4z6w\" (UID: \"f7cd79f2-9940-40f6-89b1-4677150981e5\") " pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735909 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-kubelet\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735969 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-multus-certs\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735974 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-cni-multus\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735992 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f37b558-ccba-4fd8-8470-43dd2024e5f4-dbus\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.735997 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-run-ovn\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736016 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-cni-dir\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736027 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dd381359-11ca-4c1a-8f9e-4f555dbeecad-env-overrides\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736077 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-kubelet\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736118 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dd381359-11ca-4c1a-8f9e-4f555dbeecad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7cd79f2-9940-40f6-89b1-4677150981e5-agent-certs\") pod \"konnectivity-agent-m4z6w\" (UID: \"f7cd79f2-9940-40f6-89b1-4677150981e5\") " pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736169 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-run-multus-certs\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-cni-bin\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736227 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f37b558-ccba-4fd8-8470-43dd2024e5f4-dbus\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736240 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff3a55d-1bb0-45de-a8b7-730509df76ab-host-var-lib-kubelet\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736172 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:44.738034 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.736327 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:44.738780 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:44.736395 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:45.236377245 +0000 UTC m=+3.055629861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:44.738780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736390 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ff3a55d-1bb0-45de-a8b7-730509df76ab-multus-daemon-config\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.738780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.736505 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dd1b71ac-b1ae-47f8-974d-33a86d358c30-iptables-alerter-script\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.738780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.737282 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dd381359-11ca-4c1a-8f9e-4f555dbeecad-ovn-node-metrics-cert\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.738780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.738634 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7cd79f2-9940-40f6-89b1-4677150981e5-agent-certs\") pod \"konnectivity-agent-m4z6w\" (UID: \"f7cd79f2-9940-40f6-89b1-4677150981e5\") " pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.748566 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.748535 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnstt\" (UniqueName: \"kubernetes.io/projected/dd381359-11ca-4c1a-8f9e-4f555dbeecad-kube-api-access-hnstt\") pod \"ovnkube-node-vwtcx\" (UID: \"dd381359-11ca-4c1a-8f9e-4f555dbeecad\") " pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.749238 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.749200 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vbql\" (UniqueName: \"kubernetes.io/projected/275ca8c0-e814-498c-bcaa-36fa1cf06adb-kube-api-access-9vbql\") pod \"node-ca-8v285\" (UID: \"275ca8c0-e814-498c-bcaa-36fa1cf06adb\") " pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:44.750229 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.749804 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q78dg\" (UniqueName: \"kubernetes.io/projected/3ff3a55d-1bb0-45de-a8b7-730509df76ab-kube-api-access-q78dg\") pod \"multus-cmdr6\" (UID: \"3ff3a55d-1bb0-45de-a8b7-730509df76ab\") " pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.750229 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.750182 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknwf\" (UniqueName: \"kubernetes.io/projected/dd1b71ac-b1ae-47f8-974d-33a86d358c30-kube-api-access-dknwf\") pod \"iptables-alerter-wkm2t\" (UID: \"dd1b71ac-b1ae-47f8-974d-33a86d358c30\") " pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.750382 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.750254 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gvzn\" (UniqueName: \"kubernetes.io/projected/3a0328b5-c52a-438e-a301-6c23bbac4a90-kube-api-access-2gvzn\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:44.829879 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.829823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" Jul 27 19:25:44.838952 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.838931 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" Jul 27 19:25:44.855830 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.855804 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x7k4j" Jul 27 19:25:44.862759 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.862730 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:25:44.871846 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.871827 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cmdr6" Jul 27 19:25:44.879736 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.879713 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:25:44.886947 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.886923 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:25:44.895246 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.895225 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wkm2t" Jul 27 19:25:44.901885 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:44.901866 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8v285" Jul 27 19:25:45.239422 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.239385 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:45.239632 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.239454 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:45.239632 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.239512 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:45.239632 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239573 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239633 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239572 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239652 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239671 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239672 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:46.239650539 +0000 UTC m=+4.058903159 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239718 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:46.239701978 +0000 UTC m=+4.058954594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:45.239803 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.239736 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:46.239726596 +0000 UTC m=+4.058979217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:45.565948 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:45.565884 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24d741d_f083_4762_af81_d83322a782c6.slice/crio-ed04c031d9d386340d7a689a75815872178c7d00e0203ab947737fa9b133d4ee WatchSource:0}: Error finding container ed04c031d9d386340d7a689a75815872178c7d00e0203ab947737fa9b133d4ee: Status 404 returned error can't find the container with id ed04c031d9d386340d7a689a75815872178c7d00e0203ab947737fa9b133d4ee Jul 27 19:25:45.567924 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:45.567880 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1b71ac_b1ae_47f8_974d_33a86d358c30.slice/crio-004bb48b55fe886cc9c3fe42bd612da0f08e996804f2873cac1e95cd3b543318 WatchSource:0}: Error finding container 004bb48b55fe886cc9c3fe42bd612da0f08e996804f2873cac1e95cd3b543318: Status 404 returned error can't find the container with id 004bb48b55fe886cc9c3fe42bd612da0f08e996804f2873cac1e95cd3b543318 Jul 27 19:25:45.571440 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:45.571408 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd381359_11ca_4c1a_8f9e_4f555dbeecad.slice/crio-de701a450f78bc25149e2decb4bdcff0e3e749ff6ca8861bcbbaee187f2e8deb WatchSource:0}: Error finding container de701a450f78bc25149e2decb4bdcff0e3e749ff6ca8861bcbbaee187f2e8deb: Status 404 returned error can't find the container with id de701a450f78bc25149e2decb4bdcff0e3e749ff6ca8861bcbbaee187f2e8deb Jul 27 19:25:45.581233 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:25:45.581063 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03661298_acdd_469e_b8fc_830b18b39439.slice/crio-46677fc497e4b77d0f2ca7bccc135934478d91cf085819ce2d3fa6dcb9bc1357 WatchSource:0}: Error finding container 46677fc497e4b77d0f2ca7bccc135934478d91cf085819ce2d3fa6dcb9bc1357: Status 404 returned error can't find the container with id 46677fc497e4b77d0f2ca7bccc135934478d91cf085819ce2d3fa6dcb9bc1357 Jul 27 19:25:45.589732 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.589684 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:20:45 +0000 UTC" deadline="2028-04-14 07:36:36.18418764 +0000 UTC" Jul 27 19:25:45.589810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.589733 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15036h10m50.594458695s" Jul 27 19:25:45.651335 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.651137 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:45.651475 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:45.651449 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:45.658649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.658606 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x7k4j" event={"ID":"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0","Type":"ContainerStarted","Data":"dc25fea0c022cbbbb993bf33f9c49b77f8a7397d7544a58ed226618ea577fe3e"} Jul 27 19:25:45.659773 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.659742 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8v285" event={"ID":"275ca8c0-e814-498c-bcaa-36fa1cf06adb","Type":"ContainerStarted","Data":"16247a8475c849a953666092d46124c7447013756c77f4dd2851be73a44fd515"} Jul 27 19:25:45.660892 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.660870 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"de701a450f78bc25149e2decb4bdcff0e3e749ff6ca8861bcbbaee187f2e8deb"} Jul 27 19:25:45.662163 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.662144 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmdr6" event={"ID":"3ff3a55d-1bb0-45de-a8b7-730509df76ab","Type":"ContainerStarted","Data":"8f6fa6786a6df39f849a53f918313285a16f19b0db4846dca9f2c624fa592eaf"} Jul 27 19:25:45.666533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.666505 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerStarted","Data":"46677fc497e4b77d0f2ca7bccc135934478d91cf085819ce2d3fa6dcb9bc1357"} Jul 27 19:25:45.667834 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.667810 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" event={"ID":"f71941dc-722c-451d-8eae-93421d8f2d26","Type":"ContainerStarted","Data":"0f549b5d2fce4b04499341e2b119aecda2623e3e2dd18a08a3fcc682eb6cbcea"} Jul 27 19:25:45.668909 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.668888 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wkm2t" event={"ID":"dd1b71ac-b1ae-47f8-974d-33a86d358c30","Type":"ContainerStarted","Data":"004bb48b55fe886cc9c3fe42bd612da0f08e996804f2873cac1e95cd3b543318"} Jul 27 19:25:45.670053 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.670030 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" event={"ID":"b24d741d-f083-4762-af81-d83322a782c6","Type":"ContainerStarted","Data":"ed04c031d9d386340d7a689a75815872178c7d00e0203ab947737fa9b133d4ee"} Jul 27 19:25:45.672799 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.672771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" event={"ID":"1b21792b782558305c8012893bc9790e","Type":"ContainerStarted","Data":"0817598eceb10beb3929689e157b306853eeb3015b3bc8a99731162740b3e2dd"} Jul 27 19:25:45.675172 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.675031 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4z6w" event={"ID":"f7cd79f2-9940-40f6-89b1-4677150981e5","Type":"ContainerStarted","Data":"5a793c49ae38af59373913c66f45eea5c45652cab2cac7d87255e4fe2e65f8f9"} Jul 27 19:25:45.692931 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:45.692889 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-113.ec2.internal" podStartSLOduration=1.692872532 podStartE2EDuration="1.692872532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:45.692375642 +0000 UTC m=+3.511628281" watchObservedRunningTime="2026-07-27 19:25:45.692872532 +0000 UTC m=+3.512125172" Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.249927 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.249999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.250053 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250193 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250262 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.250241863 +0000 UTC m=+6.069494494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250697 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250719 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250758 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250805 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.25078927 +0000 UTC m=+6.070041889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250868 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:46.250949 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.250902 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:48.250890511 +0000 UTC m=+6.070143130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:46.590779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.590664 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 19:20:45 +0000 UTC" deadline="2028-02-20 18:09:32.554889412 +0000 UTC" Jul 27 19:25:46.590779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.590730 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13750h43m45.964163634s" Jul 27 19:25:46.652010 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.651457 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:46.652010 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.651613 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:46.652527 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.652379 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:46.652527 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:46.652489 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:46.686739 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.686705 2584 generic.go:356] "Generic (PLEG): container finished" podID="1c0ea14aaf4d4e2f37195236b9f9e25f" containerID="8e45e849e36966ab5d420e9796d042ed37b70bf79e23c71204176cbf7ce82f5f" exitCode=0 Jul 27 19:25:46.687481 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:46.687249 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" event={"ID":"1c0ea14aaf4d4e2f37195236b9f9e25f","Type":"ContainerDied","Data":"8e45e849e36966ab5d420e9796d042ed37b70bf79e23c71204176cbf7ce82f5f"} Jul 27 19:25:47.652252 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:47.651706 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:47.652252 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:47.651858 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:47.703337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:47.703301 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" event={"ID":"1c0ea14aaf4d4e2f37195236b9f9e25f","Type":"ContainerStarted","Data":"e3ba7fbd55c66e2b9de8932c7e94f4349eba92b9f8772581cb0cf57f579c1bd0"} Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:48.268345 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:48.268423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:48.268472 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268664 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268735 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:52.268714993 +0000 UTC m=+10.087967611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268788 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268825 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268849 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268857 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:25:52.268837219 +0000 UTC m=+10.088089840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268863 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:48.269092 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.268914 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:25:52.268899251 +0000 UTC m=+10.088151871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:48.651509 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:48.651414 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:48.651698 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.651556 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:48.651996 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:48.651974 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:48.652148 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:48.652080 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:49.651245 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:49.650724 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:49.651245 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:49.650873 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:50.652242 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:50.651726 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:50.652242 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:50.651747 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:50.652242 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:50.651854 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:50.652242 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:50.652202 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:51.651745 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:51.651709 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:51.651940 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:51.651878 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:52.305248 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:52.305208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:52.305268 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305378 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305413 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305434 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:00.305413584 +0000 UTC m=+18.124666225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305443 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305457 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:52.305460 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305511 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:26:00.305493632 +0000 UTC m=+18.124746262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305563 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:52.305707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.305632 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:00.305617957 +0000 UTC m=+18.124870573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:25:52.652327 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:52.652228 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:52.652487 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.652334 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:52.652765 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:52.652745 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:52.652875 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:52.652844 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:53.651437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:53.651401 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:53.651983 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:53.651529 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:54.651569 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:54.651486 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:54.651964 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:54.651683 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:54.652055 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:54.652038 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:54.652158 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:54.652139 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:55.650738 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:55.650709 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:55.650962 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:55.650823 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:56.651082 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:56.651046 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:56.651452 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:56.651046 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:56.651452 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:56.651177 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:56.651452 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:56.651210 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:57.651656 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:57.651619 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:57.652069 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:57.651743 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:25:58.651871 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:58.651837 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:25:58.651871 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:58.651880 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:25:58.652263 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:58.651960 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:25:58.652263 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:58.652073 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:25:59.651463 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:25:59.651425 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:25:59.651710 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:25:59.651557 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:00.366301 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:00.366262 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:00.366322 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:00.366358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366418 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366438 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366488 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:16.366469107 +0000 UTC m=+34.185721722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366504 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:16.366495789 +0000 UTC m=+34.185748404 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366505 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366530 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366543 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:26:00.366788 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.366615 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:26:16.366596762 +0000 UTC m=+34.185849393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:26:00.651637 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:00.651555 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:00.651768 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.651709 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:00.652088 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:00.651555 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:00.652180 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:00.652162 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:01.651520 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:01.651490 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:01.651968 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:01.651638 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:02.652040 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:02.651998 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:02.652463 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:02.652118 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:02.652511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:02.652471 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:02.652548 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:02.652538 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:03.650921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:03.650884 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:03.651080 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:03.651014 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:04.651068 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:04.651029 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:04.651483 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:04.651161 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:04.651483 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:04.651201 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:04.651483 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:04.651292 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:05.651407 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.651020 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:05.652135 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:05.651524 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:05.744863 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.744790 2584 generic.go:356] "Generic (PLEG): container finished" podID="03661298-acdd-469e-b8fc-830b18b39439" containerID="0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6" exitCode=0 Jul 27 19:26:05.745007 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.744863 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerDied","Data":"0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6"} Jul 27 19:26:05.746282 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.746258 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" event={"ID":"f71941dc-722c-451d-8eae-93421d8f2d26","Type":"ContainerStarted","Data":"8809f1cf3ce0c88e63b68dad955861add96933ccf7c8cabcdad58f09fba69af0"} Jul 27 19:26:05.747779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.747748 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" event={"ID":"b24d741d-f083-4762-af81-d83322a782c6","Type":"ContainerStarted","Data":"caadc5e11f290ae94970fb1ffefecdc2a39c4db8ee10a827393245666ffdd067"} Jul 27 19:26:05.748953 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.748933 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4z6w" event={"ID":"f7cd79f2-9940-40f6-89b1-4677150981e5","Type":"ContainerStarted","Data":"f75a25f24c633e1fc7640ede9043154d2b58c6c56cc390e64c8505a99ca4d983"} Jul 27 19:26:05.750454 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.750409 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x7k4j" event={"ID":"5b04d6f9-bc80-4da8-af55-25fc9e46c8f0","Type":"ContainerStarted","Data":"14ae0fec946d6550e42ea8a4bc7728bf664be734ae7554f326bf76edc30bce45"} Jul 27 19:26:05.751684 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.751663 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8v285" event={"ID":"275ca8c0-e814-498c-bcaa-36fa1cf06adb","Type":"ContainerStarted","Data":"43d5a41a78202f50f7799a067ee4f5533eb0d237bfc730deaf64f02abc54331e"} Jul 27 19:26:05.754323 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.754305 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78"} Jul 27 19:26:05.754409 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.754364 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41"} Jul 27 19:26:05.754409 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.754394 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b"} Jul 27 19:26:05.754481 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.754422 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff"} Jul 27 19:26:05.754481 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.754450 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340"} Jul 27 19:26:05.754545 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.754491 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae"} Jul 27 19:26:05.755467 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.755451 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cmdr6" event={"ID":"3ff3a55d-1bb0-45de-a8b7-730509df76ab","Type":"ContainerStarted","Data":"4a8e362c216269d7c5a8fe576da66112461f85e9a32de91d61e7c6e7ba57ce3b"} Jul 27 19:26:05.772781 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.772740 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-113.ec2.internal" podStartSLOduration=21.772730135 podStartE2EDuration="21.772730135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:47.723094221 +0000 UTC m=+5.542346863" watchObservedRunningTime="2026-07-27 19:26:05.772730135 +0000 UTC m=+23.591982770" Jul 27 19:26:05.792149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.792112 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m4z6w" podStartSLOduration=3.44027319 podStartE2EDuration="22.792099422s" totalImagesPullingTime="19.351826232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:05.791058255 +0000 UTC m=+23.610310901" watchObservedRunningTime="2026-07-27 19:26:05.792099422 +0000 UTC m=+23.611352057" Jul 27 19:26:05.831375 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.831322 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cmdr6" podStartSLOduration=3.432206994 podStartE2EDuration="22.83130266s" totalImagesPullingTime="19.399095666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:05.81234032 +0000 UTC m=+23.631592969" watchObservedRunningTime="2026-07-27 19:26:05.83130266 +0000 UTC m=+23.650555297" Jul 27 19:26:05.858168 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.858123 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8v285" podStartSLOduration=3.514026082 podStartE2EDuration="22.858103948s" totalImagesPullingTime="19.344077866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:05.831202826 +0000 UTC m=+23.650455463" watchObservedRunningTime="2026-07-27 19:26:05.858103948 +0000 UTC m=+23.677356586" Jul 27 19:26:05.874050 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.874001 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4kl4c" podStartSLOduration=3.514493088 podStartE2EDuration="22.87398802s" totalImagesPullingTime="19.359494932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:05.858100065 +0000 UTC m=+23.677352705" watchObservedRunningTime="2026-07-27 19:26:05.87398802 +0000 UTC m=+23.693240655" Jul 27 19:26:05.874320 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:05.874297 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x7k4j" podStartSLOduration=3.5301842900000002 podStartE2EDuration="22.874292636s" totalImagesPullingTime="19.344108346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:05.873758215 +0000 UTC m=+23.693010851" watchObservedRunningTime="2026-07-27 19:26:05.874292636 +0000 UTC m=+23.693545272" Jul 27 19:26:06.279598 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.279560 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 19:26:06.468327 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.468245 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:26:06.468817 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.468799 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:26:06.594977 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.594874 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T19:26:06.27960859Z","UUID":"6e03c4be-b58b-409d-8c44-1275859946ca","Handler":null,"Name":"","Endpoint":""} Jul 27 19:26:06.596528 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.596507 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 19:26:06.596670 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.596550 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 19:26:06.650829 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.650799 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:06.650979 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:06.650923 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:06.651448 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.651429 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:06.651830 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:06.651527 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:06.760765 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.760732 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" event={"ID":"f71941dc-722c-451d-8eae-93421d8f2d26","Type":"ContainerStarted","Data":"a9f85756bbbdbf8d3f76ac0fd787bb79354505d1ada243fd90020eae60544b4f"} Jul 27 19:26:06.762519 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.762473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wkm2t" event={"ID":"dd1b71ac-b1ae-47f8-974d-33a86d358c30","Type":"ContainerStarted","Data":"ec5175d313f4b62e57cd2ebc075ec502267b3a708986d02f10db7a1fc8b6ced9"} Jul 27 19:26:06.762908 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.762811 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:26:06.763472 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.763452 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m4z6w" Jul 27 19:26:06.781118 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:06.780646 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wkm2t" podStartSLOduration=4.425014983 podStartE2EDuration="23.780630346s" totalImagesPullingTime="19.355615363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:06.779944785 +0000 UTC m=+24.599197421" watchObservedRunningTime="2026-07-27 19:26:06.780630346 +0000 UTC m=+24.599882984" Jul 27 19:26:07.651096 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:07.651070 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:07.651312 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:07.651175 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:07.766660 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:07.766631 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" event={"ID":"f71941dc-722c-451d-8eae-93421d8f2d26","Type":"ContainerStarted","Data":"3fdd4f9bb0ae0bd7b3f7f617c257da9fa16a0f14b0ae544f00f728ffbcb9809f"} Jul 27 19:26:08.652091 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:08.651565 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:08.652091 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:08.651626 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:08.652091 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:08.651725 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:08.652091 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:08.651845 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:08.773108 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:08.773071 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834"} Jul 27 19:26:09.651727 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:09.651534 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:09.651899 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:09.651820 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:10.650875 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.650847 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:10.650875 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.650866 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:10.651648 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:10.650960 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:10.651648 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:10.651090 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:10.779478 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.779255 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" event={"ID":"dd381359-11ca-4c1a-8f9e-4f555dbeecad","Type":"ContainerStarted","Data":"94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51"} Jul 27 19:26:10.779676 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.779540 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:10.779676 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.779612 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:10.781247 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.781225 2584 generic.go:356] "Generic (PLEG): container finished" podID="03661298-acdd-469e-b8fc-830b18b39439" containerID="3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57" exitCode=0 Jul 27 19:26:10.781331 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.781257 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerDied","Data":"3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57"} Jul 27 19:26:10.795698 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.795678 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:10.813117 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.813032 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bx7qh" podStartSLOduration=10.334991574 podStartE2EDuration="27.813018708s" totalImagesPullingTime="17.478027134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:07.790701276 +0000 UTC m=+25.609953913" watchObservedRunningTime="2026-07-27 19:26:10.813018708 +0000 UTC m=+28.632271343" Jul 27 19:26:10.813305 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:10.813287 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" podStartSLOduration=8.394969829 podStartE2EDuration="27.813283253s" totalImagesPullingTime="19.418313424s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:26:10.811641847 +0000 UTC m=+28.630894483" watchObservedRunningTime="2026-07-27 19:26:10.813283253 +0000 UTC m=+28.632535890" Jul 27 19:26:11.651666 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:11.651640 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:11.652106 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:11.651754 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:11.783597 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:11.783546 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:11.797463 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:11.797435 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:12.176809 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.176738 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rj6l"] Jul 27 19:26:12.177065 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.176861 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:12.177065 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:12.176964 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:12.179595 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.179545 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4gbd"] Jul 27 19:26:12.179710 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.179664 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:12.179796 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:12.179770 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:12.180083 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.180064 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c9sj9"] Jul 27 19:26:12.180162 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.180140 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:12.180235 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:12.180219 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:12.788103 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.788064 2584 generic.go:356] "Generic (PLEG): container finished" podID="03661298-acdd-469e-b8fc-830b18b39439" containerID="4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889" exitCode=0 Jul 27 19:26:12.788561 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:12.788151 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerDied","Data":"4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889"} Jul 27 19:26:13.651830 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:13.651802 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:13.652046 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:13.651857 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:13.652046 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:13.651875 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:13.652046 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:13.651939 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:13.652156 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:13.652073 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:13.652200 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:13.652149 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:14.794076 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:14.794038 2584 generic.go:356] "Generic (PLEG): container finished" podID="03661298-acdd-469e-b8fc-830b18b39439" containerID="84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5" exitCode=0 Jul 27 19:26:14.794408 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:14.794097 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerDied","Data":"84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5"} Jul 27 19:26:15.650947 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:15.650909 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:15.651126 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:15.650962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:15.651126 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:15.650925 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:15.651126 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:15.651044 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:15.651240 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:15.651131 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:15.651240 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:15.651208 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:16.395714 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:16.395675 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:16.395737 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:16.395782 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395863 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395883 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395887 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395911 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395941 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:48.395922517 +0000 UTC m=+66.215175153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395883 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395959 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:26:48.395949768 +0000 UTC m=+66.215202382 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:26:16.396122 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:16.395984 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:26:48.395966782 +0000 UTC m=+66.215219401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:26:17.651424 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:17.651389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:17.651905 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:17.651389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:17.651905 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:17.651510 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:17.651905 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:17.651620 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:17.651905 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:17.651395 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:17.651905 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:17.651777 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:18.807679 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:18.807643 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerStarted","Data":"0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988"} Jul 27 19:26:19.651099 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:19.651069 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:19.651099 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:19.651075 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:19.651289 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:19.651175 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:19.651289 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:19.651198 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:19.651289 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:19.651256 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:19.651401 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:19.651308 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:19.814844 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:19.814805 2584 generic.go:356] "Generic (PLEG): container finished" podID="03661298-acdd-469e-b8fc-830b18b39439" containerID="0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988" exitCode=0 Jul 27 19:26:19.814844 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:19.814849 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerDied","Data":"0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988"} Jul 27 19:26:19.872220 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:19.872121 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":false,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:19.888848 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:19.888755 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"message\\\":\\\"containers with incomplete status: [whereabouts-cni]\\\",\\\"type\\\":\\\"Initialized\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"PodInitializing\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:20.819843 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:20.819799 2584 generic.go:356] "Generic (PLEG): container finished" podID="03661298-acdd-469e-b8fc-830b18b39439" containerID="27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82" exitCode=0 Jul 27 19:26:20.820268 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:20.819855 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerDied","Data":"27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82"} Jul 27 19:26:20.847569 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:20.847439 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:21.650886 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:21.650862 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:21.651029 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:21.650862 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:21.651029 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:21.650956 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:21.651096 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:21.650862 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:21.651096 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:21.651031 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:21.651096 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:21.651091 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:21.825041 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:21.825015 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" event={"ID":"03661298-acdd-469e-b8fc-830b18b39439","Type":"ContainerStarted","Data":"5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58"} Jul 27 19:26:21.842220 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:21.842109 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:22.704451 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:22.704336 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:23.651406 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:23.651366 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:23.651836 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:23.651414 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:23.651836 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:23.651469 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:23.651836 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:23.651485 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:23.651836 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:23.651570 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:23.651836 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:23.651643 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:25.651625 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:25.651595 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:25.651625 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:25.651613 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:25.652014 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:25.651705 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:25.652014 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:25.651793 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:25.652014 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:25.651832 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:25.652014 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:25.651889 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:27.651340 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:27.651304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:27.651730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:27.651304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:27.651730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:27.651304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:27.651730 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:27.651486 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:27.651730 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:27.651548 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:27.651730 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:27.651405 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:29.651535 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:29.651509 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:29.652038 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:29.651549 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:29.652038 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:29.651609 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:29.652038 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:29.651631 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:29.652038 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:29.651709 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:29.652038 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:29.651774 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:31.651644 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:31.651608 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:31.651644 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:31.651641 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:31.652054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:31.651616 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:31.652054 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:31.651739 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:31.652054 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:31.651797 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:31.652054 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:31.651877 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:32.671909 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:32.671794 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:33.651284 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:33.651258 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:33.651442 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:33.651258 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:33.651442 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:33.651352 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:33.651442 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:33.651258 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:33.651442 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:33.651423 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:33.651571 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:33.651487 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:35.650974 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:35.650944 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:35.650974 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:35.650962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:35.651424 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:35.651036 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:35.651424 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:35.651098 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:35.651424 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:35.651164 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:35.651424 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:35.651217 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:37.651425 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:37.651393 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:37.651425 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:37.651426 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:37.651841 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:37.651393 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:37.651841 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:37.651500 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:37.651841 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:37.651567 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:37.651841 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:37.651673 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:39.651572 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:39.651542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:39.651958 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:39.651542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:39.651958 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:39.651652 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:39.651958 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:39.651542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:39.651958 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:39.651719 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:39.651958 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:39.651788 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:41.651498 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:41.651465 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:41.651942 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:41.651566 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:41.651942 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:41.651597 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:41.651942 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:41.651656 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:41.651942 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:41.651667 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:41.651942 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:41.651791 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:42.668874 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:42.668757 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:43.651334 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:43.651307 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:43.651490 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:43.651397 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:43.651490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:43.651311 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:43.651490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:43.651442 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:43.651609 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:43.651536 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:43.651646 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:43.651633 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:43.815027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:43.815000 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:43.832130 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:43.832021 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:43.849135 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:43.849006 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:44.619810 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:44.619732 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:44.632231 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:44.632158 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:44.644564 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:44.644493 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:44.656941 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:44.656863 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:44.668962 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:44.668885 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:44Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:44.668962 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:44.668956 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:26:45.650761 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:45.650729 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:45.651156 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:45.650783 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:45.651156 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:45.650856 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:45.651156 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:45.650874 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:45.651156 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:45.650925 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:45.651156 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:45.651003 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:47.651652 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:47.651623 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:47.652046 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:47.651663 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:47.652046 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:47.651724 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:47.652046 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:47.651733 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:47.652046 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:47.651796 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:47.652046 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:47.651865 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:48.432626 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:48.432596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:48.432634 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:48.432658 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432748 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432753 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432764 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432779 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432788 2584 projected.go:196] Error preparing data for projected volume kube-api-access-5sxlw for pod openshift-network-diagnostics/network-check-target-t4gbd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432794 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:52.432780736 +0000 UTC m=+130.252033350 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432806 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret podName:6f37b558-ccba-4fd8-8470-43dd2024e5f4 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:52.432800405 +0000 UTC m=+130.252053019 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret") pod "global-pull-secret-syncer-4rj6l" (UID: "6f37b558-ccba-4fd8-8470-43dd2024e5f4") : object "kube-system"/"original-pull-secret" not registered Jul 27 19:26:48.432822 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:48.432816 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw podName:6aecc2cb-b29d-4f78-80a8-9b3eac39e94e nodeName:}" failed. No retries permitted until 2026-07-27 19:27:52.432810455 +0000 UTC m=+130.252063069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5sxlw" (UniqueName: "kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw") pod "network-check-target-t4gbd" (UID: "6aecc2cb-b29d-4f78-80a8-9b3eac39e94e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 19:26:49.651724 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:49.651685 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:49.652123 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:49.651802 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:49.652123 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:49.651820 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:49.652123 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:49.651812 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:49.652123 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:49.651876 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:49.652123 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:49.651937 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:51.651641 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:51.651609 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:51.651641 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:51.651608 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:51.651641 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:51.651620 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:51.652076 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:51.651852 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:51.652076 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:51.651969 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:51.652076 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:51.652048 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:52.673007 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:52.672877 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:26:52.688497 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:52.688383 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:26:53.651498 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:53.651460 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:53.651714 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:53.651556 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:53.651714 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:53.651561 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:53.651714 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:53.651651 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:53.651714 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:53.651563 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:53.651860 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:53.651731 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:54.950065 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:54.949980 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:54.962178 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:54.962104 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:54.973842 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:54.973772 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:54.986063 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:54.985974 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:54.998116 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:54.998038 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:26:54Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:26:54.998116 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:54.998114 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:26:55.651271 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:55.651237 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:55.651271 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:55.651271 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:55.651472 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:55.651357 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:55.651472 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:55.651412 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:55.651532 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:55.651483 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:55.651532 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:55.651516 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:57.650872 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:57.650844 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:57.650872 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:57.650857 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:57.651306 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:57.650933 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:26:57.651306 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:57.650988 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:57.651306 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:57.651076 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:57.651306 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:57.651164 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:59.651533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:59.651507 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:26:59.651917 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:59.651507 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:26:59.651917 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:59.651617 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:26:59.651917 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:26:59.651507 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:26:59.651917 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:59.651668 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:26:59.651917 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:26:59.651752 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:01.651284 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:01.651238 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:01.651791 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:01.651346 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:01.651791 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:01.651257 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:01.651791 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:01.651391 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:01.651791 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:01.651455 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:01.651791 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:01.651524 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:02.670109 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:02.669975 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:27:02.684097 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:02.683986 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:27:03.651491 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:03.651380 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:03.651491 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:03.651380 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:03.651491 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:03.651477 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:03.651738 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:03.651380 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:03.651738 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:03.651547 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:03.651738 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:03.651673 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:05.327094 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.327014 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:05.340171 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.340091 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:05.352186 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.352114 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:05.364262 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.364187 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:05.376639 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.376552 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:05Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:05.376639 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.376634 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:27:05.651160 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:05.651084 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:05.651318 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:05.651092 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:05.651318 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.651175 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:05.651318 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:05.651197 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:05.651318 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.651290 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:05.651613 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:05.651335 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:07.651036 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:07.651007 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:07.651402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:07.651046 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:07.651402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:07.651120 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:07.651402 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:07.651135 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:07.651402 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:07.651186 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:07.651402 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:07.651241 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:09.650889 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:09.650860 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:09.650889 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:09.650882 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:09.651307 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:09.650917 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:09.651307 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:09.650983 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:09.651307 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:09.651043 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:09.651307 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:09.651102 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:11.651487 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:11.651441 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:11.651487 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:11.651491 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:11.651921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:11.651544 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:11.651921 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:11.651559 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:11.651921 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:11.651633 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:11.651921 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:11.651684 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:12.673770 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:12.673631 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:27:12.691826 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:12.691703 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:27:13.651434 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:13.651392 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:13.651434 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:13.651396 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:13.651434 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:13.651408 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:13.651707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:13.651657 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:13.651814 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:13.651787 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:13.651848 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:13.651825 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:15.643739 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.643653 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:15.650738 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:15.650707 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:15.650899 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:15.650800 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:15.650899 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.650808 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:15.650995 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:15.650898 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:15.650995 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.650898 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:15.650995 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.650979 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:15.660139 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.660068 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:15.672838 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.672760 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:15.689396 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.689328 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:15.705278 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.705200 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:15Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:15.705278 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:15.705271 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:27:17.651044 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:17.651013 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:17.651452 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:17.651049 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:17.651452 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:17.651111 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:17.651452 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:17.651121 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:17.651452 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:17.651186 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:17.651452 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:17.651263 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:19.650910 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:19.650869 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:19.651346 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:19.650869 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:19.651346 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:19.650967 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:19.651346 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:19.650885 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:19.651346 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:19.651073 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:19.651346 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:19.651091 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:21.651303 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:21.651268 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:21.651791 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:21.651273 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:21.651791 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:21.651385 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:21.651791 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:21.651559 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:21.651916 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:21.651861 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:21.651948 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:21.651933 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:22.667765 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:22.667644 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:27:22.685510 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:22.685380 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:27:23.651670 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:23.651640 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:23.651843 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:23.651644 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:23.651843 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:23.651749 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:23.651843 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:23.651759 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:23.651843 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:23.651803 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:23.651975 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:23.651865 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:25.651285 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:25.651249 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:25.651285 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:25.651277 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:25.651699 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:25.651366 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:25.651699 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:25.651369 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:25.651699 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:25.651437 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:25.651699 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:25.651508 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:26.081382 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:26.081294 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:26.094269 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:26.094187 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:26.107078 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:26.107003 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:26.122511 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:26.122430 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:26.136411 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:26.136334 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:26Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:26.136411 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:26.136407 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:27:27.651144 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:27.651107 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:27.651144 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:27.651142 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:27.651532 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:27.651230 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:27.651532 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:27.651251 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:27.651532 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:27.651326 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:27.651532 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:27.651408 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:29.651428 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:29.651384 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:29.651839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:29.651483 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:29.651839 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:29.651492 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:29.651839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:29.651511 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:29.651839 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:29.651574 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:29.651839 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:29.651652 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:31.650855 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:31.650824 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:31.651212 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:31.650824 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:31.651212 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:31.650930 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:31.651212 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:31.650832 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:31.651212 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:31.650996 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:31.651212 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:31.651080 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:32.670762 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:32.670613 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:27:32.685031 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:32.684902 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:27:33.651740 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:33.651702 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:33.651914 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:33.651801 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:33.651914 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:33.651806 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:33.651914 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:33.651874 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:33.651914 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:33.651809 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:33.652062 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:33.651936 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:35.650967 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:35.650932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:35.651372 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:35.651042 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:35.651372 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:35.651065 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:35.651372 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:35.651056 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:35.651372 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:35.651145 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:35.651372 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:35.651225 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:36.537182 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:36.537099 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:36.550118 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:36.550049 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:36.562931 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:36.562858 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:36.575053 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:36.574985 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:36.586838 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:36.586759 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:36Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:36.586838 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:36.586837 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:27:37.650973 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:37.650932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:37.650973 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:37.650966 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:37.650973 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:37.650932 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:37.651454 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:37.651246 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:37.651454 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:37.651371 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:37.651454 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:37.651421 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:39.651654 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:39.651624 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:39.652105 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:39.651630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:39.652105 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:39.651743 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:27:39.652105 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:39.651630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:39.652105 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:39.651795 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rj6l" podUID="6f37b558-ccba-4fd8-8470-43dd2024e5f4" Jul 27 19:27:39.652105 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:39.651862 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t4gbd" podUID="6aecc2cb-b29d-4f78-80a8-9b3eac39e94e" Jul 27 19:27:41.547695 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.547666 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:41.548020 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.547772 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 19:27:41.557162 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.557085 2584 kubelet_node_status.go:493] "Error updating node status, will retry with syncNodeStatus" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:41.557536 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.557519 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:41.566844 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.566768 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:41.569866 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.569847 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:41.578707 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.578632 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:41.585658 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.585633 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:41.594739 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.594670 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:41.597618 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.597602 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:41.606738 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.606665 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:41.609533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.609517 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:41.618428 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.618360 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:41Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:41.618428 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:41.618424 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:27:41.651062 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.651038 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:41.651062 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.651056 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:41.651149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.651139 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:41.653774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.653754 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 19:27:41.653876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.653792 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 19:27:41.653876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.653754 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4682l\"" Jul 27 19:27:41.653876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.653862 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xt9mb\"" Jul 27 19:27:41.654023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.653887 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 19:27:41.654023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:41.653946 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 19:27:42.673395 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:42.673263 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dd381359-11ca-4c1a-8f9e-4f555dbeecad\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:43Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://9734c2a1ee46cedea8e943a42f3f2838154d8fce7f2ec93d99bc1b0bd50cf1ff\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-node\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://e6b0243c43677d48b14dd5e62a2669f1a6616a0ecb65d33a26d4361bf690768b\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-rbac-proxy-ovn-metrics\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":65534,\\\"supplementalGroups\\\":[65534],\\\"uid\\\":65534}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/pki/tls/metrics-cert\\\",\\\"name\\\":\\\"ovn-node-metrics-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://2a4a9b5bc6371e5f83e7f88ff3942446b126ead40f97ffc929a53e0eab442e78\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"nbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://32e1fec347f11e102aec06978f95a63e7069bf41292119f274e1a170fc664b41\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"northd\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"},\\\"containerID\\\":\\\"cri-o://0527e324c169203a3e554335e78f52984a8c9b50d46084654569c55a570ad340\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-acl-logging\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"20Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://af957c966952d9b9c906a38b8c3b3db31ab4af9dbd55fceb4006958cc04153ae\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovn-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn/\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/dev/log\\\",\\\"name\\\":\\\"log-socket\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"},\\\"containerID\\\":\\\"cri-o://94daa0cb0ebe70a632b2ce6adc960eeeb164f8798a0a1e72a1dbe02c52aeee51\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"ovnkube-controller\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"600Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:09Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"host-kubelet\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/etc/systemd/system\\\",\\\"name\\\":\\\"systemd-units\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host\\\",\\\"name\\\":\\\"host-slash\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/ovn-kubernetes/\\\",\\\"name\\\":\\\"host-run-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/netns\\\",\\\"name\\\":\\\"host-run-netns\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/run/systemd/private\\\",\\\"name\\\":\\\"run-systemd\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/cni-bin-dir\\\",\\\"name\\\":\\\"host-cni-bin\\\"},{\\\"mountPath\\\":\\\"/etc/cni/net.d\\\",\\\"name\\\":\\\"host-cni-netd\\\"},{\\\"mountPath\\\":\\\"/var/lib/cni/networks/ovn-k8s-cni-overlay\\\",\\\"name\\\":\\\"host-var-lib-cni-networks-ovn-kubernetes\\\"},{\\\"mountPath\\\":\\\"/run/openvswitch\\\",\\\"name\\\":\\\"run-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/log/ovnkube/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/etc/openvswitch\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/var/lib/openvswitch\\\",\\\"name\\\":\\\"var-lib-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovnkube-config/\\\",\\\"name\\\":\\\"ovnkube-config\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"containerID\\\":\\\"cri-o://7d496614d402a63f3b83ff88e506ea4144ec624057a25faba945df639c998834\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"sbdb\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"300Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:07Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/ovnkube-lib\\\",\\\"name\\\":\\\"ovnkube-script-lib\\\"},{\\\"mountPath\\\":\\\"/etc/ovn/\\\",\\\"name\\\":\\\"etc-openvswitch\\\"},{\\\"mountPath\\\":\\\"/run/ovn/\\\",\\\"name\\\":\\\"run-ovn\\\"},{\\\"mountPath\\\":\\\"/var/log/ovn\\\",\\\"name\\\":\\\"node-log\\\"},{\\\"mountPath\\\":\\\"/env\\\",\\\"name\\\":\\\"env-overrides\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-hnstt\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"openshift-ovn-kubernetes\"/\"ovnkube-node-vwtcx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-ovn-kubernetes/ovnkube-node-vwtcx" Jul 27 19:27:42.688283 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:42.688179 2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"03661298-acdd-469e-b8fc-830b18b39439\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:20Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-27T19:26:21Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://5cc97d7e79a5c9ee459a8acb17572488c043f32fb8ca898c8c463ebf6bab9b58\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"kube-multus-additional-cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-27T19:26:20Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"initContainerStatuses\\\":[{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"egress-router-binary-copy\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0e4817991fd40f2d9ee2b4ac351683012fdb801a5a5b69f7bb113e820ca053e6\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:05Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:05Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"cni-plugins\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://3c0933c21529ab04b1aeb4dfc62634ac1430c7699174b1324f63fcf653341e57\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:10Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:10Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/tuning/\\\",\\\"name\\\":\\\"tuning-conf-dir\\\"},{\\\"mountPath\\\":\\\"/sysctls\\\",\\\"name\\\":\\\"cni-sysctl-allowlist\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"bond-cni-plugin\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://4b8f7345b696d8822d94ca254ab26c6c1c66debfd704da633280b5f605f31889\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:11Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:11Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"routeoverride-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://84bfd22b3fc48c7545d8199657bc75aef4f1dfeedb5f56a538bab26d41cbabd5\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:13Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:13Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni-bincopy\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://0b312a14920c3757f17861b6afc2f5edc48076656800dd295b6f747e7432f988\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:18Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:18Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/entrypoint\\\",\\\"name\\\":\\\"cni-binary-copy\\\"},{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/os-release\\\",\\\"name\\\":\\\"os-release\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]},{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"},\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\",\\\"imageID\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"whereabouts-cni\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"requests\\\":{\\\"cpu\\\":\\\"10m\\\",\\\"memory\\\":\\\"10Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"terminated\\\":{\\\"containerID\\\":\\\"cri-o://27c803d53ac734be51c4714a705d749f4c383bf6b6efd93e27159b733d808d82\\\",\\\"exitCode\\\":0,\\\"finishedAt\\\":\\\"2026-07-27T19:26:19Z\\\",\\\"reason\\\":\\\"Completed\\\",\\\"startedAt\\\":\\\"2026-07-27T19:26:19Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0],\\\"uid\\\":0}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/host/opt/cni/bin\\\",\\\"name\\\":\\\"cnibin\\\"},{\\\"mountPath\\\":\\\"/host/etc/cni/net.d\\\",\\\"name\\\":\\\"system-cni-dir\\\"},{\\\"mountPath\\\":\\\"/etc/whereabouts/config\\\",\\\"name\\\":\\\"whereabouts-flatfile-configmap\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-xzlc6\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"phase\\\":\\\"Running\\\"}}\" for pod \"openshift-multus\"/\"multus-additional-cni-plugins-vdgkx\": Internal error occurred: failed calling webhook \"pod.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/pod?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" Jul 27 19:27:46.885850 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:46.885813 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:46.896146 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:46.896069 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:46.899330 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:46.899315 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:46.908703 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:46.908635 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:46.911833 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:46.911818 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:46.921041 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:46.920966 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:46.924147 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:46.924130 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:46.933133 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:46.933052 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:46.936131 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:46.936117 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:46.945994 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:46.945919 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"lastTransitionTime\\\":\\\"2026-07-27T19:27:46Z\\\",\\\"message\\\":\\\"kubelet is posting ready status\\\",\\\"reason\\\":\\\"KubeletReady\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"images\\\":[{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:16ca8b7c1184a105aac97293a35c94373262103579713746b69f4f125185b301\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c61b1bd630d745ebd63d45ede0bae739076b4213e12bea2e0bb124e8f4727ab0\\\"],\\\"sizeBytes\\\":1341984117},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:09a988dc79ac3bbc5aff0a5cae44cb8ae06b7d21a0c28d30499f6b5f63fcefd8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ea7622cd6145f37fcac7b916bd4464831e2efdf19ebe0ec41c27047c814f23f0\\\"],\\\"sizeBytes\\\":1183199980},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0663b35dc117c67b903f052040d0ce01685d1e22781bc2ef837fb32d942f677c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:89bbd9284fb92be98f07e3067b3dd3b08642713706cd6520e6ed5a7819c4d18e\\\"],\\\"sizeBytes\\\":876273280},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:73a0d41e53dabfc205782cf08f95c47e93f3857314598fbfd7b4d281b4a932b2\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a83451907191f154bed1dfc7f0174433f0075beb6b6b82b9ec61e07e402dc811\\\"],\\\"sizeBytes\\\":586731180},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:3f42f4c14e88b49108b37c533fbbc282996a50a648f57db40690d2b0e8d5c811\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8e951c133c66e9b456835de5087842d6fc86fecfe5aad3ca560fdd9c719ed8ba\\\"],\\\"sizeBytes\\\":580608166},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8c672072cc02663bcd473a2edc6c5142d36ddb28dea685e0cfc5d06f52e03d64\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b8fe761810ead4093b28f3e7ee9ef6b962fd3499250b1838a1b00cc77765d1bf\\\"],\\\"sizeBytes\\\":537939273},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:787925288f5c2c026e0cbada3e6706c38be466bf3995c478d54c10defc389780\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e3ba88cacf3c747ed1559bdb550d4483a0e7a25ad4f76ef3c4588f72ae1d281e\\\"],\\\"sizeBytes\\\":349477060},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:bf790441537ab71f6e39920d97984a14115bd52c94cb371ffd5cf4ef6899e344\\\"],\\\"sizeBytes\\\":347020814},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:53008d8e30cdba8a421c865d7fd13497538e84d6843c1692df37914257440e91\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:c6db0ab20c9e44aed5dff7711ce889fe6725a09b24499fc7971edcd307d1e942\\\"],\\\"sizeBytes\\\":343989083},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:44dcc3802076a6fb1ea11dff5479cc5721d7c3452fb04af6023d965e5d92c987\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559\\\"],\\\"sizeBytes\\\":317186379},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:843b51893f8a3884f1fe56948902e4dd166193b21cc34e099aa8d96a8ff2ea09\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f01dca26528042bc3f05fdd53d5a72cb9f3bd70dcfe2f1d5eab626c7530dd859\\\"],\\\"sizeBytes\\\":313107438},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:39fb880a46d245719ae227a8b8e803ed4945a53bbfd7aef02be61d262527989a\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46a09b61078082511645fb4b54f513d0b4c65ffe5abdd774765376c5b5df57e7\\\"],\\\"sizeBytes\\\":284044146},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:373a63186d156b4ce0ae2d8560e108441d17b09be34e6d6db2b3486bc43f7dfd\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:79363f7abd34060a04015eceb060626d31d91d8c0aa51ce25ec751c237169fdc\\\"],\\\"sizeBytes\\\":278280461},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2e863246db3b0816c2d1279b3d1a2ee5606624d3e1c7601c715ddc7309e7b68c\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f984df1cb2384583cc1b1d74cc304af86ed19d269145c54f380ee1b6b11ebeff\\\"],\\\"sizeBytes\\\":235560681},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d1d940b941cc3129d8c30028e2371b5741771afc1860c872c66cdc8ebda6c0fe\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:e0fbdb86532d771d5307b5972b2013a378dfa3a213b2f5960eece8410c770ca3\\\"],\\\"sizeBytes\\\":235302136},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15259073275e2789accc887bd84daeb72a005385030ffcfd81af0ece73a97191\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:15ab63548751bddcfa77c870dddc6d9bb822b23f82cba324e5f1747c0d35abe8\\\"],\\\"sizeBytes\\\":222771689},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:062f884217d33f8982f101f5b2bee51590a578164f2707db799b0dce80c399e8\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:64a796986118e9bcb9f32dd15fba29e2aa5906f3068c8209a3ad21b66cd7fe06\\\"],\\\"sizeBytes\\\":218369365},{\\\"names\\\":[\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb\\\",\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7fef1a9d7fb1e554165cc9ff6b4ca01027ee426c0e28b7a9f81ce5339b8bb53f\\\"],\\\"sizeBytes\\\":206446249}]}}\" for node \"ip-10-0-136-113.ec2.internal\": Internal error occurred: failed calling webhook \"node.network-node-identity.openshift.io\": failed to call webhook: Post \"https://network-node-identity.clusters-98c63052-5512-48ed-9e58-8008512a0fb1.svc:9743/node?timeout=10s\": dial tcp 172.30.119.215:9743: connect: connection refused" Jul 27 19:27:46.945994 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:46.945993 2584 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count" Jul 27 19:27:52.516027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.515978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:52.516027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.516037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:52.516510 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.516062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:27:52.518661 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.518643 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 19:27:52.518726 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.518645 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 19:27:52.518768 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.518729 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 19:27:52.526867 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:52.526844 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 27 19:27:52.526972 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:52.526920 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs podName:3a0328b5-c52a-438e-a301-6c23bbac4a90 nodeName:}" failed. No retries permitted until 2026-07-27 19:29:54.526904528 +0000 UTC m=+252.346157142 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs") pod "network-metrics-daemon-c9sj9" (UID: "3a0328b5-c52a-438e-a301-6c23bbac4a90") : secret "metrics-daemon-secret" not found Jul 27 19:27:52.529034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.529014 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 19:27:52.530530 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.530512 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f37b558-ccba-4fd8-8470-43dd2024e5f4-original-pull-secret\") pod \"global-pull-secret-syncer-4rj6l\" (UID: \"6f37b558-ccba-4fd8-8470-43dd2024e5f4\") " pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:52.539109 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.539092 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sxlw\" (UniqueName: \"kubernetes.io/projected/6aecc2cb-b29d-4f78-80a8-9b3eac39e94e-kube-api-access-5sxlw\") pod \"network-check-target-t4gbd\" (UID: \"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e\") " pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:52.684187 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.684140 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vdgkx" podStartSLOduration=100.114484982 podStartE2EDuration="2m9.684125542s" totalImagesPullingTime="29.56964056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:52.682474068 +0000 UTC m=+130.501726703" watchObservedRunningTime="2026-07-27 19:27:52.684125542 +0000 UTC m=+130.503378177" Jul 27 19:27:52.761330 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.761304 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rj6l" Jul 27 19:27:52.772160 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.772137 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xt9mb\"" Jul 27 19:27:52.780572 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.780546 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:52.900169 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.900142 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rj6l"] Jul 27 19:27:52.903617 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:27:52.903568 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f37b558_ccba_4fd8_8470_43dd2024e5f4.slice/crio-a4c73571d06c126507c54f2d5e62d775bfceb3dbe10177102276f64682b5734e WatchSource:0}: Error finding container a4c73571d06c126507c54f2d5e62d775bfceb3dbe10177102276f64682b5734e: Status 404 returned error can't find the container with id a4c73571d06c126507c54f2d5e62d775bfceb3dbe10177102276f64682b5734e Jul 27 19:27:52.915394 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:52.914775 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t4gbd"] Jul 27 19:27:52.918489 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:27:52.918469 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aecc2cb_b29d_4f78_80a8_9b3eac39e94e.slice/crio-91824a7ef2bd9e15765818c2bd8c44a18ca9af1a0cddb5d1a9e7568ab446361a WatchSource:0}: Error finding container 91824a7ef2bd9e15765818c2bd8c44a18ca9af1a0cddb5d1a9e7568ab446361a: Status 404 returned error can't find the container with id 91824a7ef2bd9e15765818c2bd8c44a18ca9af1a0cddb5d1a9e7568ab446361a Jul 27 19:27:53.008134 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:53.008103 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rj6l" event={"ID":"6f37b558-ccba-4fd8-8470-43dd2024e5f4","Type":"ContainerStarted","Data":"a4c73571d06c126507c54f2d5e62d775bfceb3dbe10177102276f64682b5734e"} Jul 27 19:27:53.009027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:53.009004 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4gbd" event={"ID":"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e","Type":"ContainerStarted","Data":"91824a7ef2bd9e15765818c2bd8c44a18ca9af1a0cddb5d1a9e7568ab446361a"} Jul 27 19:27:56.017385 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:56.017350 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t4gbd" event={"ID":"6aecc2cb-b29d-4f78-80a8-9b3eac39e94e","Type":"ContainerStarted","Data":"891427a44590a5a0211b29eaf770eae4d4b538adee3050a238eb86f3f7765bac"} Jul 27 19:27:56.018120 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:56.018101 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:27:56.036002 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:56.035959 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t4gbd" podStartSLOduration=130.265194842 podStartE2EDuration="2m13.035945268s" totalImagesPullingTime="2.770750426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:56.034487206 +0000 UTC m=+133.853739842" watchObservedRunningTime="2026-07-27 19:27:56.035945268 +0000 UTC m=+133.855197903" Jul 27 19:27:57.210025 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.209995 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-113.ec2.internal" event="NodeReady" Jul 27 19:27:57.261101 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.261073 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c45475667-kqp5p"] Jul 27 19:27:57.264190 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.264164 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.266942 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.266871 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 19:27:57.266942 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.266880 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 19:27:57.266942 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.266935 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 19:27:57.267162 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.266936 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h9pp5\"" Jul 27 19:27:57.272977 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.272952 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dkmb6"] Jul 27 19:27:57.277652 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.277628 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 19:27:57.278250 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.278219 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h6flp"] Jul 27 19:27:57.278699 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.278683 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.281045 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.281027 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c45475667-kqp5p"] Jul 27 19:27:57.281154 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.281124 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.281664 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.281640 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 19:27:57.281755 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.281704 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctr9s\"" Jul 27 19:27:57.281846 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.281831 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 19:27:57.283879 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.283858 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 19:27:57.283974 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.283905 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 19:27:57.283974 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.283919 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmpmh\"" Jul 27 19:27:57.284149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.284131 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 19:27:57.286394 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.286373 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h6flp"] Jul 27 19:27:57.291518 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.291497 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dkmb6"] Jul 27 19:27:57.350279 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-config-volume\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.350437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350289 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-image-registry-private-configuration\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350319 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-trusted-ca\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-installation-pull-secrets\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350395 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-bound-sa-token\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350436 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b8f0150-bc95-4af1-817c-c58ec44564b7-cert\") pod \"ingress-canary-h6flp\" (UID: \"1b8f0150-bc95-4af1-817c-c58ec44564b7\") " pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350461 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vblvw\" (UniqueName: \"kubernetes.io/projected/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-kube-api-access-vblvw\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350486 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lldf\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-kube-api-access-9lldf\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350511 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794725ee-2c6f-436b-bf2e-b22b064a2e24-ca-trust-extracted\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350538 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-certificates\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350566 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350659 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvzj9\" (UniqueName: \"kubernetes.io/projected/1b8f0150-bc95-4af1-817c-c58ec44564b7-kube-api-access-zvzj9\") pod \"ingress-canary-h6flp\" (UID: \"1b8f0150-bc95-4af1-817c-c58ec44564b7\") " pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.350689 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350688 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.350962 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.350709 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-tmp-dir\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.451634 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-certificates\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.451810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451654 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.451810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvzj9\" (UniqueName: \"kubernetes.io/projected/1b8f0150-bc95-4af1-817c-c58ec44564b7-kube-api-access-zvzj9\") pod \"ingress-canary-h6flp\" (UID: \"1b8f0150-bc95-4af1-817c-c58ec44564b7\") " pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.451810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.451810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451785 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-tmp-dir\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.451810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451806 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-config-volume\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.452000 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451828 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-image-registry-private-configuration\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452000 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.451836 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 19:27:57.452000 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.451857 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c45475667-kqp5p: secret "image-registry-tls" not found Jul 27 19:27:57.452000 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.451904 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls podName:794725ee-2c6f-436b-bf2e-b22b064a2e24 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:57.951890638 +0000 UTC m=+135.771143255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls") pod "image-registry-c45475667-kqp5p" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24") : secret "image-registry-tls" not found Jul 27 19:27:57.452123 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.451846 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-trusted-ca\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452157 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452128 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-installation-pull-secrets\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452157 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452146 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-bound-sa-token\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452216 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b8f0150-bc95-4af1-817c-c58ec44564b7-cert\") pod \"ingress-canary-h6flp\" (UID: \"1b8f0150-bc95-4af1-817c-c58ec44564b7\") " pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.452216 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452176 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vblvw\" (UniqueName: \"kubernetes.io/projected/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-kube-api-access-vblvw\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.452216 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452179 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-certificates\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452216 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lldf\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-kube-api-access-9lldf\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452330 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794725ee-2c6f-436b-bf2e-b22b064a2e24-ca-trust-extracted\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452630 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452433 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794725ee-2c6f-436b-bf2e-b22b064a2e24-ca-trust-extracted\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452630 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.452523 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 19:27:57.452630 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452529 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-trusted-ca\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.452630 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.452603 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls podName:cf1a6f4f-afda-4b01-a45f-6b7f0607a42e nodeName:}" failed. No retries permitted until 2026-07-27 19:27:57.952564724 +0000 UTC m=+135.771817343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls") pod "dns-default-dkmb6" (UID: "cf1a6f4f-afda-4b01-a45f-6b7f0607a42e") : secret "dns-default-metrics-tls" not found Jul 27 19:27:57.452899 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.452737 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-tmp-dir\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.453105 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.453089 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-config-volume\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.455130 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.455105 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-installation-pull-secrets\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.455295 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.455280 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b8f0150-bc95-4af1-817c-c58ec44564b7-cert\") pod \"ingress-canary-h6flp\" (UID: \"1b8f0150-bc95-4af1-817c-c58ec44564b7\") " pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.455376 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.455357 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-image-registry-private-configuration\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.463768 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.463705 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lldf\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-kube-api-access-9lldf\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.464016 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.463982 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-bound-sa-token\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.464120 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.464068 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vblvw\" (UniqueName: \"kubernetes.io/projected/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-kube-api-access-vblvw\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.464524 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.464506 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvzj9\" (UniqueName: \"kubernetes.io/projected/1b8f0150-bc95-4af1-817c-c58ec44564b7-kube-api-access-zvzj9\") pod \"ingress-canary-h6flp\" (UID: \"1b8f0150-bc95-4af1-817c-c58ec44564b7\") " pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.596759 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.596734 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h6flp" Jul 27 19:27:57.725592 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.725504 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h6flp"] Jul 27 19:27:57.728944 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:27:57.728918 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8f0150_bc95_4af1_817c_c58ec44564b7.slice/crio-f7382b78aaa034cfa6d5e34a9a0e2ed881cdc57bf9abb2b82a8c47c0cc3dc77d WatchSource:0}: Error finding container f7382b78aaa034cfa6d5e34a9a0e2ed881cdc57bf9abb2b82a8c47c0cc3dc77d: Status 404 returned error can't find the container with id f7382b78aaa034cfa6d5e34a9a0e2ed881cdc57bf9abb2b82a8c47c0cc3dc77d Jul 27 19:27:57.956365 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.956333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:57.956515 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:57.956380 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:57.956515 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.956483 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 19:27:57.956515 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.956486 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 19:27:57.956515 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.956502 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c45475667-kqp5p: secret "image-registry-tls" not found Jul 27 19:27:57.956682 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.956555 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls podName:cf1a6f4f-afda-4b01-a45f-6b7f0607a42e nodeName:}" failed. No retries permitted until 2026-07-27 19:27:58.95653673 +0000 UTC m=+136.775789347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls") pod "dns-default-dkmb6" (UID: "cf1a6f4f-afda-4b01-a45f-6b7f0607a42e") : secret "dns-default-metrics-tls" not found Jul 27 19:27:57.956682 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:57.956570 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls podName:794725ee-2c6f-436b-bf2e-b22b064a2e24 nodeName:}" failed. No retries permitted until 2026-07-27 19:27:58.956564278 +0000 UTC m=+136.775816892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls") pod "image-registry-c45475667-kqp5p" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24") : secret "image-registry-tls" not found Jul 27 19:27:58.023310 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:58.023280 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rj6l" event={"ID":"6f37b558-ccba-4fd8-8470-43dd2024e5f4","Type":"ContainerStarted","Data":"c8c9f327d3b35f2b2340c328a53c2e1a52a0bb5924cdab6733c140958ba7b19c"} Jul 27 19:27:58.024334 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:58.024312 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h6flp" event={"ID":"1b8f0150-bc95-4af1-817c-c58ec44564b7","Type":"ContainerStarted","Data":"f7382b78aaa034cfa6d5e34a9a0e2ed881cdc57bf9abb2b82a8c47c0cc3dc77d"} Jul 27 19:27:58.039038 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:58.038997 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4rj6l" podStartSLOduration=130.392568136 podStartE2EDuration="2m15.038983635s" totalImagesPullingTime="4.646415499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:58.038129682 +0000 UTC m=+135.857382318" watchObservedRunningTime="2026-07-27 19:27:58.038983635 +0000 UTC m=+135.858236249" Jul 27 19:27:58.963300 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:58.963264 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:27:58.963732 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:27:58.963315 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:27:58.963732 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:58.963424 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 19:27:58.963732 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:58.963428 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 19:27:58.963732 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:58.963444 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c45475667-kqp5p: secret "image-registry-tls" not found Jul 27 19:27:58.963732 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:58.963491 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls podName:cf1a6f4f-afda-4b01-a45f-6b7f0607a42e nodeName:}" failed. No retries permitted until 2026-07-27 19:28:00.963473404 +0000 UTC m=+138.782726018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls") pod "dns-default-dkmb6" (UID: "cf1a6f4f-afda-4b01-a45f-6b7f0607a42e") : secret "dns-default-metrics-tls" not found Jul 27 19:27:58.963732 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:27:58.963504 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls podName:794725ee-2c6f-436b-bf2e-b22b064a2e24 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:00.963498243 +0000 UTC m=+138.782750857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls") pod "image-registry-c45475667-kqp5p" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24") : secret "image-registry-tls" not found Jul 27 19:28:00.029693 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:00.029662 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h6flp" event={"ID":"1b8f0150-bc95-4af1-817c-c58ec44564b7","Type":"ContainerStarted","Data":"b761e75ba4b0068987e569aaf8c9834785296e12a418f4956932c25d093e4689"} Jul 27 19:28:00.048149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:00.048105 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h6flp" podStartSLOduration=0.837707448 podStartE2EDuration="3.048085461s" totalImagesPullingTime="2.210378013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:00.047628725 +0000 UTC m=+137.866881362" watchObservedRunningTime="2026-07-27 19:28:00.048085461 +0000 UTC m=+137.867338096" Jul 27 19:28:00.977484 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:00.977430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:00.977662 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:00.977541 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:00.977662 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:00.977606 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 19:28:00.977662 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:00.977623 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c45475667-kqp5p: secret "image-registry-tls" not found Jul 27 19:28:00.977662 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:00.977649 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 19:28:00.977820 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:00.977686 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls podName:794725ee-2c6f-436b-bf2e-b22b064a2e24 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:04.977668198 +0000 UTC m=+142.796920828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls") pod "image-registry-c45475667-kqp5p" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24") : secret "image-registry-tls" not found Jul 27 19:28:00.977820 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:00.977701 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls podName:cf1a6f4f-afda-4b01-a45f-6b7f0607a42e nodeName:}" failed. No retries permitted until 2026-07-27 19:28:04.977695325 +0000 UTC m=+142.796947939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls") pod "dns-default-dkmb6" (UID: "cf1a6f4f-afda-4b01-a45f-6b7f0607a42e") : secret "dns-default-metrics-tls" not found Jul 27 19:28:03.677890 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.677817 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6"] Jul 27 19:28:03.680893 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.680875 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" Jul 27 19:28:03.683406 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.683386 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 19:28:03.684016 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.683998 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 19:28:03.684774 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.684758 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8frbv\"" Jul 27 19:28:03.689894 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.689874 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6"] Jul 27 19:28:03.795521 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.795488 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl6g7\" (UniqueName: \"kubernetes.io/projected/24836b7a-7e03-4740-8173-2ca6f0cfe25a-kube-api-access-tl6g7\") pod \"migrator-6865c9967-7mxv6\" (UID: \"24836b7a-7e03-4740-8173-2ca6f0cfe25a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" Jul 27 19:28:03.896055 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.896026 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl6g7\" (UniqueName: \"kubernetes.io/projected/24836b7a-7e03-4740-8173-2ca6f0cfe25a-kube-api-access-tl6g7\") pod \"migrator-6865c9967-7mxv6\" (UID: \"24836b7a-7e03-4740-8173-2ca6f0cfe25a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" Jul 27 19:28:03.903823 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.903802 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl6g7\" (UniqueName: \"kubernetes.io/projected/24836b7a-7e03-4740-8173-2ca6f0cfe25a-kube-api-access-tl6g7\") pod \"migrator-6865c9967-7mxv6\" (UID: \"24836b7a-7e03-4740-8173-2ca6f0cfe25a\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" Jul 27 19:28:03.989971 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:03.989894 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" Jul 27 19:28:04.106023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.105993 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6"] Jul 27 19:28:04.108747 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:04.108716 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24836b7a_7e03_4740_8173_2ca6f0cfe25a.slice/crio-4204efe627ba5da6409a40af558ca1a51acac3ffe54158932802307b5d83cbd3 WatchSource:0}: Error finding container 4204efe627ba5da6409a40af558ca1a51acac3ffe54158932802307b5d83cbd3: Status 404 returned error can't find the container with id 4204efe627ba5da6409a40af558ca1a51acac3ffe54158932802307b5d83cbd3 Jul 27 19:28:04.236525 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.236492 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-czwz5"] Jul 27 19:28:04.240505 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.240452 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.243238 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.243218 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 19:28:04.243337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.243292 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 19:28:04.243337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.243327 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qd54j\"" Jul 27 19:28:04.243454 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.243291 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 19:28:04.244522 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.244506 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 19:28:04.251824 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.251804 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-czwz5"] Jul 27 19:28:04.299777 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.299742 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-crio-socket\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.299891 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.299781 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.299891 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.299802 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwsn\" (UniqueName: \"kubernetes.io/projected/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-api-access-4wwsn\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.299891 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.299846 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.299891 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.299878 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-data-volume\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.400944 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.400915 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-crio-socket\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.401061 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.400949 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.401061 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.400967 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwsn\" (UniqueName: \"kubernetes.io/projected/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-api-access-4wwsn\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.401061 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.400991 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.401061 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.401016 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-data-volume\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.401061 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.401039 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-crio-socket\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.401237 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.401083 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 19:28:04.401237 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.401153 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:04.901134111 +0000 UTC m=+142.720386728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : secret "insights-runtime-extractor-tls" not found Jul 27 19:28:04.401237 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.401083 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 19:28:04.401237 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.401231 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:04.901217346 +0000 UTC m=+142.720469964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : configmap "kube-rbac-proxy" not found Jul 27 19:28:04.401359 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.401322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-data-volume\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.410723 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.410693 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwsn\" (UniqueName: \"kubernetes.io/projected/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-api-access-4wwsn\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.903592 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.903559 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.903951 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:04.903613 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:04.903951 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.903704 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 19:28:04.903951 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.903709 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 19:28:04.903951 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.903773 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:05.903757862 +0000 UTC m=+143.723010476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : configmap "kube-rbac-proxy" not found Jul 27 19:28:04.903951 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:04.903786 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:05.903780459 +0000 UTC m=+143.723033073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : secret "insights-runtime-extractor-tls" not found Jul 27 19:28:05.004129 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:05.004098 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:05.004281 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:05.004175 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:05.004281 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.004232 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 19:28:05.004362 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.004296 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls podName:cf1a6f4f-afda-4b01-a45f-6b7f0607a42e nodeName:}" failed. No retries permitted until 2026-07-27 19:28:13.004280063 +0000 UTC m=+150.823532677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls") pod "dns-default-dkmb6" (UID: "cf1a6f4f-afda-4b01-a45f-6b7f0607a42e") : secret "dns-default-metrics-tls" not found Jul 27 19:28:05.004362 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.004297 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 19:28:05.004362 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.004309 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c45475667-kqp5p: secret "image-registry-tls" not found Jul 27 19:28:05.004362 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.004348 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls podName:794725ee-2c6f-436b-bf2e-b22b064a2e24 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:13.004333563 +0000 UTC m=+150.823586195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls") pod "image-registry-c45475667-kqp5p" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24") : secret "image-registry-tls" not found Jul 27 19:28:05.042315 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:05.042281 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" event={"ID":"24836b7a-7e03-4740-8173-2ca6f0cfe25a","Type":"ContainerStarted","Data":"4204efe627ba5da6409a40af558ca1a51acac3ffe54158932802307b5d83cbd3"} Jul 27 19:28:05.910214 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:05.910133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:05.910214 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:05.910173 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:05.910641 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.910265 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 19:28:05.910641 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.910288 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 19:28:05.910641 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.910327 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:07.910307582 +0000 UTC m=+145.729560198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : configmap "kube-rbac-proxy" not found Jul 27 19:28:05.910641 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:05.910352 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:07.910342391 +0000 UTC m=+145.729595009 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : secret "insights-runtime-extractor-tls" not found Jul 27 19:28:06.046458 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.046428 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" event={"ID":"24836b7a-7e03-4740-8173-2ca6f0cfe25a","Type":"ContainerStarted","Data":"6ea02f418bc3686b8a3a14dd56109ed021255acecc5a3961ed9aaca14343336f"} Jul 27 19:28:06.046629 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.046475 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" event={"ID":"24836b7a-7e03-4740-8173-2ca6f0cfe25a","Type":"ContainerStarted","Data":"dfe4d9c999ec72702e23aa17bc8a34834551de3cfe5e0f3d0dca2010f7ead2f5"} Jul 27 19:28:06.062363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.062320 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-7mxv6" podStartSLOduration=1.6001690160000002 podStartE2EDuration="3.062306706s" totalImagesPullingTime="1.46213769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:06.060732075 +0000 UTC m=+143.879984710" watchObservedRunningTime="2026-07-27 19:28:06.062306706 +0000 UTC m=+143.881559341" Jul 27 19:28:06.844350 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.844317 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v2rnm"] Jul 27 19:28:06.847295 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.847280 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:06.850011 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.849989 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 27 19:28:06.850263 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.850247 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 27 19:28:06.850364 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.850247 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 27 19:28:06.851219 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.851195 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-mfqjj\"" Jul 27 19:28:06.851327 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.851223 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 27 19:28:06.855675 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.855649 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v2rnm"] Jul 27 19:28:06.917480 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.917443 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n82s\" (UniqueName: \"kubernetes.io/projected/c915bb84-36c5-48e8-af6a-8b006c5f654d-kube-api-access-9n82s\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:06.917845 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.917515 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c915bb84-36c5-48e8-af6a-8b006c5f654d-signing-key\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:06.917845 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:06.917541 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c915bb84-36c5-48e8-af6a-8b006c5f654d-signing-cabundle\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.018157 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.018118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c915bb84-36c5-48e8-af6a-8b006c5f654d-signing-key\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.018157 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.018162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c915bb84-36c5-48e8-af6a-8b006c5f654d-signing-cabundle\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.018295 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.018224 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n82s\" (UniqueName: \"kubernetes.io/projected/c915bb84-36c5-48e8-af6a-8b006c5f654d-kube-api-access-9n82s\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.018821 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.018801 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c915bb84-36c5-48e8-af6a-8b006c5f654d-signing-cabundle\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.020646 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.020626 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c915bb84-36c5-48e8-af6a-8b006c5f654d-signing-key\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.026057 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.026037 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n82s\" (UniqueName: \"kubernetes.io/projected/c915bb84-36c5-48e8-af6a-8b006c5f654d-kube-api-access-9n82s\") pod \"service-ca-658d7b7c78-v2rnm\" (UID: \"c915bb84-36c5-48e8-af6a-8b006c5f654d\") " pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.156316 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.156251 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" Jul 27 19:28:07.274811 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.274783 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-v2rnm"] Jul 27 19:28:07.277654 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:07.277629 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc915bb84_36c5_48e8_af6a_8b006c5f654d.slice/crio-20cc890f21fc2b6af17c4193057dc927fc3bbc8edc77525dbd76553299039052 WatchSource:0}: Error finding container 20cc890f21fc2b6af17c4193057dc927fc3bbc8edc77525dbd76553299039052: Status 404 returned error can't find the container with id 20cc890f21fc2b6af17c4193057dc927fc3bbc8edc77525dbd76553299039052 Jul 27 19:28:07.924111 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.924075 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:07.924111 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:07.924113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:07.924497 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:07.924194 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 19:28:07.924497 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:07.924228 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 19:28:07.924497 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:07.924251 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:11.924236301 +0000 UTC m=+149.743488915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : configmap "kube-rbac-proxy" not found Jul 27 19:28:07.924497 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:07.924281 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:11.924268336 +0000 UTC m=+149.743520950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : secret "insights-runtime-extractor-tls" not found Jul 27 19:28:08.051447 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:08.051415 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" event={"ID":"c915bb84-36c5-48e8-af6a-8b006c5f654d","Type":"ContainerStarted","Data":"20cc890f21fc2b6af17c4193057dc927fc3bbc8edc77525dbd76553299039052"} Jul 27 19:28:10.058462 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:10.058428 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" event={"ID":"c915bb84-36c5-48e8-af6a-8b006c5f654d","Type":"ContainerStarted","Data":"972e8a9e4b6a3989901af78fbce75b7c2be350aa10920df8d68d9b33488cf3e7"} Jul 27 19:28:10.074648 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:10.074492 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-v2rnm" podStartSLOduration=1.877809177 podStartE2EDuration="4.074472956s" totalImagesPullingTime="2.196663779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:10.07422612 +0000 UTC m=+147.893478757" watchObservedRunningTime="2026-07-27 19:28:10.074472956 +0000 UTC m=+147.893725593" Jul 27 19:28:10.120524 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:10.120498 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x7k4j_5b04d6f9-bc80-4da8-af55-25fc9e46c8f0/dns-node-resolver/0.log" Jul 27 19:28:10.719429 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:10.719398 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8v285_275ca8c0-e814-498c-bcaa-36fa1cf06adb/node-ca/0.log" Jul 27 19:28:11.720812 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:11.720780 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6flp_1b8f0150-bc95-4af1-817c-c58ec44564b7/serve-healthcheck-canary/0.log" Jul 27 19:28:11.921168 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:11.921130 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7mxv6_24836b7a-7e03-4740-8173-2ca6f0cfe25a/migrator/0.log" Jul 27 19:28:11.959137 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:11.959106 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:11.959329 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:11.959153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:11.959632 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:11.959504 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 19:28:11.959632 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:11.959598 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls podName:c1392a57-9ef2-4ae4-b1ff-35b2f8212568 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:19.959561924 +0000 UTC m=+157.778814542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czwz5" (UID: "c1392a57-9ef2-4ae4-b1ff-35b2f8212568") : secret "insights-runtime-extractor-tls" not found Jul 27 19:28:11.959792 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:11.959734 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:12.120184 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:12.120149 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7mxv6_24836b7a-7e03-4740-8173-2ca6f0cfe25a/graceful-termination/0.log" Jul 27 19:28:13.068336 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:13.068308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:13.068723 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:13.068353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:13.068723 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:13.068449 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 19:28:13.068723 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:13.068449 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 19:28:13.068723 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:13.068459 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c45475667-kqp5p: secret "image-registry-tls" not found Jul 27 19:28:13.068723 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:13.068506 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls podName:794725ee-2c6f-436b-bf2e-b22b064a2e24 nodeName:}" failed. No retries permitted until 2026-07-27 19:28:29.068493025 +0000 UTC m=+166.887745639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls") pod "image-registry-c45475667-kqp5p" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24") : secret "image-registry-tls" not found Jul 27 19:28:13.068723 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:13.068516 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls podName:cf1a6f4f-afda-4b01-a45f-6b7f0607a42e nodeName:}" failed. No retries permitted until 2026-07-27 19:28:29.068511425 +0000 UTC m=+166.887764039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls") pod "dns-default-dkmb6" (UID: "cf1a6f4f-afda-4b01-a45f-6b7f0607a42e") : secret "dns-default-metrics-tls" not found Jul 27 19:28:15.720018 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:15.719992 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/egress-router-binary-copy/0.log" Jul 27 19:28:15.921741 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:15.921712 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/cni-plugins/0.log" Jul 27 19:28:16.119234 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:16.119206 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/bond-cni-plugin/0.log" Jul 27 19:28:16.320655 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:16.320625 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/routeoverride-cni/0.log" Jul 27 19:28:16.521463 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:16.521424 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/whereabouts-cni-bincopy/0.log" Jul 27 19:28:16.719769 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:16.719729 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/whereabouts-cni/0.log" Jul 27 19:28:16.919885 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:16.919816 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/kube-multus-additional-cni-plugins/0.log" Jul 27 19:28:17.120365 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:17.120338 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cmdr6_3ff3a55d-1bb0-45de-a8b7-730509df76ab/kube-multus/0.log" Jul 27 19:28:20.019666 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:20.019633 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:20.021983 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:20.021961 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c1392a57-9ef2-4ae4-b1ff-35b2f8212568-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czwz5\" (UID: \"c1392a57-9ef2-4ae4-b1ff-35b2f8212568\") " pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:20.149507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:20.149485 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-czwz5" Jul 27 19:28:20.268388 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:20.268366 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-czwz5"] Jul 27 19:28:20.270813 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:20.270747 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1392a57_9ef2_4ae4_b1ff_35b2f8212568.slice/crio-c97375f9b04be32a89c48f401db5dd0394b72b2cf8ddf899ca8fa035a13abf0c WatchSource:0}: Error finding container c97375f9b04be32a89c48f401db5dd0394b72b2cf8ddf899ca8fa035a13abf0c: Status 404 returned error can't find the container with id c97375f9b04be32a89c48f401db5dd0394b72b2cf8ddf899ca8fa035a13abf0c Jul 27 19:28:21.091900 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:21.091796 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czwz5" event={"ID":"c1392a57-9ef2-4ae4-b1ff-35b2f8212568","Type":"ContainerStarted","Data":"c97375f9b04be32a89c48f401db5dd0394b72b2cf8ddf899ca8fa035a13abf0c"} Jul 27 19:28:25.321651 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:25.321625 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/ovn-controller/0.log" Jul 27 19:28:25.520471 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:25.520417 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/ovn-acl-logging/0.log" Jul 27 19:28:25.721981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:25.721949 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/kube-rbac-proxy-node/0.log" Jul 27 19:28:25.921792 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:25.921718 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 19:28:26.110778 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:26.110746 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czwz5" event={"ID":"c1392a57-9ef2-4ae4-b1ff-35b2f8212568","Type":"ContainerStarted","Data":"e3fbdbce7ef9c994c916bba37169c31b40e324eeaaf6b226ea2d5c994ac69abe"} Jul 27 19:28:26.127224 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:26.127194 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/northd/0.log" Jul 27 19:28:26.321090 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:26.321065 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/nbdb/0.log" Jul 27 19:28:26.521225 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:26.521195 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/sbdb/0.log" Jul 27 19:28:26.722352 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:26.722252 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vwtcx_dd381359-11ca-4c1a-8f9e-4f555dbeecad/ovnkube-controller/0.log" Jul 27 19:28:27.521008 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:27.520982 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-t4gbd_6aecc2cb-b29d-4f78-80a8-9b3eac39e94e/network-check-target-container/0.log" Jul 27 19:28:28.027448 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:28.027421 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t4gbd" Jul 27 19:28:28.320211 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:28.320192 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-wkm2t_dd1b71ac-b1ae-47f8-974d-33a86d358c30/iptables-alerter/0.log" Jul 27 19:28:29.094221 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.094185 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:29.094663 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.094259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:29.096856 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.096829 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf1a6f4f-afda-4b01-a45f-6b7f0607a42e-metrics-tls\") pod \"dns-default-dkmb6\" (UID: \"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e\") " pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:29.096998 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.096979 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"image-registry-c45475667-kqp5p\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:29.122248 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.122206 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czwz5" event={"ID":"c1392a57-9ef2-4ae4-b1ff-35b2f8212568","Type":"ContainerStarted","Data":"25172376d4adf36b4e123637b2b2bdd5e60dfae0bb7ae4049a81ebb4eabc0d75"} Jul 27 19:28:29.375329 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.375249 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:29.390752 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.390522 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:29.525646 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.525616 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c45475667-kqp5p"] Jul 27 19:28:29.528299 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:29.528261 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794725ee_2c6f_436b_bf2e_b22b064a2e24.slice/crio-c8d9d6721ebb8f308046d3e488eef906da82eb8ab21c826be5176661b4dd626b WatchSource:0}: Error finding container c8d9d6721ebb8f308046d3e488eef906da82eb8ab21c826be5176661b4dd626b: Status 404 returned error can't find the container with id c8d9d6721ebb8f308046d3e488eef906da82eb8ab21c826be5176661b4dd626b Jul 27 19:28:29.540093 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:29.540065 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dkmb6"] Jul 27 19:28:29.544668 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:29.544322 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1a6f4f_afda_4b01_a45f_6b7f0607a42e.slice/crio-e02be0ba2a0398b5f10b345f766bec6f4fcbbe59e928551beee8fa6593a345f6 WatchSource:0}: Error finding container e02be0ba2a0398b5f10b345f766bec6f4fcbbe59e928551beee8fa6593a345f6: Status 404 returned error can't find the container with id e02be0ba2a0398b5f10b345f766bec6f4fcbbe59e928551beee8fa6593a345f6 Jul 27 19:28:30.128640 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.128603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c45475667-kqp5p" event={"ID":"794725ee-2c6f-436b-bf2e-b22b064a2e24","Type":"ContainerStarted","Data":"69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68"} Jul 27 19:28:30.129093 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.128664 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c45475667-kqp5p" event={"ID":"794725ee-2c6f-436b-bf2e-b22b064a2e24","Type":"ContainerStarted","Data":"c8d9d6721ebb8f308046d3e488eef906da82eb8ab21c826be5176661b4dd626b"} Jul 27 19:28:30.129093 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.128878 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:30.130252 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.130222 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkmb6" event={"ID":"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e","Type":"ContainerStarted","Data":"e02be0ba2a0398b5f10b345f766bec6f4fcbbe59e928551beee8fa6593a345f6"} Jul 27 19:28:30.151972 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.151919 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c45475667-kqp5p" podStartSLOduration=50.151899249 podStartE2EDuration="50.151899249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:30.151427125 +0000 UTC m=+167.970679803" watchObservedRunningTime="2026-07-27 19:28:30.151899249 +0000 UTC m=+167.971151886" Jul 27 19:28:30.781746 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.781484 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c45475667-kqp5p"] Jul 27 19:28:30.782345 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.782319 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-khk8h"] Jul 27 19:28:30.788817 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.788775 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:30.793681 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.793657 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xnxvv\"" Jul 27 19:28:30.793681 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.793672 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 19:28:30.794030 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.794010 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 19:28:30.799772 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.799705 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-khk8h"] Jul 27 19:28:30.806535 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.806511 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rj5\" (UniqueName: \"kubernetes.io/projected/e0c90960-7c8c-41d0-815b-0da4cba96954-kube-api-access-86rj5\") pod \"downloads-7c97dc4555-khk8h\" (UID: \"e0c90960-7c8c-41d0-815b-0da4cba96954\") " pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:30.866797 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.866767 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-787bb4c475-khjsh"] Jul 27 19:28:30.871211 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.871187 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.884145 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.884121 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-787bb4c475-khjsh"] Jul 27 19:28:30.907112 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907084 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-registry-tls\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907265 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907125 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96f4b5db-f002-4e45-bfb7-819d21f7f190-registry-certificates\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907265 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907159 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96f4b5db-f002-4e45-bfb7-819d21f7f190-installation-pull-secrets\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907265 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907241 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7vwh\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-kube-api-access-d7vwh\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907377 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907310 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-bound-sa-token\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907377 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96f4b5db-f002-4e45-bfb7-819d21f7f190-image-registry-private-configuration\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907377 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rj5\" (UniqueName: \"kubernetes.io/projected/e0c90960-7c8c-41d0-815b-0da4cba96954-kube-api-access-86rj5\") pod \"downloads-7c97dc4555-khk8h\" (UID: \"e0c90960-7c8c-41d0-815b-0da4cba96954\") " pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:30.907488 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96f4b5db-f002-4e45-bfb7-819d21f7f190-trusted-ca\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.907488 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.907436 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96f4b5db-f002-4e45-bfb7-819d21f7f190-ca-trust-extracted\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:30.921151 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:30.921124 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rj5\" (UniqueName: \"kubernetes.io/projected/e0c90960-7c8c-41d0-815b-0da4cba96954-kube-api-access-86rj5\") pod \"downloads-7c97dc4555-khk8h\" (UID: \"e0c90960-7c8c-41d0-815b-0da4cba96954\") " pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:31.008700 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96f4b5db-f002-4e45-bfb7-819d21f7f190-trusted-ca\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008700 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96f4b5db-f002-4e45-bfb7-819d21f7f190-ca-trust-extracted\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008727 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-registry-tls\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008768 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96f4b5db-f002-4e45-bfb7-819d21f7f190-registry-certificates\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008788 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96f4b5db-f002-4e45-bfb7-819d21f7f190-installation-pull-secrets\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008805 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7vwh\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-kube-api-access-d7vwh\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008847 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-bound-sa-token\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.008921 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.008888 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96f4b5db-f002-4e45-bfb7-819d21f7f190-image-registry-private-configuration\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.009232 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.009108 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/96f4b5db-f002-4e45-bfb7-819d21f7f190-ca-trust-extracted\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.009854 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.009785 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/96f4b5db-f002-4e45-bfb7-819d21f7f190-registry-certificates\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.010395 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.010372 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/96f4b5db-f002-4e45-bfb7-819d21f7f190-trusted-ca\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.011934 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.011905 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-registry-tls\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.012030 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.011955 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/96f4b5db-f002-4e45-bfb7-819d21f7f190-image-registry-private-configuration\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.012291 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.012245 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/96f4b5db-f002-4e45-bfb7-819d21f7f190-installation-pull-secrets\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.018516 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.018004 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7vwh\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-kube-api-access-d7vwh\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.018516 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.018345 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/96f4b5db-f002-4e45-bfb7-819d21f7f190-bound-sa-token\") pod \"image-registry-787bb4c475-khjsh\" (UID: \"96f4b5db-f002-4e45-bfb7-819d21f7f190\") " pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:31.100766 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.100688 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:31.181758 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:31.181722 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:32.568016 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:32.567952 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-787bb4c475-khjsh"] Jul 27 19:28:32.572357 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:32.572331 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f4b5db_f002_4e45_bfb7_819d21f7f190.slice/crio-b2baf91013c8e238cab466609c86c328c434722c272f54e08007dc77a6da1766 WatchSource:0}: Error finding container b2baf91013c8e238cab466609c86c328c434722c272f54e08007dc77a6da1766: Status 404 returned error can't find the container with id b2baf91013c8e238cab466609c86c328c434722c272f54e08007dc77a6da1766 Jul 27 19:28:32.581857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:32.581830 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-khk8h"] Jul 27 19:28:32.584981 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:32.584954 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c90960_7c8c_41d0_815b_0da4cba96954.slice/crio-acde251cc535bbff8b116cea27c82d2d538b82f9825b2e90e52e54687568487d WatchSource:0}: Error finding container acde251cc535bbff8b116cea27c82d2d538b82f9825b2e90e52e54687568487d: Status 404 returned error can't find the container with id acde251cc535bbff8b116cea27c82d2d538b82f9825b2e90e52e54687568487d Jul 27 19:28:33.142175 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.142134 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czwz5" event={"ID":"c1392a57-9ef2-4ae4-b1ff-35b2f8212568","Type":"ContainerStarted","Data":"ec192d86599c821e576050659274ef62fc3bd02c02746a95e848b64a6f6a5332"} Jul 27 19:28:33.144052 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.144026 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkmb6" event={"ID":"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e","Type":"ContainerStarted","Data":"0451d8e131f12ebc9f702b2ebb36451e78d074623a36a6f078e826f5fc17f2f9"} Jul 27 19:28:33.144186 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.144075 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dkmb6" event={"ID":"cf1a6f4f-afda-4b01-a45f-6b7f0607a42e","Type":"ContainerStarted","Data":"dbdf5accc6f4ad693cb3b12432162b63127db3f17a26766988ad329257c7f8e5"} Jul 27 19:28:33.144186 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.144118 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:33.145417 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.145391 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-khk8h" event={"ID":"e0c90960-7c8c-41d0-815b-0da4cba96954","Type":"ContainerStarted","Data":"acde251cc535bbff8b116cea27c82d2d538b82f9825b2e90e52e54687568487d"} Jul 27 19:28:33.146893 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.146874 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" event={"ID":"96f4b5db-f002-4e45-bfb7-819d21f7f190","Type":"ContainerStarted","Data":"81e3622f15353549516187bc72a4d7747926ede2631f62dfc0554b637f51365c"} Jul 27 19:28:33.146993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.146910 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" event={"ID":"96f4b5db-f002-4e45-bfb7-819d21f7f190","Type":"ContainerStarted","Data":"b2baf91013c8e238cab466609c86c328c434722c272f54e08007dc77a6da1766"} Jul 27 19:28:33.146993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.146981 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:33.160326 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.160280 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-czwz5" podStartSLOduration=17.131137901 podStartE2EDuration="29.160267211s" totalImagesPullingTime="12.02912931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:28:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:33.158636796 +0000 UTC m=+170.977889432" watchObservedRunningTime="2026-07-27 19:28:33.160267211 +0000 UTC m=+170.979519846" Jul 27 19:28:33.178973 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.178917 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" podStartSLOduration=3.178903416 podStartE2EDuration="3.178903416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:33.178353878 +0000 UTC m=+170.997606526" watchObservedRunningTime="2026-07-27 19:28:33.178903416 +0000 UTC m=+170.998156051" Jul 27 19:28:33.196349 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:33.196302 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dkmb6" podStartSLOduration=33.345645737 podStartE2EDuration="36.19628145s" totalImagesPullingTime="2.850635713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:33.195715456 +0000 UTC m=+171.014968093" watchObservedRunningTime="2026-07-27 19:28:33.19628145 +0000 UTC m=+171.015534102" Jul 27 19:28:43.153414 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:43.153381 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dkmb6" Jul 27 19:28:49.209047 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:49.208321 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-khk8h" event={"ID":"e0c90960-7c8c-41d0-815b-0da4cba96954","Type":"ContainerStarted","Data":"9135464455b6f111aa62e8c1bdcc908408f56f0016ac3f46f405d8a675153c12"} Jul 27 19:28:49.209047 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:49.208833 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:49.222008 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:49.221981 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-khk8h" Jul 27 19:28:49.229849 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:49.229803 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-khk8h" podStartSLOduration=3.64581857 podStartE2EDuration="19.229785872s" totalImagesPullingTime="15.583967302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:49.229552386 +0000 UTC m=+187.048805023" watchObservedRunningTime="2026-07-27 19:28:49.229785872 +0000 UTC m=+187.049038508" Jul 27 19:28:52.142672 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:52.142640 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:54.155990 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:54.155963 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-787bb4c475-khjsh" Jul 27 19:28:56.712550 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.712516 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-49qp2"] Jul 27 19:28:56.811925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.811887 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.814977 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.814903 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kxzxm\"" Jul 27 19:28:56.814977 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.814921 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 19:28:56.816595 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.816551 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 19:28:56.816826 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.816807 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 19:28:56.816897 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.816822 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 19:28:56.816897 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.816857 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 19:28:56.817113 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.817096 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 19:28:56.926721 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.926683 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-textfile\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.926966 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.926939 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-metrics-client-ca\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927096 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.926988 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-sys\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927096 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.927018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jx27\" (UniqueName: \"kubernetes.io/projected/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-kube-api-access-7jx27\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927096 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.927063 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-wtmp\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927253 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.927104 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927253 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.927128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-root\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927253 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.927152 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:56.927253 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:56.927203 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-tls\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028303 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028264 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-wtmp\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028634 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028604 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028643 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-wtmp\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028647 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-root\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028694 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-root\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028709 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.028780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028761 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-tls\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.029049 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028809 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-textfile\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.029049 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028834 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-metrics-client-ca\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.029049 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028863 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-sys\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.029049 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.028892 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jx27\" (UniqueName: \"kubernetes.io/projected/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-kube-api-access-7jx27\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.029650 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.029632 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-textfile\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.029811 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.029788 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.030243 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.030222 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-metrics-client-ca\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.030343 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.030280 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-sys\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.032217 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.031730 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.036759 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.036739 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jx27\" (UniqueName: \"kubernetes.io/projected/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-kube-api-access-7jx27\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.040930 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.040906 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/39922aac-4a1c-42bd-8f85-5874aa6ed1b3-node-exporter-tls\") pod \"node-exporter-49qp2\" (UID: \"39922aac-4a1c-42bd-8f85-5874aa6ed1b3\") " pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.124339 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.124310 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-49qp2" Jul 27 19:28:57.155764 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:28:57.155728 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39922aac_4a1c_42bd_8f85_5874aa6ed1b3.slice/crio-a314d72da210fba4f8ead416e23ff514f25371e0b1926cda9a5b241985cf035e WatchSource:0}: Error finding container a314d72da210fba4f8ead416e23ff514f25371e0b1926cda9a5b241985cf035e: Status 404 returned error can't find the container with id a314d72da210fba4f8ead416e23ff514f25371e0b1926cda9a5b241985cf035e Jul 27 19:28:57.155880 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.155846 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c45475667-kqp5p" podUID="794725ee-2c6f-436b-bf2e-b22b064a2e24" containerName="registry" containerID="cri-o://69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68" gracePeriod=30 Jul 27 19:28:57.236228 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.236197 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49qp2" event={"ID":"39922aac-4a1c-42bd-8f85-5874aa6ed1b3","Type":"ContainerStarted","Data":"a314d72da210fba4f8ead416e23ff514f25371e0b1926cda9a5b241985cf035e"} Jul 27 19:28:57.409857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.409828 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:57.532877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.532851 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-trusted-ca\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533057 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.532887 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lldf\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-kube-api-access-9lldf\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533057 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.532923 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-certificates\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533057 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.532956 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-bound-sa-token\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533057 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.532990 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-image-registry-private-configuration\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533057 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.533036 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794725ee-2c6f-436b-bf2e-b22b064a2e24-ca-trust-extracted\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533313 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.533074 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-installation-pull-secrets\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533313 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.533096 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") pod \"794725ee-2c6f-436b-bf2e-b22b064a2e24\" (UID: \"794725ee-2c6f-436b-bf2e-b22b064a2e24\") " Jul 27 19:28:57.533400 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.533315 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:28:57.533447 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.533396 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:28:57.535461 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.535433 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:28:57.535600 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.535535 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-kube-api-access-9lldf" (OuterVolumeSpecName: "kube-api-access-9lldf") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "kube-api-access-9lldf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:28:57.535600 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.535568 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:28:57.535705 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.535689 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:28:57.535860 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.535837 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:28:57.541688 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.541642 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/794725ee-2c6f-436b-bf2e-b22b064a2e24-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "794725ee-2c6f-436b-bf2e-b22b064a2e24" (UID: "794725ee-2c6f-436b-bf2e-b22b064a2e24"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:28:57.633696 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633668 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-installation-pull-secrets\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633696 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633691 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633696 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633700 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-trusted-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633984 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633707 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lldf\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-kube-api-access-9lldf\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633984 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633716 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/794725ee-2c6f-436b-bf2e-b22b064a2e24-registry-certificates\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633984 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633724 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/794725ee-2c6f-436b-bf2e-b22b064a2e24-bound-sa-token\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633984 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633733 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/794725ee-2c6f-436b-bf2e-b22b064a2e24-image-registry-private-configuration\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:57.633984 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:57.633742 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/794725ee-2c6f-436b-bf2e-b22b064a2e24-ca-trust-extracted\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:28:58.241089 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.241060 2584 generic.go:356] "Generic (PLEG): container finished" podID="794725ee-2c6f-436b-bf2e-b22b064a2e24" containerID="69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68" exitCode=0 Jul 27 19:28:58.241514 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.241106 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c45475667-kqp5p" Jul 27 19:28:58.241514 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.241128 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c45475667-kqp5p" event={"ID":"794725ee-2c6f-436b-bf2e-b22b064a2e24","Type":"ContainerDied","Data":"69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68"} Jul 27 19:28:58.241514 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.241170 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c45475667-kqp5p" event={"ID":"794725ee-2c6f-436b-bf2e-b22b064a2e24","Type":"ContainerDied","Data":"c8d9d6721ebb8f308046d3e488eef906da82eb8ab21c826be5176661b4dd626b"} Jul 27 19:28:58.241514 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.241189 2584 scope.go:117] "RemoveContainer" containerID="69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68" Jul 27 19:28:58.261225 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.261202 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c45475667-kqp5p"] Jul 27 19:28:58.264417 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.264400 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c45475667-kqp5p"] Jul 27 19:28:58.322682 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.322651 2584 scope.go:117] "RemoveContainer" containerID="69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68" Jul 27 19:28:58.322980 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:28:58.322958 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68\": container with ID starting with 69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68 not found: ID does not exist" containerID="69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68" Jul 27 19:28:58.323064 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.322990 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68"} err="failed to get container status \"69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68\": rpc error: code = NotFound desc = could not find container \"69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68\": container with ID starting with 69712882500c18214890b8924ab9ea8413161b113f24337b1040950773f88b68 not found: ID does not exist" Jul 27 19:28:58.654820 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:58.654753 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="794725ee-2c6f-436b-bf2e-b22b064a2e24" path="/var/lib/kubelet/pods/794725ee-2c6f-436b-bf2e-b22b064a2e24/volumes" Jul 27 19:28:59.245335 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:59.245297 2584 generic.go:356] "Generic (PLEG): container finished" podID="39922aac-4a1c-42bd-8f85-5874aa6ed1b3" containerID="53a545b6b8b921b298a9c4b7bda207a2ab4e65e388feda3603aa458ccff4e184" exitCode=0 Jul 27 19:28:59.245853 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:28:59.245382 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49qp2" event={"ID":"39922aac-4a1c-42bd-8f85-5874aa6ed1b3","Type":"ContainerDied","Data":"53a545b6b8b921b298a9c4b7bda207a2ab4e65e388feda3603aa458ccff4e184"} Jul 27 19:29:00.251869 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:00.251834 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49qp2" event={"ID":"39922aac-4a1c-42bd-8f85-5874aa6ed1b3","Type":"ContainerStarted","Data":"06e06ee2d6889a97d61c9a974c14fade3e9f4f3b854842991b669094f2b4e2b6"} Jul 27 19:29:00.252297 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:00.251890 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-49qp2" event={"ID":"39922aac-4a1c-42bd-8f85-5874aa6ed1b3","Type":"ContainerStarted","Data":"e62165a2405c2816577b83731afb2f1cac8d686a1983fc36be4bd7de33e33ac5"} Jul 27 19:29:00.280332 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:00.280285 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-49qp2" podStartSLOduration=2.670612629 podStartE2EDuration="4.280271246s" totalImagesPullingTime="1.513265528s" totalInitContainerRuntime="96.393089ms" isStatefulPod=true podCreationTimestamp="2026-07-27 19:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:00.278913469 +0000 UTC m=+198.098166107" watchObservedRunningTime="2026-07-27 19:29:00.280271246 +0000 UTC m=+198.099523881" Jul 27 19:29:01.471694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.471659 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh"] Jul 27 19:29:01.472053 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.471925 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794725ee-2c6f-436b-bf2e-b22b064a2e24" containerName="registry" Jul 27 19:29:01.472053 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.471938 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="794725ee-2c6f-436b-bf2e-b22b064a2e24" containerName="registry" Jul 27 19:29:01.472053 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.471987 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="794725ee-2c6f-436b-bf2e-b22b064a2e24" containerName="registry" Jul 27 19:29:01.551086 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.551050 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh"] Jul 27 19:29:01.551251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.551148 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.555528 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.555503 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-56rv7\"" Jul 27 19:29:01.555679 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.555548 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 27 19:29:01.661003 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.660973 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcthl\" (UniqueName: \"kubernetes.io/projected/f08e2eb6-a162-4147-83ee-b2e452d9a4dd-kube-api-access-zcthl\") pod \"monitoring-plugin-68b7fc9574-c2dbh\" (UID: \"f08e2eb6-a162-4147-83ee-b2e452d9a4dd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.661179 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.661044 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f08e2eb6-a162-4147-83ee-b2e452d9a4dd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-c2dbh\" (UID: \"f08e2eb6-a162-4147-83ee-b2e452d9a4dd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.762067 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.762039 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f08e2eb6-a162-4147-83ee-b2e452d9a4dd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-c2dbh\" (UID: \"f08e2eb6-a162-4147-83ee-b2e452d9a4dd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.762228 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.762204 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcthl\" (UniqueName: \"kubernetes.io/projected/f08e2eb6-a162-4147-83ee-b2e452d9a4dd-kube-api-access-zcthl\") pod \"monitoring-plugin-68b7fc9574-c2dbh\" (UID: \"f08e2eb6-a162-4147-83ee-b2e452d9a4dd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.764635 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.764612 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f08e2eb6-a162-4147-83ee-b2e452d9a4dd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-c2dbh\" (UID: \"f08e2eb6-a162-4147-83ee-b2e452d9a4dd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.770298 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.770277 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcthl\" (UniqueName: \"kubernetes.io/projected/f08e2eb6-a162-4147-83ee-b2e452d9a4dd-kube-api-access-zcthl\") pod \"monitoring-plugin-68b7fc9574-c2dbh\" (UID: \"f08e2eb6-a162-4147-83ee-b2e452d9a4dd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.859558 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.859511 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:01.998000 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:01.997972 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh"] Jul 27 19:29:02.001045 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:29:02.001023 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08e2eb6_a162_4147_83ee_b2e452d9a4dd.slice/crio-f8cfb1f9866dfe692651fcb020cdc2146d15bdab8c161297ec20a137dff34fa4 WatchSource:0}: Error finding container f8cfb1f9866dfe692651fcb020cdc2146d15bdab8c161297ec20a137dff34fa4: Status 404 returned error can't find the container with id f8cfb1f9866dfe692651fcb020cdc2146d15bdab8c161297ec20a137dff34fa4 Jul 27 19:29:02.258562 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:02.258530 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" event={"ID":"f08e2eb6-a162-4147-83ee-b2e452d9a4dd","Type":"ContainerStarted","Data":"f8cfb1f9866dfe692651fcb020cdc2146d15bdab8c161297ec20a137dff34fa4"} Jul 27 19:29:03.142809 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.142728 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65b9cf6db5-4nkhr"] Jul 27 19:29:03.164748 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.164712 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b9cf6db5-4nkhr"] Jul 27 19:29:03.164908 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.164777 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.167698 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.167675 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 19:29:03.168051 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.168027 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 19:29:03.168153 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.168030 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 19:29:03.168909 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.168891 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 19:29:03.168909 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.168903 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 19:29:03.169087 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.168899 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gwndm\"" Jul 27 19:29:03.174143 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.174008 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 19:29:03.274739 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.274699 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-service-ca\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.274920 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.274755 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-oauth-serving-cert\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.274920 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.274816 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-oauth-config\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.274920 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.274883 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-config\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.275070 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.274986 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-serving-cert\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.275070 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.275005 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/1dca7e16-e001-4754-baca-c9f2319a5bd7-kube-api-access-cxdz9\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.275070 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.275026 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-trusted-ca-bundle\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376241 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376206 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-serving-cert\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376241 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376239 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/1dca7e16-e001-4754-baca-c9f2319a5bd7-kube-api-access-cxdz9\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376441 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-trusted-ca-bundle\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376441 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376379 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-service-ca\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376441 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-oauth-serving-cert\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376556 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376489 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-oauth-config\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.376556 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.376516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-config\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.377084 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.377053 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-service-ca\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.377195 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.377148 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-oauth-serving-cert\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.377264 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.377211 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-trusted-ca-bundle\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.377264 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.377225 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-config\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.378937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.378917 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-serving-cert\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.380456 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.380440 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-oauth-config\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.384370 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.384352 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/1dca7e16-e001-4754-baca-c9f2319a5bd7-kube-api-access-cxdz9\") pod \"console-65b9cf6db5-4nkhr\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.477557 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.477488 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:03.611949 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:03.611860 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65b9cf6db5-4nkhr"] Jul 27 19:29:03.614421 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:29:03.614394 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dca7e16_e001_4754_baca_c9f2319a5bd7.slice/crio-65da42e35e2485f1fe277d23bd216ee690652e8dfce01987b8954080083a5a7e WatchSource:0}: Error finding container 65da42e35e2485f1fe277d23bd216ee690652e8dfce01987b8954080083a5a7e: Status 404 returned error can't find the container with id 65da42e35e2485f1fe277d23bd216ee690652e8dfce01987b8954080083a5a7e Jul 27 19:29:04.268316 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:04.268280 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" event={"ID":"f08e2eb6-a162-4147-83ee-b2e452d9a4dd","Type":"ContainerStarted","Data":"60a13a186fe47e257c2387cbd4dfbbdfea4ba4cb0d351065453cc9d8f5550767"} Jul 27 19:29:04.268837 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:04.268528 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:04.269830 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:04.269801 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b9cf6db5-4nkhr" event={"ID":"1dca7e16-e001-4754-baca-c9f2319a5bd7","Type":"ContainerStarted","Data":"65da42e35e2485f1fe277d23bd216ee690652e8dfce01987b8954080083a5a7e"} Jul 27 19:29:04.274262 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:04.274239 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" Jul 27 19:29:04.285373 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:04.285321 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-c2dbh" podStartSLOduration=1.6486960480000001 podStartE2EDuration="3.285304097s" totalImagesPullingTime="1.636608049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:04.284935662 +0000 UTC m=+202.104188298" watchObservedRunningTime="2026-07-27 19:29:04.285304097 +0000 UTC m=+202.104556733" Jul 27 19:29:07.282887 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:07.282847 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b9cf6db5-4nkhr" event={"ID":"1dca7e16-e001-4754-baca-c9f2319a5bd7","Type":"ContainerStarted","Data":"d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50"} Jul 27 19:29:07.301906 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:07.301859 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65b9cf6db5-4nkhr" podStartSLOduration=1.164543985 podStartE2EDuration="4.301844652s" totalImagesPullingTime="3.137300667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:07.300322892 +0000 UTC m=+205.119575527" watchObservedRunningTime="2026-07-27 19:29:07.301844652 +0000 UTC m=+205.121097288" Jul 27 19:29:13.478575 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:13.478539 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:13.479167 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:13.478625 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:13.482914 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:13.482892 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:14.306987 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:14.306960 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:29:44.666667 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:29:44.666631 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c9sj9" podUID="3a0328b5-c52a-438e-a301-6c23bbac4a90" Jul 27 19:29:54.535029 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:54.534971 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:29:54.537346 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:54.537325 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a0328b5-c52a-438e-a301-6c23bbac4a90-metrics-certs\") pod \"network-metrics-daemon-c9sj9\" (UID: \"3a0328b5-c52a-438e-a301-6c23bbac4a90\") " pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:29:55.651688 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:55.651642 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:29:55.654871 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:55.654851 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4682l\"" Jul 27 19:29:55.662082 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:55.662062 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c9sj9" Jul 27 19:29:55.790874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:55.790847 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c9sj9"] Jul 27 19:29:55.794872 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:29:55.794848 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0328b5_c52a_438e_a301_6c23bbac4a90.slice/crio-6fae63eceab6b14c40d8cf3462ffe6fc90a0ef0f057cf2df8b990017984d1936 WatchSource:0}: Error finding container 6fae63eceab6b14c40d8cf3462ffe6fc90a0ef0f057cf2df8b990017984d1936: Status 404 returned error can't find the container with id 6fae63eceab6b14c40d8cf3462ffe6fc90a0ef0f057cf2df8b990017984d1936 Jul 27 19:29:56.440161 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:56.440130 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9sj9" event={"ID":"3a0328b5-c52a-438e-a301-6c23bbac4a90","Type":"ContainerStarted","Data":"6fae63eceab6b14c40d8cf3462ffe6fc90a0ef0f057cf2df8b990017984d1936"} Jul 27 19:29:57.445435 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:57.445399 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9sj9" event={"ID":"3a0328b5-c52a-438e-a301-6c23bbac4a90","Type":"ContainerStarted","Data":"ebfa6e392295edd0228e870d2003cb8078904514af7c34041e28e07a7fcdc530"} Jul 27 19:29:57.445798 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:57.445457 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c9sj9" event={"ID":"3a0328b5-c52a-438e-a301-6c23bbac4a90","Type":"ContainerStarted","Data":"0b79ba0d0739b2adaba8163c62ba5d31b840fbde4a59cbe7aa04d2dc61bc0b91"} Jul 27 19:29:57.470014 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:29:57.469974 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c9sj9" podStartSLOduration=253.436793828 podStartE2EDuration="4m14.469960784s" totalImagesPullingTime="1.033166956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:57.468826276 +0000 UTC m=+255.288078913" watchObservedRunningTime="2026-07-27 19:29:57.469960784 +0000 UTC m=+255.289213419" Jul 27 19:30:21.015889 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.015805 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bb476b6bc-wlsr2"] Jul 27 19:30:21.018285 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.018269 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.020955 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.020932 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 27 19:30:21.021454 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.021431 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p4rc9\"" Jul 27 19:30:21.021555 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.021474 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 27 19:30:21.021555 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.021496 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 27 19:30:21.021555 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.021497 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 27 19:30:21.021727 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.021479 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 27 19:30:21.026851 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.026829 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 27 19:30:21.031188 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.031167 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb476b6bc-wlsr2"] Jul 27 19:30:21.118075 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118030 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967bs\" (UniqueName: \"kubernetes.io/projected/d3dc0b85-42ab-4840-99a0-f63fdadefa20-kube-api-access-967bs\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118075 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118082 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-federate-client-tls\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118240 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118109 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-telemeter-client-tls\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118240 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118174 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-serving-certs-ca-bundle\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118240 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-secret-telemeter-client\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118240 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118228 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-metrics-client-ca\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118375 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118257 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.118375 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.118278 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219010 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.218985 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219124 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219124 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219039 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-967bs\" (UniqueName: \"kubernetes.io/projected/d3dc0b85-42ab-4840-99a0-f63fdadefa20-kube-api-access-967bs\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219219 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219155 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-federate-client-tls\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219219 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-telemeter-client-tls\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219318 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219233 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-serving-certs-ca-bundle\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219318 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219271 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-secret-telemeter-client\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.219318 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.219293 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-metrics-client-ca\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.220171 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.220146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-serving-certs-ca-bundle\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.220281 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.220195 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-metrics-client-ca\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.220281 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.220203 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3dc0b85-42ab-4840-99a0-f63fdadefa20-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.221627 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.221605 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.221769 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.221745 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-telemeter-client-tls\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.222025 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.222008 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-federate-client-tls\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.222125 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.222107 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3dc0b85-42ab-4840-99a0-f63fdadefa20-secret-telemeter-client\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.226510 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.226490 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-967bs\" (UniqueName: \"kubernetes.io/projected/d3dc0b85-42ab-4840-99a0-f63fdadefa20-kube-api-access-967bs\") pod \"telemeter-client-bb476b6bc-wlsr2\" (UID: \"d3dc0b85-42ab-4840-99a0-f63fdadefa20\") " pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.328699 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.328600 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" Jul 27 19:30:21.455765 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.455738 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb476b6bc-wlsr2"] Jul 27 19:30:21.458420 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:30:21.458389 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3dc0b85_42ab_4840_99a0_f63fdadefa20.slice/crio-df6044de2f33a396db417e2fe35371cb2f0d3955182bf80fe6582f93bfc35583 WatchSource:0}: Error finding container df6044de2f33a396db417e2fe35371cb2f0d3955182bf80fe6582f93bfc35583: Status 404 returned error can't find the container with id df6044de2f33a396db417e2fe35371cb2f0d3955182bf80fe6582f93bfc35583 Jul 27 19:30:21.521059 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:21.521027 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" event={"ID":"d3dc0b85-42ab-4840-99a0-f63fdadefa20","Type":"ContainerStarted","Data":"df6044de2f33a396db417e2fe35371cb2f0d3955182bf80fe6582f93bfc35583"} Jul 27 19:30:23.529129 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:23.529100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" event={"ID":"d3dc0b85-42ab-4840-99a0-f63fdadefa20","Type":"ContainerStarted","Data":"c5a5c16f76d475ccbc590cc551156af75a2efe33cb40ea2fa2dd1d373f99e225"} Jul 27 19:30:25.540255 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:25.540214 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" event={"ID":"d3dc0b85-42ab-4840-99a0-f63fdadefa20","Type":"ContainerStarted","Data":"c641ef94d734776d1c5f8bc32449ce2936e6f167c5076b16e855663a2492eed8"} Jul 27 19:30:25.540660 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:25.540269 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" event={"ID":"d3dc0b85-42ab-4840-99a0-f63fdadefa20","Type":"ContainerStarted","Data":"f44c79f9655d7bae411b2ea3eeaef1c3734ba85f4d1a29d80be74ae58386a9a7"} Jul 27 19:30:25.564711 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:25.564657 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bb476b6bc-wlsr2" podStartSLOduration=2.483025831 podStartE2EDuration="5.564643251s" totalImagesPullingTime="3.08161742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:25.563754058 +0000 UTC m=+283.383006694" watchObservedRunningTime="2026-07-27 19:30:25.564643251 +0000 UTC m=+283.383895886" Jul 27 19:30:26.674188 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.674155 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6866cfd5fd-gsfl9"] Jul 27 19:30:26.676383 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.676361 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.690026 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.690004 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6866cfd5fd-gsfl9"] Jul 27 19:30:26.757474 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757443 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-oauth-config\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.757474 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757479 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-trusted-ca-bundle\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.757710 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757493 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-oauth-serving-cert\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.757710 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757513 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-service-ca\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.757710 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757639 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-serving-cert\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.757710 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-config\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.757874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.757726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8jf\" (UniqueName: \"kubernetes.io/projected/7ce2f05d-eb1a-43df-9911-5d7be2d64277-kube-api-access-zl8jf\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.858901 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.858856 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-oauth-config\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.858901 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.858904 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-trusted-ca-bundle\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859119 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.858943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-oauth-serving-cert\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859119 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.858999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-service-ca\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859119 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859051 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-serving-cert\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859119 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859083 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-config\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859119 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8jf\" (UniqueName: \"kubernetes.io/projected/7ce2f05d-eb1a-43df-9911-5d7be2d64277-kube-api-access-zl8jf\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859635 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859613 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-oauth-serving-cert\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859775 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859752 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-config\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.859990 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859975 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-trusted-ca-bundle\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.860028 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.859988 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-service-ca\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.861433 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.861404 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-serving-cert\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.861517 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.861455 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-oauth-config\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.867901 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.867883 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8jf\" (UniqueName: \"kubernetes.io/projected/7ce2f05d-eb1a-43df-9911-5d7be2d64277-kube-api-access-zl8jf\") pod \"console-6866cfd5fd-gsfl9\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:26.985043 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:26.984978 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:27.109130 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:27.109061 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6866cfd5fd-gsfl9"] Jul 27 19:30:27.112632 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:30:27.112601 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce2f05d_eb1a_43df_9911_5d7be2d64277.slice/crio-07c5264ea666684793cbe3ce1075552c10633ed5bf9d8aacd5146a1828c033a8 WatchSource:0}: Error finding container 07c5264ea666684793cbe3ce1075552c10633ed5bf9d8aacd5146a1828c033a8: Status 404 returned error can't find the container with id 07c5264ea666684793cbe3ce1075552c10633ed5bf9d8aacd5146a1828c033a8 Jul 27 19:30:27.548111 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:27.548075 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6866cfd5fd-gsfl9" event={"ID":"7ce2f05d-eb1a-43df-9911-5d7be2d64277","Type":"ContainerStarted","Data":"4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800"} Jul 27 19:30:27.548111 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:27.548118 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6866cfd5fd-gsfl9" event={"ID":"7ce2f05d-eb1a-43df-9911-5d7be2d64277","Type":"ContainerStarted","Data":"07c5264ea666684793cbe3ce1075552c10633ed5bf9d8aacd5146a1828c033a8"} Jul 27 19:30:27.569839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:27.569795 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6866cfd5fd-gsfl9" podStartSLOduration=1.569779682 podStartE2EDuration="1.569779682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:30:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:30:27.567484168 +0000 UTC m=+285.386736803" watchObservedRunningTime="2026-07-27 19:30:27.569779682 +0000 UTC m=+285.389032390" Jul 27 19:30:36.985183 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:36.985156 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:36.985608 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:36.985206 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:36.989697 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:36.989672 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:37.586134 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:37.586107 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:30:37.629926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:37.629903 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65b9cf6db5-4nkhr"] Jul 27 19:30:42.531344 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:30:42.531310 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 19:31:02.648411 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:02.648374 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65b9cf6db5-4nkhr" podUID="1dca7e16-e001-4754-baca-c9f2319a5bd7" containerName="console" containerID="cri-o://d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50" gracePeriod=15 Jul 27 19:31:02.884836 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:02.884813 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:31:03.019553 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019525 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-oauth-serving-cert\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.019730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019562 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-config\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.019730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019606 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-service-ca\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.019730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019640 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-serving-cert\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.019730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019671 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-oauth-config\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.019730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019693 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/1dca7e16-e001-4754-baca-c9f2319a5bd7-kube-api-access-cxdz9\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.019730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.019725 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-trusted-ca-bundle\") pod \"1dca7e16-e001-4754-baca-c9f2319a5bd7\" (UID: \"1dca7e16-e001-4754-baca-c9f2319a5bd7\") " Jul 27 19:31:03.020052 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.020026 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-config" (OuterVolumeSpecName: "console-config") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:31:03.020116 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.020038 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:31:03.020171 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.020147 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-service-ca" (OuterVolumeSpecName: "service-ca") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:31:03.020217 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.020190 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:31:03.022011 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.021991 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:31:03.022106 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.022019 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:31:03.022106 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.022063 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dca7e16-e001-4754-baca-c9f2319a5bd7-kube-api-access-cxdz9" (OuterVolumeSpecName: "kube-api-access-cxdz9") pod "1dca7e16-e001-4754-baca-c9f2319a5bd7" (UID: "1dca7e16-e001-4754-baca-c9f2319a5bd7"). InnerVolumeSpecName "kube-api-access-cxdz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:31:03.120834 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120802 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-oauth-serving-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.120834 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120827 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-config\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.120834 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120836 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.121028 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120845 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-serving-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.121028 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120853 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1dca7e16-e001-4754-baca-c9f2319a5bd7-console-oauth-config\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.121028 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120861 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdz9\" (UniqueName: \"kubernetes.io/projected/1dca7e16-e001-4754-baca-c9f2319a5bd7-kube-api-access-cxdz9\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.121028 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.120868 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dca7e16-e001-4754-baca-c9f2319a5bd7-trusted-ca-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:31:03.667085 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.667051 2584 generic.go:356] "Generic (PLEG): container finished" podID="1dca7e16-e001-4754-baca-c9f2319a5bd7" containerID="d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50" exitCode=0 Jul 27 19:31:03.667456 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.667092 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65b9cf6db5-4nkhr" Jul 27 19:31:03.667456 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.667146 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b9cf6db5-4nkhr" event={"ID":"1dca7e16-e001-4754-baca-c9f2319a5bd7","Type":"ContainerDied","Data":"d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50"} Jul 27 19:31:03.667456 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.667190 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65b9cf6db5-4nkhr" event={"ID":"1dca7e16-e001-4754-baca-c9f2319a5bd7","Type":"ContainerDied","Data":"65da42e35e2485f1fe277d23bd216ee690652e8dfce01987b8954080083a5a7e"} Jul 27 19:31:03.667456 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.667211 2584 scope.go:117] "RemoveContainer" containerID="d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50" Jul 27 19:31:03.675431 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.675413 2584 scope.go:117] "RemoveContainer" containerID="d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50" Jul 27 19:31:03.675722 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:31:03.675703 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50\": container with ID starting with d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50 not found: ID does not exist" containerID="d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50" Jul 27 19:31:03.675785 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.675730 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50"} err="failed to get container status \"d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50\": rpc error: code = NotFound desc = could not find container \"d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50\": container with ID starting with d1fd60edd8ec2f44074319f4309ccfa9275b7a20ce39785f2f0c75f172dbbd50 not found: ID does not exist" Jul 27 19:31:03.687032 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.687012 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65b9cf6db5-4nkhr"] Jul 27 19:31:03.690072 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:03.690054 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65b9cf6db5-4nkhr"] Jul 27 19:31:04.658768 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:04.656796 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dca7e16-e001-4754-baca-c9f2319a5bd7" path="/var/lib/kubelet/pods/1dca7e16-e001-4754-baca-c9f2319a5bd7/volumes" Jul 27 19:31:38.836802 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.836721 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6b8d9cc-xrzfp"] Jul 27 19:31:38.837273 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.837004 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dca7e16-e001-4754-baca-c9f2319a5bd7" containerName="console" Jul 27 19:31:38.837273 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.837016 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dca7e16-e001-4754-baca-c9f2319a5bd7" containerName="console" Jul 27 19:31:38.837273 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.837061 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dca7e16-e001-4754-baca-c9f2319a5bd7" containerName="console" Jul 27 19:31:38.838756 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.838740 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.848684 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.848657 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6b8d9cc-xrzfp"] Jul 27 19:31:38.960839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.960808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-service-ca\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.960839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.960840 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-serving-cert\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.961006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.960865 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-oauth-serving-cert\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.961006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.960885 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-config\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.961006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.960938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-trusted-ca-bundle\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.961006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.960979 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsgl4\" (UniqueName: \"kubernetes.io/projected/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-kube-api-access-vsgl4\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:38.961006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:38.961006 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-oauth-config\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.061874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061845 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-oauth-serving-cert\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.061874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061876 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-config\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061897 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-trusted-ca-bundle\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061913 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsgl4\" (UniqueName: \"kubernetes.io/projected/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-kube-api-access-vsgl4\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061935 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-oauth-config\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061966 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-service-ca\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.061988 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-serving-cert\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062733 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.062704 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-config\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062852 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.062786 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-oauth-serving-cert\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062916 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.062880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-trusted-ca-bundle\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.062957 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.062936 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-service-ca\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.064376 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.064356 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-serving-cert\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.064466 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.064424 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-oauth-config\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.069640 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.069620 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsgl4\" (UniqueName: \"kubernetes.io/projected/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-kube-api-access-vsgl4\") pod \"console-5c6b8d9cc-xrzfp\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.148233 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.148183 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:39.272894 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.272871 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6b8d9cc-xrzfp"] Jul 27 19:31:39.275213 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:31:39.275186 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb79e2a9_eb07_4fb1_aa86_28a2e0cd13cc.slice/crio-6af27379c78c9dd1f4b1c7fc6be99aeb86a3139ffaca69e910a0d92f436f4628 WatchSource:0}: Error finding container 6af27379c78c9dd1f4b1c7fc6be99aeb86a3139ffaca69e910a0d92f436f4628: Status 404 returned error can't find the container with id 6af27379c78c9dd1f4b1c7fc6be99aeb86a3139ffaca69e910a0d92f436f4628 Jul 27 19:31:39.784812 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.784781 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6b8d9cc-xrzfp" event={"ID":"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc","Type":"ContainerStarted","Data":"3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b"} Jul 27 19:31:39.784986 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.784826 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6b8d9cc-xrzfp" event={"ID":"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc","Type":"ContainerStarted","Data":"6af27379c78c9dd1f4b1c7fc6be99aeb86a3139ffaca69e910a0d92f436f4628"} Jul 27 19:31:39.802768 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:39.802716 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6b8d9cc-xrzfp" podStartSLOduration=1.802697358 podStartE2EDuration="1.802697358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:31:39.801736377 +0000 UTC m=+357.620989013" watchObservedRunningTime="2026-07-27 19:31:39.802697358 +0000 UTC m=+357.621949995" Jul 27 19:31:49.149243 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:49.149205 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:49.149684 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:49.149290 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:49.153970 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:49.153950 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:49.820347 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:49.820322 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 19:31:49.867836 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:31:49.867802 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6866cfd5fd-gsfl9"] Jul 27 19:32:14.887043 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:14.887000 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6866cfd5fd-gsfl9" podUID="7ce2f05d-eb1a-43df-9911-5d7be2d64277" containerName="console" containerID="cri-o://4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800" gracePeriod=15 Jul 27 19:32:15.120539 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.120516 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:32:15.225981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.225890 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-oauth-config\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.225981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.225954 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-oauth-serving-cert\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.225981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.225978 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-service-ca\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.226208 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226150 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl8jf\" (UniqueName: \"kubernetes.io/projected/7ce2f05d-eb1a-43df-9911-5d7be2d64277-kube-api-access-zl8jf\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.226253 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226212 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-config\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.226253 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226241 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-trusted-ca-bundle\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.226358 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226294 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-serving-cert\") pod \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\" (UID: \"7ce2f05d-eb1a-43df-9911-5d7be2d64277\") " Jul 27 19:32:15.226358 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226337 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:32:15.226451 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226352 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:32:15.226641 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226606 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-config" (OuterVolumeSpecName: "console-config") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:32:15.226724 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226650 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-oauth-serving-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.226724 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226673 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.226724 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.226707 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:32:15.228403 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.228382 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:32:15.228708 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.228690 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:32:15.228770 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.228711 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ce2f05d-eb1a-43df-9911-5d7be2d64277-kube-api-access-zl8jf" (OuterVolumeSpecName: "kube-api-access-zl8jf") pod "7ce2f05d-eb1a-43df-9911-5d7be2d64277" (UID: "7ce2f05d-eb1a-43df-9911-5d7be2d64277"). InnerVolumeSpecName "kube-api-access-zl8jf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:32:15.327872 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.327820 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-config\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.327872 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.327867 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ce2f05d-eb1a-43df-9911-5d7be2d64277-trusted-ca-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.327872 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.327878 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-serving-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.327872 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.327887 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ce2f05d-eb1a-43df-9911-5d7be2d64277-console-oauth-config\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.328122 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.327897 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl8jf\" (UniqueName: \"kubernetes.io/projected/7ce2f05d-eb1a-43df-9911-5d7be2d64277-kube-api-access-zl8jf\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:15.903505 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.903470 2584 generic.go:356] "Generic (PLEG): container finished" podID="7ce2f05d-eb1a-43df-9911-5d7be2d64277" containerID="4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800" exitCode=0 Jul 27 19:32:15.903943 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.903521 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6866cfd5fd-gsfl9" Jul 27 19:32:15.903943 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.903534 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6866cfd5fd-gsfl9" event={"ID":"7ce2f05d-eb1a-43df-9911-5d7be2d64277","Type":"ContainerDied","Data":"4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800"} Jul 27 19:32:15.903943 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.903602 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6866cfd5fd-gsfl9" event={"ID":"7ce2f05d-eb1a-43df-9911-5d7be2d64277","Type":"ContainerDied","Data":"07c5264ea666684793cbe3ce1075552c10633ed5bf9d8aacd5146a1828c033a8"} Jul 27 19:32:15.903943 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.903609 2584 scope.go:117] "RemoveContainer" containerID="4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800" Jul 27 19:32:15.911504 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.911485 2584 scope.go:117] "RemoveContainer" containerID="4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800" Jul 27 19:32:15.911761 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:32:15.911744 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800\": container with ID starting with 4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800 not found: ID does not exist" containerID="4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800" Jul 27 19:32:15.911814 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.911769 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800"} err="failed to get container status \"4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800\": rpc error: code = NotFound desc = could not find container \"4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800\": container with ID starting with 4bf98f040d9d9d395e19eb6a7a8b701d83b1e8612f2a1acbd159b6c132c7d800 not found: ID does not exist" Jul 27 19:32:15.922625 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.922603 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6866cfd5fd-gsfl9"] Jul 27 19:32:15.925750 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:15.925731 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6866cfd5fd-gsfl9"] Jul 27 19:32:16.655657 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:16.655623 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ce2f05d-eb1a-43df-9911-5d7be2d64277" path="/var/lib/kubelet/pods/7ce2f05d-eb1a-43df-9911-5d7be2d64277/volumes" Jul 27 19:32:31.624767 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.624732 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr"] Jul 27 19:32:31.625132 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.624981 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ce2f05d-eb1a-43df-9911-5d7be2d64277" containerName="console" Jul 27 19:32:31.625132 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.624996 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ce2f05d-eb1a-43df-9911-5d7be2d64277" containerName="console" Jul 27 19:32:31.625132 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.625083 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ce2f05d-eb1a-43df-9911-5d7be2d64277" containerName="console" Jul 27 19:32:31.628054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.628036 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.630668 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.630646 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 19:32:31.630779 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.630645 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9nd9p\"" Jul 27 19:32:31.631826 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.631807 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 19:32:31.636382 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.636359 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr"] Jul 27 19:32:31.741094 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.741060 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.741239 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.741096 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkwfv\" (UniqueName: \"kubernetes.io/projected/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-kube-api-access-tkwfv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.741239 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.741160 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.841906 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.841878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.842064 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.841934 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.842064 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.841951 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkwfv\" (UniqueName: \"kubernetes.io/projected/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-kube-api-access-tkwfv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.842221 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.842198 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.842288 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.842257 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.851720 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.851701 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkwfv\" (UniqueName: \"kubernetes.io/projected/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-kube-api-access-tkwfv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:31.936741 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:31.936677 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:32.059496 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:32.059468 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr"] Jul 27 19:32:32.062633 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:32:32.062562 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb7ba65_bea1_4151_a44e_c0a58b9b23eb.slice/crio-e410064b0d31323d1b07277066e7ed9eea346ea8ac2f0fb16aea4356b1c3d3b7 WatchSource:0}: Error finding container e410064b0d31323d1b07277066e7ed9eea346ea8ac2f0fb16aea4356b1c3d3b7: Status 404 returned error can't find the container with id e410064b0d31323d1b07277066e7ed9eea346ea8ac2f0fb16aea4356b1c3d3b7 Jul 27 19:32:32.064386 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:32.064370 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 19:32:32.962885 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:32.962851 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" event={"ID":"adb7ba65-bea1-4151-a44e-c0a58b9b23eb","Type":"ContainerStarted","Data":"e410064b0d31323d1b07277066e7ed9eea346ea8ac2f0fb16aea4356b1c3d3b7"} Jul 27 19:32:38.985814 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:38.985782 2584 generic.go:356] "Generic (PLEG): container finished" podID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerID="9af5bd8445888e2914f4d75c5ab46d88ef8964de017d9a0e4505e4a5c1612f69" exitCode=0 Jul 27 19:32:38.986204 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:38.985874 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" event={"ID":"adb7ba65-bea1-4151-a44e-c0a58b9b23eb","Type":"ContainerDied","Data":"9af5bd8445888e2914f4d75c5ab46d88ef8964de017d9a0e4505e4a5c1612f69"} Jul 27 19:32:41.998666 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:41.998627 2584 generic.go:356] "Generic (PLEG): container finished" podID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerID="449018d27b04c714998177609b435b43f70863238802e347783a1a454614d454" exitCode=0 Jul 27 19:32:41.999078 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:41.998704 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" event={"ID":"adb7ba65-bea1-4151-a44e-c0a58b9b23eb","Type":"ContainerDied","Data":"449018d27b04c714998177609b435b43f70863238802e347783a1a454614d454"} Jul 27 19:32:49.026669 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:49.026636 2584 generic.go:356] "Generic (PLEG): container finished" podID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerID="ef82520147b0eb80b484c157f2184f4d7a905ba3f0e0304604af402ae11825d9" exitCode=0 Jul 27 19:32:49.027065 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:49.026729 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" event={"ID":"adb7ba65-bea1-4151-a44e-c0a58b9b23eb","Type":"ContainerDied","Data":"ef82520147b0eb80b484c157f2184f4d7a905ba3f0e0304604af402ae11825d9"} Jul 27 19:32:50.142381 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.142358 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:50.171488 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.171458 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-bundle\") pod \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " Jul 27 19:32:50.171667 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.171505 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkwfv\" (UniqueName: \"kubernetes.io/projected/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-kube-api-access-tkwfv\") pod \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " Jul 27 19:32:50.171667 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.171530 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-util\") pod \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\" (UID: \"adb7ba65-bea1-4151-a44e-c0a58b9b23eb\") " Jul 27 19:32:50.172224 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.172185 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-bundle" (OuterVolumeSpecName: "bundle") pod "adb7ba65-bea1-4151-a44e-c0a58b9b23eb" (UID: "adb7ba65-bea1-4151-a44e-c0a58b9b23eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:32:50.174270 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.174242 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-kube-api-access-tkwfv" (OuterVolumeSpecName: "kube-api-access-tkwfv") pod "adb7ba65-bea1-4151-a44e-c0a58b9b23eb" (UID: "adb7ba65-bea1-4151-a44e-c0a58b9b23eb"). InnerVolumeSpecName "kube-api-access-tkwfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:32:50.178371 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.178344 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-util" (OuterVolumeSpecName: "util") pod "adb7ba65-bea1-4151-a44e-c0a58b9b23eb" (UID: "adb7ba65-bea1-4151-a44e-c0a58b9b23eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:32:50.272876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.272842 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkwfv\" (UniqueName: \"kubernetes.io/projected/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-kube-api-access-tkwfv\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:50.272876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.272871 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:50.273038 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:50.272884 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adb7ba65-bea1-4151-a44e-c0a58b9b23eb-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:32:51.034684 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:51.034655 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" Jul 27 19:32:51.034855 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:51.034650 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rtjvr" event={"ID":"adb7ba65-bea1-4151-a44e-c0a58b9b23eb","Type":"ContainerDied","Data":"e410064b0d31323d1b07277066e7ed9eea346ea8ac2f0fb16aea4356b1c3d3b7"} Jul 27 19:32:51.034855 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:51.034787 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e410064b0d31323d1b07277066e7ed9eea346ea8ac2f0fb16aea4356b1c3d3b7" Jul 27 19:32:54.594901 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.594869 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk"] Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595114 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="pull" Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595125 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="pull" Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595133 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="extract" Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595138 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="extract" Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595161 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="util" Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595169 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="util" Jul 27 19:32:54.595251 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.595213 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb7ba65-bea1-4151-a44e-c0a58b9b23eb" containerName="extract" Jul 27 19:32:54.638343 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.638313 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk"] Jul 27 19:32:54.638471 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.638402 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.643795 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.643771 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-x2v98\"" Jul 27 19:32:54.643953 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.643933 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 27 19:32:54.644021 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.644006 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 27 19:32:54.703319 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.703292 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzkj4\" (UniqueName: \"kubernetes.io/projected/e56c12d0-3edf-449c-8a8f-4c2bcf3a418c-kube-api-access-kzkj4\") pod \"cert-manager-operator-controller-manager-55c444bf86-l9lrk\" (UID: \"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.703479 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.703335 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e56c12d0-3edf-449c-8a8f-4c2bcf3a418c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l9lrk\" (UID: \"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.804475 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.804440 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e56c12d0-3edf-449c-8a8f-4c2bcf3a418c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l9lrk\" (UID: \"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.804652 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.804516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkj4\" (UniqueName: \"kubernetes.io/projected/e56c12d0-3edf-449c-8a8f-4c2bcf3a418c-kube-api-access-kzkj4\") pod \"cert-manager-operator-controller-manager-55c444bf86-l9lrk\" (UID: \"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.804811 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.804791 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e56c12d0-3edf-449c-8a8f-4c2bcf3a418c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-l9lrk\" (UID: \"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.814323 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.814296 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzkj4\" (UniqueName: \"kubernetes.io/projected/e56c12d0-3edf-449c-8a8f-4c2bcf3a418c-kube-api-access-kzkj4\") pod \"cert-manager-operator-controller-manager-55c444bf86-l9lrk\" (UID: \"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:54.946560 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:54.946476 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" Jul 27 19:32:55.072736 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:55.072710 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk"] Jul 27 19:32:55.075472 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:32:55.075448 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56c12d0_3edf_449c_8a8f_4c2bcf3a418c.slice/crio-531681c24f4cacacfecb0ef8e495558aefa75c17738699bd37bacab670605ab1 WatchSource:0}: Error finding container 531681c24f4cacacfecb0ef8e495558aefa75c17738699bd37bacab670605ab1: Status 404 returned error can't find the container with id 531681c24f4cacacfecb0ef8e495558aefa75c17738699bd37bacab670605ab1 Jul 27 19:32:56.055034 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:56.055000 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" event={"ID":"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c","Type":"ContainerStarted","Data":"531681c24f4cacacfecb0ef8e495558aefa75c17738699bd37bacab670605ab1"} Jul 27 19:32:58.065143 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:58.065105 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" event={"ID":"e56c12d0-3edf-449c-8a8f-4c2bcf3a418c","Type":"ContainerStarted","Data":"b8e791fbbe6960cb56290a7518de8c2e3c6991e145066b9203a232ef08b25705"} Jul 27 19:32:58.088661 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:58.088612 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-l9lrk" podStartSLOduration=1.955947203 podStartE2EDuration="4.088597087s" totalImagesPullingTime="2.132649884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:32:58.086354651 +0000 UTC m=+435.905607288" watchObservedRunningTime="2026-07-27 19:32:58.088597087 +0000 UTC m=+435.907849714" Jul 27 19:32:59.047354 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.047322 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24"] Jul 27 19:32:59.051362 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.051347 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.054090 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.054070 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 19:32:59.054186 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.054070 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 19:32:59.055023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.055009 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9nd9p\"" Jul 27 19:32:59.065819 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.065794 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24"] Jul 27 19:32:59.136331 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.136296 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.136483 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.136370 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm82n\" (UniqueName: \"kubernetes.io/projected/0646d605-83ce-4f36-81cc-8d6c5a585046-kube-api-access-pm82n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.136483 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.136409 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.237025 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.236995 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.237144 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.237044 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm82n\" (UniqueName: \"kubernetes.io/projected/0646d605-83ce-4f36-81cc-8d6c5a585046-kube-api-access-pm82n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.237144 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.237085 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.237423 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.237404 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.237465 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.237413 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.249681 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.249655 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm82n\" (UniqueName: \"kubernetes.io/projected/0646d605-83ce-4f36-81cc-8d6c5a585046-kube-api-access-pm82n\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.359563 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.359499 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:32:59.490023 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:32:59.489995 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24"] Jul 27 19:32:59.492940 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:32:59.492914 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0646d605_83ce_4f36_81cc_8d6c5a585046.slice/crio-ced9f296bac030d10b6db441e726c41b831078cff211fffee90fe84859f74ff8 WatchSource:0}: Error finding container ced9f296bac030d10b6db441e726c41b831078cff211fffee90fe84859f74ff8: Status 404 returned error can't find the container with id ced9f296bac030d10b6db441e726c41b831078cff211fffee90fe84859f74ff8 Jul 27 19:33:00.073678 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:00.073641 2584 generic.go:356] "Generic (PLEG): container finished" podID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerID="6196bc734e50c0a4944003d241c8c914819e3af6ad5f3cfd13bb11e0c1b4608c" exitCode=0 Jul 27 19:33:00.074024 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:00.073725 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" event={"ID":"0646d605-83ce-4f36-81cc-8d6c5a585046","Type":"ContainerDied","Data":"6196bc734e50c0a4944003d241c8c914819e3af6ad5f3cfd13bb11e0c1b4608c"} Jul 27 19:33:00.074024 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:00.073773 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" event={"ID":"0646d605-83ce-4f36-81cc-8d6c5a585046","Type":"ContainerStarted","Data":"ced9f296bac030d10b6db441e726c41b831078cff211fffee90fe84859f74ff8"} Jul 27 19:33:03.091994 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.091898 2584 generic.go:356] "Generic (PLEG): container finished" podID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerID="1bae28e8720665274e866391287a43b3b292e881597b428e4181e0b2ee502e60" exitCode=0 Jul 27 19:33:03.091994 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.091962 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" event={"ID":"0646d605-83ce-4f36-81cc-8d6c5a585046","Type":"ContainerDied","Data":"1bae28e8720665274e866391287a43b3b292e881597b428e4181e0b2ee502e60"} Jul 27 19:33:03.165025 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.164961 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x"] Jul 27 19:33:03.169924 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.169903 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.172410 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.172389 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 27 19:33:03.172519 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.172440 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 27 19:33:03.172519 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.172473 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ds2gw\"" Jul 27 19:33:03.177015 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.176991 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x"] Jul 27 19:33:03.266325 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.266286 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaef5ee4-069e-48e0-95c4-a55e7750413e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bnj8x\" (UID: \"aaef5ee4-069e-48e0-95c4-a55e7750413e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.266325 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.266336 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxx8f\" (UniqueName: \"kubernetes.io/projected/aaef5ee4-069e-48e0-95c4-a55e7750413e-kube-api-access-dxx8f\") pod \"cert-manager-cainjector-559cdd8c87-bnj8x\" (UID: \"aaef5ee4-069e-48e0-95c4-a55e7750413e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.366785 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.366692 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaef5ee4-069e-48e0-95c4-a55e7750413e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bnj8x\" (UID: \"aaef5ee4-069e-48e0-95c4-a55e7750413e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.366785 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.366739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxx8f\" (UniqueName: \"kubernetes.io/projected/aaef5ee4-069e-48e0-95c4-a55e7750413e-kube-api-access-dxx8f\") pod \"cert-manager-cainjector-559cdd8c87-bnj8x\" (UID: \"aaef5ee4-069e-48e0-95c4-a55e7750413e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.374888 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.374864 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aaef5ee4-069e-48e0-95c4-a55e7750413e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-bnj8x\" (UID: \"aaef5ee4-069e-48e0-95c4-a55e7750413e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.374974 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.374955 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxx8f\" (UniqueName: \"kubernetes.io/projected/aaef5ee4-069e-48e0-95c4-a55e7750413e-kube-api-access-dxx8f\") pod \"cert-manager-cainjector-559cdd8c87-bnj8x\" (UID: \"aaef5ee4-069e-48e0-95c4-a55e7750413e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.486683 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.486648 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" Jul 27 19:33:03.611086 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:03.611055 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x"] Jul 27 19:33:03.614497 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:33:03.614466 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaaef5ee4_069e_48e0_95c4_a55e7750413e.slice/crio-9889a9bbd61f5be05641134b4e26c89ef0ca04087acfada7a49c21a964925e24 WatchSource:0}: Error finding container 9889a9bbd61f5be05641134b4e26c89ef0ca04087acfada7a49c21a964925e24: Status 404 returned error can't find the container with id 9889a9bbd61f5be05641134b4e26c89ef0ca04087acfada7a49c21a964925e24 Jul 27 19:33:04.097825 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:04.097789 2584 generic.go:356] "Generic (PLEG): container finished" podID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerID="10ffeae97b4d91d7a94c702162d3f4692a172f2ea6d6abc6e3451cb7e2aeb62b" exitCode=0 Jul 27 19:33:04.098256 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:04.097880 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" event={"ID":"0646d605-83ce-4f36-81cc-8d6c5a585046","Type":"ContainerDied","Data":"10ffeae97b4d91d7a94c702162d3f4692a172f2ea6d6abc6e3451cb7e2aeb62b"} Jul 27 19:33:04.098992 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:04.098972 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" event={"ID":"aaef5ee4-069e-48e0-95c4-a55e7750413e","Type":"ContainerStarted","Data":"9889a9bbd61f5be05641134b4e26c89ef0ca04087acfada7a49c21a964925e24"} Jul 27 19:33:05.015637 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.015599 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5gfrb"] Jul 27 19:33:05.020075 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.020051 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.022554 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.022536 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8zfdr\"" Jul 27 19:33:05.030307 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.030283 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5gfrb"] Jul 27 19:33:05.078854 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.078821 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ead96dc0-0391-43c1-9d93-7b227ffd492a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5gfrb\" (UID: \"ead96dc0-0391-43c1-9d93-7b227ffd492a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.079011 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.078956 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkptx\" (UniqueName: \"kubernetes.io/projected/ead96dc0-0391-43c1-9d93-7b227ffd492a-kube-api-access-hkptx\") pod \"cert-manager-webhook-6486ffd997-5gfrb\" (UID: \"ead96dc0-0391-43c1-9d93-7b227ffd492a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.179425 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.179385 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkptx\" (UniqueName: \"kubernetes.io/projected/ead96dc0-0391-43c1-9d93-7b227ffd492a-kube-api-access-hkptx\") pod \"cert-manager-webhook-6486ffd997-5gfrb\" (UID: \"ead96dc0-0391-43c1-9d93-7b227ffd492a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.179817 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.179445 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ead96dc0-0391-43c1-9d93-7b227ffd492a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5gfrb\" (UID: \"ead96dc0-0391-43c1-9d93-7b227ffd492a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.188863 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.188835 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ead96dc0-0391-43c1-9d93-7b227ffd492a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5gfrb\" (UID: \"ead96dc0-0391-43c1-9d93-7b227ffd492a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.189137 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.189094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkptx\" (UniqueName: \"kubernetes.io/projected/ead96dc0-0391-43c1-9d93-7b227ffd492a-kube-api-access-hkptx\") pod \"cert-manager-webhook-6486ffd997-5gfrb\" (UID: \"ead96dc0-0391-43c1-9d93-7b227ffd492a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.247717 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.247690 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:33:05.280139 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.279815 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-util\") pod \"0646d605-83ce-4f36-81cc-8d6c5a585046\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " Jul 27 19:33:05.280139 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.279857 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm82n\" (UniqueName: \"kubernetes.io/projected/0646d605-83ce-4f36-81cc-8d6c5a585046-kube-api-access-pm82n\") pod \"0646d605-83ce-4f36-81cc-8d6c5a585046\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " Jul 27 19:33:05.280139 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.279896 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-bundle\") pod \"0646d605-83ce-4f36-81cc-8d6c5a585046\" (UID: \"0646d605-83ce-4f36-81cc-8d6c5a585046\") " Jul 27 19:33:05.280368 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.280322 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-bundle" (OuterVolumeSpecName: "bundle") pod "0646d605-83ce-4f36-81cc-8d6c5a585046" (UID: "0646d605-83ce-4f36-81cc-8d6c5a585046"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:33:05.282846 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.282806 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0646d605-83ce-4f36-81cc-8d6c5a585046-kube-api-access-pm82n" (OuterVolumeSpecName: "kube-api-access-pm82n") pod "0646d605-83ce-4f36-81cc-8d6c5a585046" (UID: "0646d605-83ce-4f36-81cc-8d6c5a585046"). InnerVolumeSpecName "kube-api-access-pm82n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:33:05.285235 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.285199 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-util" (OuterVolumeSpecName: "util") pod "0646d605-83ce-4f36-81cc-8d6c5a585046" (UID: "0646d605-83ce-4f36-81cc-8d6c5a585046"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:33:05.330511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.330483 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:05.380944 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.380913 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm82n\" (UniqueName: \"kubernetes.io/projected/0646d605-83ce-4f36-81cc-8d6c5a585046-kube-api-access-pm82n\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:33:05.380944 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.380946 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:33:05.381139 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.380958 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0646d605-83ce-4f36-81cc-8d6c5a585046-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:33:05.474031 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:05.474006 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5gfrb"] Jul 27 19:33:05.476519 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:33:05.476486 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead96dc0_0391_43c1_9d93_7b227ffd492a.slice/crio-3bac4313ec7cca61e280f9e29a19b85bded3a8685ce28aa9ef66a040bf83f2bf WatchSource:0}: Error finding container 3bac4313ec7cca61e280f9e29a19b85bded3a8685ce28aa9ef66a040bf83f2bf: Status 404 returned error can't find the container with id 3bac4313ec7cca61e280f9e29a19b85bded3a8685ce28aa9ef66a040bf83f2bf Jul 27 19:33:06.109224 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:06.109185 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" event={"ID":"ead96dc0-0391-43c1-9d93-7b227ffd492a","Type":"ContainerStarted","Data":"3bac4313ec7cca61e280f9e29a19b85bded3a8685ce28aa9ef66a040bf83f2bf"} Jul 27 19:33:06.111301 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:06.111270 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" event={"ID":"0646d605-83ce-4f36-81cc-8d6c5a585046","Type":"ContainerDied","Data":"ced9f296bac030d10b6db441e726c41b831078cff211fffee90fe84859f74ff8"} Jul 27 19:33:06.111432 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:06.111318 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvn24" Jul 27 19:33:06.111432 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:06.111319 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ced9f296bac030d10b6db441e726c41b831078cff211fffee90fe84859f74ff8" Jul 27 19:33:07.116783 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:07.116747 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" event={"ID":"aaef5ee4-069e-48e0-95c4-a55e7750413e","Type":"ContainerStarted","Data":"a3b155f5535be2d3fdb42be301c95e05daa2c58201c98ba8cc1270d2c193e4c9"} Jul 27 19:33:07.118193 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:07.118174 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" event={"ID":"ead96dc0-0391-43c1-9d93-7b227ffd492a","Type":"ContainerStarted","Data":"5447fb0ad0478818b235d6e6173ce31fe88201f2d38f7f22c66f8e3681637476"} Jul 27 19:33:07.118268 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:07.118220 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:07.132233 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:07.132182 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-bnj8x" podStartSLOduration=1.34041317 podStartE2EDuration="4.132167157s" totalImagesPullingTime="2.791753987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:07.131312598 +0000 UTC m=+444.950565234" watchObservedRunningTime="2026-07-27 19:33:07.132167157 +0000 UTC m=+444.951419792" Jul 27 19:33:07.147330 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:07.147268 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" podStartSLOduration=2.217995551 podStartE2EDuration="3.147249575s" totalImagesPullingTime="929.254024ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:07.145783839 +0000 UTC m=+444.965036476" watchObservedRunningTime="2026-07-27 19:33:07.147249575 +0000 UTC m=+444.966502213" Jul 27 19:33:13.124114 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:13.124087 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5gfrb" Jul 27 19:33:19.507024 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.506990 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86"] Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507251 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="extract" Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507261 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="extract" Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507280 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="pull" Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507285 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="pull" Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507293 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="util" Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507298 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="util" Jul 27 19:33:19.507402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.507338 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0646d605-83ce-4f36-81cc-8d6c5a585046" containerName="extract" Jul 27 19:33:19.509530 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.509514 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.511881 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.511855 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 19:33:19.512960 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.512938 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9nd9p\"" Jul 27 19:33:19.513011 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.512938 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 19:33:19.519102 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.519080 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86"] Jul 27 19:33:19.581602 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.581553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5rjt\" (UniqueName: \"kubernetes.io/projected/57924c5f-b430-4550-8a55-360f47a10a46-kube-api-access-v5rjt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.581807 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.581615 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.581807 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.581634 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.682343 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.682314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.682473 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.682348 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.682473 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.682409 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5rjt\" (UniqueName: \"kubernetes.io/projected/57924c5f-b430-4550-8a55-360f47a10a46-kube-api-access-v5rjt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.682690 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.682671 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.682809 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.682709 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.691169 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.691142 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5rjt\" (UniqueName: \"kubernetes.io/projected/57924c5f-b430-4550-8a55-360f47a10a46-kube-api-access-v5rjt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.818145 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.818080 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:19.941263 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:19.941148 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86"] Jul 27 19:33:19.943187 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:33:19.943163 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57924c5f_b430_4550_8a55_360f47a10a46.slice/crio-8959ee16c918e0b8ccb547a2018f341835d30daea338d81e301db2aa38fba622 WatchSource:0}: Error finding container 8959ee16c918e0b8ccb547a2018f341835d30daea338d81e301db2aa38fba622: Status 404 returned error can't find the container with id 8959ee16c918e0b8ccb547a2018f341835d30daea338d81e301db2aa38fba622 Jul 27 19:33:20.175131 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:20.175044 2584 generic.go:356] "Generic (PLEG): container finished" podID="57924c5f-b430-4550-8a55-360f47a10a46" containerID="383ae5c3e95dcbca2ea9e7f3a90324a751dcb3146be8bcbca829346961392716" exitCode=0 Jul 27 19:33:20.175260 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:20.175118 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" event={"ID":"57924c5f-b430-4550-8a55-360f47a10a46","Type":"ContainerDied","Data":"383ae5c3e95dcbca2ea9e7f3a90324a751dcb3146be8bcbca829346961392716"} Jul 27 19:33:20.175260 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:20.175189 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" event={"ID":"57924c5f-b430-4550-8a55-360f47a10a46","Type":"ContainerStarted","Data":"8959ee16c918e0b8ccb547a2018f341835d30daea338d81e301db2aa38fba622"} Jul 27 19:33:21.181354 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:21.181322 2584 generic.go:356] "Generic (PLEG): container finished" podID="57924c5f-b430-4550-8a55-360f47a10a46" containerID="1a64c13ba6f5472e4dcfadaf5053d0c00d5845e616f31009ae8d77faabc5bd45" exitCode=0 Jul 27 19:33:21.181714 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:21.181389 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" event={"ID":"57924c5f-b430-4550-8a55-360f47a10a46","Type":"ContainerDied","Data":"1a64c13ba6f5472e4dcfadaf5053d0c00d5845e616f31009ae8d77faabc5bd45"} Jul 27 19:33:22.187049 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:22.187016 2584 generic.go:356] "Generic (PLEG): container finished" podID="57924c5f-b430-4550-8a55-360f47a10a46" containerID="ecbc7f8c84decfffad8dfabfa4a8f0722ffd00d0b9797cd99c2ed32f6c52599a" exitCode=0 Jul 27 19:33:22.187399 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:22.187056 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" event={"ID":"57924c5f-b430-4550-8a55-360f47a10a46","Type":"ContainerDied","Data":"ecbc7f8c84decfffad8dfabfa4a8f0722ffd00d0b9797cd99c2ed32f6c52599a"} Jul 27 19:33:23.329426 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.329392 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:23.410865 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.410825 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-bundle\") pod \"57924c5f-b430-4550-8a55-360f47a10a46\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " Jul 27 19:33:23.411043 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.410889 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-util\") pod \"57924c5f-b430-4550-8a55-360f47a10a46\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " Jul 27 19:33:23.411043 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.410942 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5rjt\" (UniqueName: \"kubernetes.io/projected/57924c5f-b430-4550-8a55-360f47a10a46-kube-api-access-v5rjt\") pod \"57924c5f-b430-4550-8a55-360f47a10a46\" (UID: \"57924c5f-b430-4550-8a55-360f47a10a46\") " Jul 27 19:33:23.411575 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.411549 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-bundle" (OuterVolumeSpecName: "bundle") pod "57924c5f-b430-4550-8a55-360f47a10a46" (UID: "57924c5f-b430-4550-8a55-360f47a10a46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:33:23.413047 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.413024 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57924c5f-b430-4550-8a55-360f47a10a46-kube-api-access-v5rjt" (OuterVolumeSpecName: "kube-api-access-v5rjt") pod "57924c5f-b430-4550-8a55-360f47a10a46" (UID: "57924c5f-b430-4550-8a55-360f47a10a46"). InnerVolumeSpecName "kube-api-access-v5rjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:33:23.415684 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.415646 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-util" (OuterVolumeSpecName: "util") pod "57924c5f-b430-4550-8a55-360f47a10a46" (UID: "57924c5f-b430-4550-8a55-360f47a10a46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:33:23.511820 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.511791 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:33:23.511820 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.511818 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57924c5f-b430-4550-8a55-360f47a10a46-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:33:23.511990 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:23.511829 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5rjt\" (UniqueName: \"kubernetes.io/projected/57924c5f-b430-4550-8a55-360f47a10a46-kube-api-access-v5rjt\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:33:24.196926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:24.196900 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" Jul 27 19:33:24.196926 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:24.196918 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpsl86" event={"ID":"57924c5f-b430-4550-8a55-360f47a10a46","Type":"ContainerDied","Data":"8959ee16c918e0b8ccb547a2018f341835d30daea338d81e301db2aa38fba622"} Jul 27 19:33:24.197132 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:24.196964 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8959ee16c918e0b8ccb547a2018f341835d30daea338d81e301db2aa38fba622" Jul 27 19:33:31.594089 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.594049 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp"] Jul 27 19:33:31.594933 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.594914 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="pull" Jul 27 19:33:31.595035 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.595027 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="pull" Jul 27 19:33:31.595129 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.595120 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="util" Jul 27 19:33:31.595240 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.595232 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="util" Jul 27 19:33:31.595308 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.595300 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="extract" Jul 27 19:33:31.595368 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.595360 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="extract" Jul 27 19:33:31.595503 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.595494 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="57924c5f-b430-4550-8a55-360f47a10a46" containerName="extract" Jul 27 19:33:31.604601 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.599490 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.612533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.611957 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 27 19:33:31.612533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.612004 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 27 19:33:31.612533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.612109 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 27 19:33:31.612533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.612121 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 27 19:33:31.612533 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.611957 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lhqz6\"" Jul 27 19:33:31.615804 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.615781 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp"] Jul 27 19:33:31.666447 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.666417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-manifests\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.666631 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.666468 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.666631 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.666510 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.666631 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.666534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrfp\" (UniqueName: \"kubernetes.io/projected/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-kube-api-access-fvrfp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.666749 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.666643 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-tmp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.767761 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.767729 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-manifests\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.767918 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.767782 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.767918 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.767802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.767918 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.767820 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrfp\" (UniqueName: \"kubernetes.io/projected/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-kube-api-access-fvrfp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.768075 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.767987 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-tmp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.768131 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.768114 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-manifests\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.770195 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.770168 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-tmp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.770293 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.770255 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.770412 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.770392 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-webhook-cert\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.777566 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.777523 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrfp\" (UniqueName: \"kubernetes.io/projected/0c9de81e-d59f-42a3-818e-ecc9903cd5e5-kube-api-access-fvrfp\") pod \"opendatahub-operator-controller-manager-787b9f94c8-fxvkp\" (UID: \"0c9de81e-d59f-42a3-818e-ecc9903cd5e5\") " pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:31.923731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:31.923651 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:32.053649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:32.053619 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp"] Jul 27 19:33:32.056603 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:33:32.056566 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9de81e_d59f_42a3_818e_ecc9903cd5e5.slice/crio-1b8d3aa753675598cb3ffeef100c2f74ef5733be399091ef5cb6b1b699c38fc7 WatchSource:0}: Error finding container 1b8d3aa753675598cb3ffeef100c2f74ef5733be399091ef5cb6b1b699c38fc7: Status 404 returned error can't find the container with id 1b8d3aa753675598cb3ffeef100c2f74ef5733be399091ef5cb6b1b699c38fc7 Jul 27 19:33:32.227619 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:32.227515 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" event={"ID":"0c9de81e-d59f-42a3-818e-ecc9903cd5e5","Type":"ContainerStarted","Data":"1b8d3aa753675598cb3ffeef100c2f74ef5733be399091ef5cb6b1b699c38fc7"} Jul 27 19:33:36.249420 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:36.249381 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" event={"ID":"0c9de81e-d59f-42a3-818e-ecc9903cd5e5","Type":"ContainerStarted","Data":"f7472ba16e6339e51cb81ddfa7c0a3e3940f2e92ad17461213e13908ff53af6e"} Jul 27 19:33:37.257279 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:37.257243 2584 generic.go:356] "Generic (PLEG): container finished" podID="0c9de81e-d59f-42a3-818e-ecc9903cd5e5" containerID="f7472ba16e6339e51cb81ddfa7c0a3e3940f2e92ad17461213e13908ff53af6e" exitCode=0 Jul 27 19:33:37.257683 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:37.257329 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" event={"ID":"0c9de81e-d59f-42a3-818e-ecc9903cd5e5","Type":"ContainerDied","Data":"f7472ba16e6339e51cb81ddfa7c0a3e3940f2e92ad17461213e13908ff53af6e"} Jul 27 19:33:38.262712 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:38.262683 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" event={"ID":"0c9de81e-d59f-42a3-818e-ecc9903cd5e5","Type":"ContainerStarted","Data":"6fdc026500a62d105de2f06412e41aaab34ad0a3423b31ddef0333ccd3938250"} Jul 27 19:33:38.263116 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:38.262810 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:38.286138 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:38.286094 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" podStartSLOduration=2.707620333 podStartE2EDuration="7.286080326s" totalImagesPullingTime="3.593308532s" totalInitContainerRuntime="985.151461ms" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:38.283309709 +0000 UTC m=+476.102562378" watchObservedRunningTime="2026-07-27 19:33:38.286080326 +0000 UTC m=+476.105332960" Jul 27 19:33:49.268989 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:49.268957 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-787b9f94c8-fxvkp" Jul 27 19:33:50.073488 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.073457 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg"] Jul 27 19:33:50.079131 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.079114 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.081552 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.081530 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 27 19:33:50.082724 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.082708 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 27 19:33:50.082805 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.082752 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 27 19:33:50.082805 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.082781 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 27 19:33:50.082897 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.082811 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 27 19:33:50.082934 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.082903 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zvgdk\"" Jul 27 19:33:50.089598 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.089558 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg"] Jul 27 19:33:50.206682 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.206649 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jq6j\" (UniqueName: \"kubernetes.io/projected/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-kube-api-access-2jq6j\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.206817 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.206687 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-metrics-cert\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.206817 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.206713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-manager-config\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.206817 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.206814 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-cert\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.307632 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.307594 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-cert\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.308069 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.307641 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jq6j\" (UniqueName: \"kubernetes.io/projected/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-kube-api-access-2jq6j\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.308069 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.307673 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-metrics-cert\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.308069 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.307698 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-manager-config\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.308638 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.308614 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-manager-config\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.310292 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.310259 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-metrics-cert\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.310939 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.310919 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-cert\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.315522 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.315499 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jq6j\" (UniqueName: \"kubernetes.io/projected/f0ded0b5-3132-4600-aa28-1988ccd1c2d5-kube-api-access-2jq6j\") pod \"lws-controller-manager-8cbf9cd8b-zkhvg\" (UID: \"f0ded0b5-3132-4600-aa28-1988ccd1c2d5\") " pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.388171 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.388101 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:50.536285 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:50.536255 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg"] Jul 27 19:33:50.540391 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:33:50.540364 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ded0b5_3132_4600_aa28_1988ccd1c2d5.slice/crio-5687966d2d0e52645d7c391f12519c74c25c5ac935eca8afcea78f989cc07c6c WatchSource:0}: Error finding container 5687966d2d0e52645d7c391f12519c74c25c5ac935eca8afcea78f989cc07c6c: Status 404 returned error can't find the container with id 5687966d2d0e52645d7c391f12519c74c25c5ac935eca8afcea78f989cc07c6c Jul 27 19:33:51.318628 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:51.318598 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" event={"ID":"f0ded0b5-3132-4600-aa28-1988ccd1c2d5","Type":"ContainerStarted","Data":"5687966d2d0e52645d7c391f12519c74c25c5ac935eca8afcea78f989cc07c6c"} Jul 27 19:33:52.325712 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:52.325672 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" event={"ID":"f0ded0b5-3132-4600-aa28-1988ccd1c2d5","Type":"ContainerStarted","Data":"305f55ffbb2992b04c795d790cd1a4b00330646a7e1458ff253f5513d5f56b1c"} Jul 27 19:33:52.326071 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:52.325806 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:33:52.345866 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:33:52.345813 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" podStartSLOduration=0.675885305 podStartE2EDuration="2.345796966s" totalImagesPullingTime="1.669911661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:33:52.344448813 +0000 UTC m=+490.163701451" watchObservedRunningTime="2026-07-27 19:33:52.345796966 +0000 UTC m=+490.165049652" Jul 27 19:34:00.872377 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.872343 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v"] Jul 27 19:34:00.875546 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.875531 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.879227 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.879205 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 27 19:34:00.879323 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.879252 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6ks5w\"" Jul 27 19:34:00.879323 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.879314 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 27 19:34:00.879629 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.879609 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 27 19:34:00.879629 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.879623 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 27 19:34:00.879788 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.879634 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 19:34:00.880402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.880384 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 19:34:00.890118 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.890094 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v"] Jul 27 19:34:00.987832 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.987804 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.987981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.987840 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.987981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.987873 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b6987a-698f-4b20-afa1-04dbe16296b8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.987981 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.987910 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.988076 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.987982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4nxt\" (UniqueName: \"kubernetes.io/projected/65b6987a-698f-4b20-afa1-04dbe16296b8-kube-api-access-l4nxt\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.988076 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.988038 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:00.988140 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:00.988081 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088687 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088637 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088687 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088695 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088721 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088747 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b6987a-698f-4b20-afa1-04dbe16296b8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088793 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.088925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.088829 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4nxt\" (UniqueName: \"kubernetes.io/projected/65b6987a-698f-4b20-afa1-04dbe16296b8-kube-api-access-l4nxt\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.089732 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.089702 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.091149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.091121 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b6987a-698f-4b20-afa1-04dbe16296b8-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.091389 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.091368 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.091448 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.091368 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.091448 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.091377 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.105839 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.105817 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4nxt\" (UniqueName: \"kubernetes.io/projected/65b6987a-698f-4b20-afa1-04dbe16296b8-kube-api-access-l4nxt\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.106224 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.106208 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b6987a-698f-4b20-afa1-04dbe16296b8-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-xds6v\" (UID: \"65b6987a-698f-4b20-afa1-04dbe16296b8\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.184930 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.184864 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:01.336485 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.336448 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v"] Jul 27 19:34:01.340058 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:34:01.340025 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b6987a_698f_4b20_afa1_04dbe16296b8.slice/crio-1d415031d8d039159ee5899d9cd72366e41d8ae0dfdbd38f7370085776ba4344 WatchSource:0}: Error finding container 1d415031d8d039159ee5899d9cd72366e41d8ae0dfdbd38f7370085776ba4344: Status 404 returned error can't find the container with id 1d415031d8d039159ee5899d9cd72366e41d8ae0dfdbd38f7370085776ba4344 Jul 27 19:34:01.361002 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:01.360967 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" event={"ID":"65b6987a-698f-4b20-afa1-04dbe16296b8","Type":"ContainerStarted","Data":"1d415031d8d039159ee5899d9cd72366e41d8ae0dfdbd38f7370085776ba4344"} Jul 27 19:34:03.332750 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:03.332719 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8cbf9cd8b-zkhvg" Jul 27 19:34:03.925761 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:03.925723 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 27 19:34:03.925857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:03.925787 2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 27 19:34:04.378797 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:04.378751 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" event={"ID":"65b6987a-698f-4b20-afa1-04dbe16296b8","Type":"ContainerStarted","Data":"68e44289fcc1284b88b86d43627532b42952582bacbd1af669ef6275be0e62b9"} Jul 27 19:34:04.379270 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:04.379016 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:34:04.380929 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:04.380646 2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-xds6v container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 27 19:34:04.380929 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:04.380695 2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" podUID="65b6987a-698f-4b20-afa1-04dbe16296b8" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 19:34:04.434604 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:04.434532 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" podStartSLOduration=1.850951612 podStartE2EDuration="4.434517523s" totalImagesPullingTime="2.583565911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:34:04.430191484 +0000 UTC m=+502.249444115" watchObservedRunningTime="2026-07-27 19:34:04.434517523 +0000 UTC m=+502.253770159" Jul 27 19:34:05.388206 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:34:05.388170 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-xds6v" Jul 27 19:35:08.223371 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.223341 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb"] Jul 27 19:35:08.225675 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.225658 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.228146 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.228112 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 27 19:35:08.228266 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.228158 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 27 19:35:08.229335 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.229317 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pc9j\"" Jul 27 19:35:08.234143 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.234122 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb"] Jul 27 19:35:08.272335 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.272301 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tg5p\" (UniqueName: \"kubernetes.io/projected/c5bb441d-01c7-41a0-820a-6d51eb3c5471-kube-api-access-6tg5p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.272443 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.272361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.272443 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.272389 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.372743 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.372714 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.372866 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.372754 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.372866 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.372775 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tg5p\" (UniqueName: \"kubernetes.io/projected/c5bb441d-01c7-41a0-820a-6d51eb3c5471-kube-api-access-6tg5p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.373164 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.373143 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.373203 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.373156 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.380462 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.380437 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tg5p\" (UniqueName: \"kubernetes.io/projected/c5bb441d-01c7-41a0-820a-6d51eb3c5471-kube-api-access-6tg5p\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.535142 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.535118 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:08.664900 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.664878 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb"] Jul 27 19:35:08.666691 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:35:08.666663 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bb441d_01c7_41a0_820a_6d51eb3c5471.slice/crio-59fe972fc14859a8f41e168d3d285db82634776714b082348ed5255f328c1f8c WatchSource:0}: Error finding container 59fe972fc14859a8f41e168d3d285db82634776714b082348ed5255f328c1f8c: Status 404 returned error can't find the container with id 59fe972fc14859a8f41e168d3d285db82634776714b082348ed5255f328c1f8c Jul 27 19:35:08.830256 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.830192 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26"] Jul 27 19:35:08.832164 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.832150 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.843752 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.843715 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26"] Jul 27 19:35:08.876289 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.876253 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.876437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.876296 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kw7w\" (UniqueName: \"kubernetes.io/projected/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-kube-api-access-5kw7w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.876437 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.876380 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.976925 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.976891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.977058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.976930 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.977058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.976956 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kw7w\" (UniqueName: \"kubernetes.io/projected/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-kube-api-access-5kw7w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.977302 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.977282 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.977337 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.977312 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:08.985335 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:08.985314 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kw7w\" (UniqueName: \"kubernetes.io/projected/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-kube-api-access-5kw7w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:09.140738 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.140669 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:09.276097 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.276073 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26"] Jul 27 19:35:09.278167 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:35:09.278142 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c22f5d5_14c8_4180_b643_3fd24e99d8b8.slice/crio-75d1d05fda69242c451492d712f563e33e03ead6b3101cf1c9cbf91bbfe8529f WatchSource:0}: Error finding container 75d1d05fda69242c451492d712f563e33e03ead6b3101cf1c9cbf91bbfe8529f: Status 404 returned error can't find the container with id 75d1d05fda69242c451492d712f563e33e03ead6b3101cf1c9cbf91bbfe8529f Jul 27 19:35:09.428665 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.428642 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf"] Jul 27 19:35:09.430968 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.430950 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.439212 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.439193 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf"] Jul 27 19:35:09.481474 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.481450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.481631 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.481478 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfd2c\" (UniqueName: \"kubernetes.io/projected/7b0ed047-ed64-409c-a639-2824423ca06f-kube-api-access-tfd2c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.481631 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.481502 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.582796 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.582760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.582796 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.582800 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfd2c\" (UniqueName: \"kubernetes.io/projected/7b0ed047-ed64-409c-a639-2824423ca06f-kube-api-access-tfd2c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.582993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.582831 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.583165 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.583148 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.583203 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.583150 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.590464 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.590439 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfd2c\" (UniqueName: \"kubernetes.io/projected/7b0ed047-ed64-409c-a639-2824423ca06f-kube-api-access-tfd2c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.656920 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.656893 2584 generic.go:356] "Generic (PLEG): container finished" podID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerID="0e35fecca7881cf7d7ec84db734fe0940a65f3f38b449af2c592e5f8f4a986a5" exitCode=0 Jul 27 19:35:09.657055 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.656978 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" event={"ID":"0c22f5d5-14c8-4180-b643-3fd24e99d8b8","Type":"ContainerDied","Data":"0e35fecca7881cf7d7ec84db734fe0940a65f3f38b449af2c592e5f8f4a986a5"} Jul 27 19:35:09.657055 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.657023 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" event={"ID":"0c22f5d5-14c8-4180-b643-3fd24e99d8b8","Type":"ContainerStarted","Data":"75d1d05fda69242c451492d712f563e33e03ead6b3101cf1c9cbf91bbfe8529f"} Jul 27 19:35:09.658517 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.658498 2584 generic.go:356] "Generic (PLEG): container finished" podID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerID="1bdf4fa4fa7db82f6bef2f4699d42578ad8d859e48a342ec69c85b13d248d085" exitCode=0 Jul 27 19:35:09.658636 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.658530 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" event={"ID":"c5bb441d-01c7-41a0-820a-6d51eb3c5471","Type":"ContainerDied","Data":"1bdf4fa4fa7db82f6bef2f4699d42578ad8d859e48a342ec69c85b13d248d085"} Jul 27 19:35:09.658636 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.658558 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" event={"ID":"c5bb441d-01c7-41a0-820a-6d51eb3c5471","Type":"ContainerStarted","Data":"59fe972fc14859a8f41e168d3d285db82634776714b082348ed5255f328c1f8c"} Jul 27 19:35:09.740357 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.740290 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:09.827763 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.827734 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98"] Jul 27 19:35:09.830169 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.830151 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.841447 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.841416 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98"] Jul 27 19:35:09.867255 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.867233 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf"] Jul 27 19:35:09.869074 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:35:09.869049 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0ed047_ed64_409c_a639_2824423ca06f.slice/crio-45448295e89c2b8cf2502e74a308997509223635c1d5cef0c5ed6e0fecf13204 WatchSource:0}: Error finding container 45448295e89c2b8cf2502e74a308997509223635c1d5cef0c5ed6e0fecf13204: Status 404 returned error can't find the container with id 45448295e89c2b8cf2502e74a308997509223635c1d5cef0c5ed6e0fecf13204 Jul 27 19:35:09.885628 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.885607 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.885688 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.885641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.885726 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.885684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctbg6\" (UniqueName: \"kubernetes.io/projected/02e1e877-242d-4814-8ee6-80c51135e86a-kube-api-access-ctbg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.986645 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.986618 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.986864 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.986652 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.986864 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.986706 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctbg6\" (UniqueName: \"kubernetes.io/projected/02e1e877-242d-4814-8ee6-80c51135e86a-kube-api-access-ctbg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.986977 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.986962 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.987054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.987035 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:09.994456 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:09.994410 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctbg6\" (UniqueName: \"kubernetes.io/projected/02e1e877-242d-4814-8ee6-80c51135e86a-kube-api-access-ctbg6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:10.142329 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.142282 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:10.278645 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.278617 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98"] Jul 27 19:35:10.287104 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:35:10.287077 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e1e877_242d_4814_8ee6_80c51135e86a.slice/crio-ec6c5a912ea40b4c22bf90e1aee4d623ea9d42314f62a044c43ba4114c0d27d0 WatchSource:0}: Error finding container ec6c5a912ea40b4c22bf90e1aee4d623ea9d42314f62a044c43ba4114c0d27d0: Status 404 returned error can't find the container with id ec6c5a912ea40b4c22bf90e1aee4d623ea9d42314f62a044c43ba4114c0d27d0 Jul 27 19:35:10.664511 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.664478 2584 generic.go:356] "Generic (PLEG): container finished" podID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerID="54747e7051f401fb2d33965650690b7217d6f3cd7b88791b5a52f4a152439791" exitCode=0 Jul 27 19:35:10.664656 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.664561 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" event={"ID":"c5bb441d-01c7-41a0-820a-6d51eb3c5471","Type":"ContainerDied","Data":"54747e7051f401fb2d33965650690b7217d6f3cd7b88791b5a52f4a152439791"} Jul 27 19:35:10.666054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.665909 2584 generic.go:356] "Generic (PLEG): container finished" podID="02e1e877-242d-4814-8ee6-80c51135e86a" containerID="d5043ecf0b7f2523fa5e38002a7dd78a85113c16b5d734ee564953ef82951711" exitCode=0 Jul 27 19:35:10.666054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.665973 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" event={"ID":"02e1e877-242d-4814-8ee6-80c51135e86a","Type":"ContainerDied","Data":"d5043ecf0b7f2523fa5e38002a7dd78a85113c16b5d734ee564953ef82951711"} Jul 27 19:35:10.666054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.666036 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" event={"ID":"02e1e877-242d-4814-8ee6-80c51135e86a","Type":"ContainerStarted","Data":"ec6c5a912ea40b4c22bf90e1aee4d623ea9d42314f62a044c43ba4114c0d27d0"} Jul 27 19:35:10.667694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.667675 2584 generic.go:356] "Generic (PLEG): container finished" podID="7b0ed047-ed64-409c-a639-2824423ca06f" containerID="7e81ac8614770f6b07df4e13531f5bc4a7698c2677371f021c77115371a40c51" exitCode=0 Jul 27 19:35:10.667801 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.667727 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" event={"ID":"7b0ed047-ed64-409c-a639-2824423ca06f","Type":"ContainerDied","Data":"7e81ac8614770f6b07df4e13531f5bc4a7698c2677371f021c77115371a40c51"} Jul 27 19:35:10.667801 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:10.667753 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" event={"ID":"7b0ed047-ed64-409c-a639-2824423ca06f","Type":"ContainerStarted","Data":"45448295e89c2b8cf2502e74a308997509223635c1d5cef0c5ed6e0fecf13204"} Jul 27 19:35:11.678828 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.678759 2584 generic.go:356] "Generic (PLEG): container finished" podID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerID="d0e1e57001062491ba12bf4bf7efd8b0150a694ecd502a04fccc94adc04f5895" exitCode=0 Jul 27 19:35:11.679219 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.678843 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" event={"ID":"c5bb441d-01c7-41a0-820a-6d51eb3c5471","Type":"ContainerDied","Data":"d0e1e57001062491ba12bf4bf7efd8b0150a694ecd502a04fccc94adc04f5895"} Jul 27 19:35:11.680676 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.680655 2584 generic.go:356] "Generic (PLEG): container finished" podID="02e1e877-242d-4814-8ee6-80c51135e86a" containerID="88639280d17155203124af05b173b6720d2e12bab8aadcc226bcce0a78f3ce70" exitCode=0 Jul 27 19:35:11.680784 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.680702 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" event={"ID":"02e1e877-242d-4814-8ee6-80c51135e86a","Type":"ContainerDied","Data":"88639280d17155203124af05b173b6720d2e12bab8aadcc226bcce0a78f3ce70"} Jul 27 19:35:11.682458 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.682439 2584 generic.go:356] "Generic (PLEG): container finished" podID="7b0ed047-ed64-409c-a639-2824423ca06f" containerID="1a7da07de72d7ebc7db6aa6f9cbf7381fad1917e89d46e9f29aec1eba788c073" exitCode=0 Jul 27 19:35:11.682537 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.682516 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" event={"ID":"7b0ed047-ed64-409c-a639-2824423ca06f","Type":"ContainerDied","Data":"1a7da07de72d7ebc7db6aa6f9cbf7381fad1917e89d46e9f29aec1eba788c073"} Jul 27 19:35:11.684509 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.684491 2584 generic.go:356] "Generic (PLEG): container finished" podID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerID="b924f5b32f49156dc5e3ce41362d7c43a9ab87744d1dcdfa30cde72003e076a4" exitCode=0 Jul 27 19:35:11.684615 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:11.684514 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" event={"ID":"0c22f5d5-14c8-4180-b643-3fd24e99d8b8","Type":"ContainerDied","Data":"b924f5b32f49156dc5e3ce41362d7c43a9ab87744d1dcdfa30cde72003e076a4"} Jul 27 19:35:12.690388 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.690293 2584 generic.go:356] "Generic (PLEG): container finished" podID="02e1e877-242d-4814-8ee6-80c51135e86a" containerID="6b251d89b56fa8689fe60f2052e89f3cc5fa4974b165fcf95f0343e7200cdb81" exitCode=0 Jul 27 19:35:12.690388 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.690327 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" event={"ID":"02e1e877-242d-4814-8ee6-80c51135e86a","Type":"ContainerDied","Data":"6b251d89b56fa8689fe60f2052e89f3cc5fa4974b165fcf95f0343e7200cdb81"} Jul 27 19:35:12.692237 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.692217 2584 generic.go:356] "Generic (PLEG): container finished" podID="7b0ed047-ed64-409c-a639-2824423ca06f" containerID="af6ff2cced8aa15ea558b2ac3c198c3c498cf99a7fb2e4d50af1fb6b4888709d" exitCode=0 Jul 27 19:35:12.692345 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.692303 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" event={"ID":"7b0ed047-ed64-409c-a639-2824423ca06f","Type":"ContainerDied","Data":"af6ff2cced8aa15ea558b2ac3c198c3c498cf99a7fb2e4d50af1fb6b4888709d"} Jul 27 19:35:12.694146 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.694118 2584 generic.go:356] "Generic (PLEG): container finished" podID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerID="b42d3f0c95532ade25e2710d5678bd7d3ca34a6d26a3a5c14b6d28c66c608aab" exitCode=0 Jul 27 19:35:12.694249 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.694183 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" event={"ID":"0c22f5d5-14c8-4180-b643-3fd24e99d8b8","Type":"ContainerDied","Data":"b42d3f0c95532ade25e2710d5678bd7d3ca34a6d26a3a5c14b6d28c66c608aab"} Jul 27 19:35:12.821268 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.821246 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:12.910188 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.910159 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-bundle\") pod \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " Jul 27 19:35:12.910359 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.910220 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-util\") pod \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " Jul 27 19:35:12.910359 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.910248 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tg5p\" (UniqueName: \"kubernetes.io/projected/c5bb441d-01c7-41a0-820a-6d51eb3c5471-kube-api-access-6tg5p\") pod \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\" (UID: \"c5bb441d-01c7-41a0-820a-6d51eb3c5471\") " Jul 27 19:35:12.910755 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.910730 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-bundle" (OuterVolumeSpecName: "bundle") pod "c5bb441d-01c7-41a0-820a-6d51eb3c5471" (UID: "c5bb441d-01c7-41a0-820a-6d51eb3c5471"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:12.912526 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.912504 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bb441d-01c7-41a0-820a-6d51eb3c5471-kube-api-access-6tg5p" (OuterVolumeSpecName: "kube-api-access-6tg5p") pod "c5bb441d-01c7-41a0-820a-6d51eb3c5471" (UID: "c5bb441d-01c7-41a0-820a-6d51eb3c5471"). InnerVolumeSpecName "kube-api-access-6tg5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:35:12.915755 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:12.915733 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-util" (OuterVolumeSpecName: "util") pod "c5bb441d-01c7-41a0-820a-6d51eb3c5471" (UID: "c5bb441d-01c7-41a0-820a-6d51eb3c5471"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:13.011300 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.011274 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:13.011300 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.011297 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tg5p\" (UniqueName: \"kubernetes.io/projected/c5bb441d-01c7-41a0-820a-6d51eb3c5471-kube-api-access-6tg5p\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:13.011433 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.011308 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c5bb441d-01c7-41a0-820a-6d51eb3c5471-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:13.700557 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.700529 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" Jul 27 19:35:13.700940 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.700554 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb" event={"ID":"c5bb441d-01c7-41a0-820a-6d51eb3c5471","Type":"ContainerDied","Data":"59fe972fc14859a8f41e168d3d285db82634776714b082348ed5255f328c1f8c"} Jul 27 19:35:13.700940 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.700622 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="59fe972fc14859a8f41e168d3d285db82634776714b082348ed5255f328c1f8c" Jul 27 19:35:13.874990 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.874969 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:13.877599 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.877555 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:13.881507 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.881481 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:13.918105 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918078 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kw7w\" (UniqueName: \"kubernetes.io/projected/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-kube-api-access-5kw7w\") pod \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " Jul 27 19:35:13.918244 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918116 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-bundle\") pod \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " Jul 27 19:35:13.918244 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918145 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctbg6\" (UniqueName: \"kubernetes.io/projected/02e1e877-242d-4814-8ee6-80c51135e86a-kube-api-access-ctbg6\") pod \"02e1e877-242d-4814-8ee6-80c51135e86a\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " Jul 27 19:35:13.918244 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918174 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-bundle\") pod \"7b0ed047-ed64-409c-a639-2824423ca06f\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " Jul 27 19:35:13.918244 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918202 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-util\") pod \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\" (UID: \"0c22f5d5-14c8-4180-b643-3fd24e99d8b8\") " Jul 27 19:35:13.918244 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918223 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-util\") pod \"7b0ed047-ed64-409c-a639-2824423ca06f\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " Jul 27 19:35:13.918490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918253 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfd2c\" (UniqueName: \"kubernetes.io/projected/7b0ed047-ed64-409c-a639-2824423ca06f-kube-api-access-tfd2c\") pod \"7b0ed047-ed64-409c-a639-2824423ca06f\" (UID: \"7b0ed047-ed64-409c-a639-2824423ca06f\") " Jul 27 19:35:13.918490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918285 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-bundle\") pod \"02e1e877-242d-4814-8ee6-80c51135e86a\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " Jul 27 19:35:13.918490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918312 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-util\") pod \"02e1e877-242d-4814-8ee6-80c51135e86a\" (UID: \"02e1e877-242d-4814-8ee6-80c51135e86a\") " Jul 27 19:35:13.918942 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.918915 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-bundle" (OuterVolumeSpecName: "bundle") pod "0c22f5d5-14c8-4180-b643-3fd24e99d8b8" (UID: "0c22f5d5-14c8-4180-b643-3fd24e99d8b8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:13.919209 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.919184 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-bundle" (OuterVolumeSpecName: "bundle") pod "7b0ed047-ed64-409c-a639-2824423ca06f" (UID: "7b0ed047-ed64-409c-a639-2824423ca06f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:13.919912 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.919421 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-bundle" (OuterVolumeSpecName: "bundle") pod "02e1e877-242d-4814-8ee6-80c51135e86a" (UID: "02e1e877-242d-4814-8ee6-80c51135e86a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:13.921050 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.921016 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e1e877-242d-4814-8ee6-80c51135e86a-kube-api-access-ctbg6" (OuterVolumeSpecName: "kube-api-access-ctbg6") pod "02e1e877-242d-4814-8ee6-80c51135e86a" (UID: "02e1e877-242d-4814-8ee6-80c51135e86a"). InnerVolumeSpecName "kube-api-access-ctbg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:35:13.921662 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.921640 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-kube-api-access-5kw7w" (OuterVolumeSpecName: "kube-api-access-5kw7w") pod "0c22f5d5-14c8-4180-b643-3fd24e99d8b8" (UID: "0c22f5d5-14c8-4180-b643-3fd24e99d8b8"). InnerVolumeSpecName "kube-api-access-5kw7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:35:13.922343 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.922317 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b0ed047-ed64-409c-a639-2824423ca06f-kube-api-access-tfd2c" (OuterVolumeSpecName: "kube-api-access-tfd2c") pod "7b0ed047-ed64-409c-a639-2824423ca06f" (UID: "7b0ed047-ed64-409c-a639-2824423ca06f"). InnerVolumeSpecName "kube-api-access-tfd2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:35:13.926263 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.926238 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-util" (OuterVolumeSpecName: "util") pod "0c22f5d5-14c8-4180-b643-3fd24e99d8b8" (UID: "0c22f5d5-14c8-4180-b643-3fd24e99d8b8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:13.927177 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.927143 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-util" (OuterVolumeSpecName: "util") pod "02e1e877-242d-4814-8ee6-80c51135e86a" (UID: "02e1e877-242d-4814-8ee6-80c51135e86a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:13.928124 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:13.928096 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-util" (OuterVolumeSpecName: "util") pod "7b0ed047-ed64-409c-a639-2824423ca06f" (UID: "7b0ed047-ed64-409c-a639-2824423ca06f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 19:35:14.019371 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019343 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctbg6\" (UniqueName: \"kubernetes.io/projected/02e1e877-242d-4814-8ee6-80c51135e86a-kube-api-access-ctbg6\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019371 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019370 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019379 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019388 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b0ed047-ed64-409c-a639-2824423ca06f-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019395 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfd2c\" (UniqueName: \"kubernetes.io/projected/7b0ed047-ed64-409c-a639-2824423ca06f-kube-api-access-tfd2c\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019404 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019411 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e1e877-242d-4814-8ee6-80c51135e86a-util\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019418 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kw7w\" (UniqueName: \"kubernetes.io/projected/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-kube-api-access-5kw7w\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.019490 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.019426 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c22f5d5-14c8-4180-b643-3fd24e99d8b8-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:35:14.706829 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.706808 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" Jul 27 19:35:14.707259 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.706802 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98" event={"ID":"02e1e877-242d-4814-8ee6-80c51135e86a","Type":"ContainerDied","Data":"ec6c5a912ea40b4c22bf90e1aee4d623ea9d42314f62a044c43ba4114c0d27d0"} Jul 27 19:35:14.707259 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.706926 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec6c5a912ea40b4c22bf90e1aee4d623ea9d42314f62a044c43ba4114c0d27d0" Jul 27 19:35:14.708764 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.708723 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" Jul 27 19:35:14.708867 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.708725 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf" event={"ID":"7b0ed047-ed64-409c-a639-2824423ca06f","Type":"ContainerDied","Data":"45448295e89c2b8cf2502e74a308997509223635c1d5cef0c5ed6e0fecf13204"} Jul 27 19:35:14.708867 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.708841 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45448295e89c2b8cf2502e74a308997509223635c1d5cef0c5ed6e0fecf13204" Jul 27 19:35:14.710986 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.710969 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" Jul 27 19:35:14.711051 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.710974 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26" event={"ID":"0c22f5d5-14c8-4180-b643-3fd24e99d8b8","Type":"ContainerDied","Data":"75d1d05fda69242c451492d712f563e33e03ead6b3101cf1c9cbf91bbfe8529f"} Jul 27 19:35:14.711095 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:14.711066 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75d1d05fda69242c451492d712f563e33e03ead6b3101cf1c9cbf91bbfe8529f" Jul 27 19:35:45.209477 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209448 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74"] Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209751 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209763 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209774 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209779 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209785 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209791 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209796 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209801 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209807 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209812 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209822 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209829 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209837 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209844 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209852 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209859 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209870 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209877 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209886 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209894 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="pull" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209909 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209920 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="util" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209929 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="extract" Jul 27 19:35:45.209937 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.209937 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="extract" Jul 27 19:35:45.210630 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.210033 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b0ed047-ed64-409c-a639-2824423ca06f" containerName="extract" Jul 27 19:35:45.210630 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.210045 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e1e877-242d-4814-8ee6-80c51135e86a" containerName="extract" Jul 27 19:35:45.210630 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.210054 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bb441d-01c7-41a0-820a-6d51eb3c5471" containerName="extract" Jul 27 19:35:45.210630 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.210060 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c22f5d5-14c8-4180-b643-3fd24e99d8b8" containerName="extract" Jul 27 19:35:45.214290 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.214274 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:35:45.217466 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.217392 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z929q\"" Jul 27 19:35:45.217466 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.217404 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 27 19:35:45.218837 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.218818 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 27 19:35:45.226933 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.226861 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74"] Jul 27 19:35:45.263006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.262981 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjj6w\" (UniqueName: \"kubernetes.io/projected/3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2-kube-api-access-gjj6w\") pod \"limitador-operator-controller-manager-859d7b78bd-ktm74\" (UID: \"3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:35:45.363704 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.363671 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjj6w\" (UniqueName: \"kubernetes.io/projected/3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2-kube-api-access-gjj6w\") pod \"limitador-operator-controller-manager-859d7b78bd-ktm74\" (UID: \"3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:35:45.373040 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.373011 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjj6w\" (UniqueName: \"kubernetes.io/projected/3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2-kube-api-access-gjj6w\") pod \"limitador-operator-controller-manager-859d7b78bd-ktm74\" (UID: \"3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:35:45.526155 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.526123 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:35:45.654358 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.654336 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74"] Jul 27 19:35:45.656835 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:35:45.656809 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e98ecae_ea40_4fe3_b1f9_9881ff63a6c2.slice/crio-6704bb48e721842be5f11ddc4788f6f38ad4a7efa22a6f9edf3f9a8933078b37 WatchSource:0}: Error finding container 6704bb48e721842be5f11ddc4788f6f38ad4a7efa22a6f9edf3f9a8933078b37: Status 404 returned error can't find the container with id 6704bb48e721842be5f11ddc4788f6f38ad4a7efa22a6f9edf3f9a8933078b37 Jul 27 19:35:45.846332 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:45.846249 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" event={"ID":"3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2","Type":"ContainerStarted","Data":"6704bb48e721842be5f11ddc4788f6f38ad4a7efa22a6f9edf3f9a8933078b37"} Jul 27 19:35:47.858303 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:47.858263 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" event={"ID":"3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2","Type":"ContainerStarted","Data":"898ca56a410892e8b559be7fb40d17f9bd3a170a57017fc6e26b1047499ed607"} Jul 27 19:35:47.858688 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:47.858387 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:35:47.893113 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:47.893069 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" podStartSLOduration=1.063988805 podStartE2EDuration="2.893055383s" totalImagesPullingTime="1.829066578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:35:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:35:47.8923393 +0000 UTC m=+605.711591936" watchObservedRunningTime="2026-07-27 19:35:47.893055383 +0000 UTC m=+605.712308017" Jul 27 19:35:58.864770 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:35:58.864742 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ktm74" Jul 27 19:37:18.039570 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.039531 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6498c4fdfb-xrwsc"] Jul 27 19:37:18.042785 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.042765 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.046127 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.046109 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 27 19:37:18.046618 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.046601 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jcp46\"" Jul 27 19:37:18.046809 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.046786 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 27 19:37:18.060212 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.060191 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6498c4fdfb-xrwsc"] Jul 27 19:37:18.156634 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.156603 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.156780 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.156650 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx79m\" (UniqueName: \"kubernetes.io/projected/3847c98d-a365-4001-82dc-fef1f8dba96c-kube-api-access-lx79m\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.257874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.257834 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.258018 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.257916 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx79m\" (UniqueName: \"kubernetes.io/projected/3847c98d-a365-4001-82dc-fef1f8dba96c-kube-api-access-lx79m\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.258018 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:37:18.257986 2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 27 19:37:18.258102 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:37:18.258070 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert podName:3847c98d-a365-4001-82dc-fef1f8dba96c nodeName:}" failed. No retries permitted until 2026-07-27 19:37:18.758049404 +0000 UTC m=+696.577302036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert") pod "maas-controller-6498c4fdfb-xrwsc" (UID: "3847c98d-a365-4001-82dc-fef1f8dba96c") : secret "maas-controller-webhook-cert" not found Jul 27 19:37:18.268021 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.267997 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx79m\" (UniqueName: \"kubernetes.io/projected/3847c98d-a365-4001-82dc-fef1f8dba96c-kube-api-access-lx79m\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.762185 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.762153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.764526 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.764508 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert\") pod \"maas-controller-6498c4fdfb-xrwsc\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:18.954874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:18.954845 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:19.081398 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:19.081375 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6498c4fdfb-xrwsc"] Jul 27 19:37:19.082983 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:37:19.082958 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3847c98d_a365_4001_82dc_fef1f8dba96c.slice/crio-b35b9b7d106b434796b48aa3847e6e9f7213c046bbce150e420a9206de89f2ae WatchSource:0}: Error finding container b35b9b7d106b434796b48aa3847e6e9f7213c046bbce150e420a9206de89f2ae: Status 404 returned error can't find the container with id b35b9b7d106b434796b48aa3847e6e9f7213c046bbce150e420a9206de89f2ae Jul 27 19:37:19.274993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:19.274959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" event={"ID":"3847c98d-a365-4001-82dc-fef1f8dba96c","Type":"ContainerStarted","Data":"b35b9b7d106b434796b48aa3847e6e9f7213c046bbce150e420a9206de89f2ae"} Jul 27 19:37:22.289382 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:22.289343 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" event={"ID":"3847c98d-a365-4001-82dc-fef1f8dba96c","Type":"ContainerStarted","Data":"4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae"} Jul 27 19:37:22.289835 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:22.289485 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:22.309048 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:22.309000 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" podStartSLOduration=2.15097354 podStartE2EDuration="4.308986542s" totalImagesPullingTime="2.158013002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:22.307822235 +0000 UTC m=+700.127074908" watchObservedRunningTime="2026-07-27 19:37:22.308986542 +0000 UTC m=+700.128239177" Jul 27 19:37:33.296802 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.296730 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:33.476274 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.476239 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6498c4fdfb-xrwsc"] Jul 27 19:37:33.476567 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.476532 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" podUID="3847c98d-a365-4001-82dc-fef1f8dba96c" containerName="manager" containerID="cri-o://4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae" gracePeriod=30 Jul 27 19:37:33.717876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.717853 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:33.785545 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.785514 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert\") pod \"3847c98d-a365-4001-82dc-fef1f8dba96c\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " Jul 27 19:37:33.785695 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.785631 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx79m\" (UniqueName: \"kubernetes.io/projected/3847c98d-a365-4001-82dc-fef1f8dba96c-kube-api-access-lx79m\") pod \"3847c98d-a365-4001-82dc-fef1f8dba96c\" (UID: \"3847c98d-a365-4001-82dc-fef1f8dba96c\") " Jul 27 19:37:33.787718 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.787685 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3847c98d-a365-4001-82dc-fef1f8dba96c" (UID: "3847c98d-a365-4001-82dc-fef1f8dba96c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:37:33.787818 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.787747 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3847c98d-a365-4001-82dc-fef1f8dba96c-kube-api-access-lx79m" (OuterVolumeSpecName: "kube-api-access-lx79m") pod "3847c98d-a365-4001-82dc-fef1f8dba96c" (UID: "3847c98d-a365-4001-82dc-fef1f8dba96c"). InnerVolumeSpecName "kube-api-access-lx79m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:37:33.886215 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.886147 2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3847c98d-a365-4001-82dc-fef1f8dba96c-webhook-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:37:33.886215 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:33.886173 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx79m\" (UniqueName: \"kubernetes.io/projected/3847c98d-a365-4001-82dc-fef1f8dba96c-kube-api-access-lx79m\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:37:34.350785 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.350748 2584 generic.go:356] "Generic (PLEG): container finished" podID="3847c98d-a365-4001-82dc-fef1f8dba96c" containerID="4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae" exitCode=0 Jul 27 19:37:34.351153 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.350790 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" Jul 27 19:37:34.351153 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.350829 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" event={"ID":"3847c98d-a365-4001-82dc-fef1f8dba96c","Type":"ContainerDied","Data":"4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae"} Jul 27 19:37:34.351153 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.350873 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6498c4fdfb-xrwsc" event={"ID":"3847c98d-a365-4001-82dc-fef1f8dba96c","Type":"ContainerDied","Data":"b35b9b7d106b434796b48aa3847e6e9f7213c046bbce150e420a9206de89f2ae"} Jul 27 19:37:34.351153 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.350897 2584 scope.go:117] "RemoveContainer" containerID="4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae" Jul 27 19:37:34.359415 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.359397 2584 scope.go:117] "RemoveContainer" containerID="4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae" Jul 27 19:37:34.359691 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:37:34.359674 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae\": container with ID starting with 4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae not found: ID does not exist" containerID="4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae" Jul 27 19:37:34.359742 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.359702 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae"} err="failed to get container status \"4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae\": rpc error: code = NotFound desc = could not find container \"4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae\": container with ID starting with 4fd8bd3bce18c553261509173eda163e25692ae8dec9482033b73ba4984a0aae not found: ID does not exist" Jul 27 19:37:34.371274 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.371252 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6498c4fdfb-xrwsc"] Jul 27 19:37:34.376181 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.376160 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6498c4fdfb-xrwsc"] Jul 27 19:37:34.656700 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:34.656632 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3847c98d-a365-4001-82dc-fef1f8dba96c" path="/var/lib/kubelet/pods/3847c98d-a365-4001-82dc-fef1f8dba96c/volumes" Jul 27 19:37:54.095961 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.095926 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79"] Jul 27 19:37:54.096604 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.096346 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3847c98d-a365-4001-82dc-fef1f8dba96c" containerName="manager" Jul 27 19:37:54.096604 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.096368 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3847c98d-a365-4001-82dc-fef1f8dba96c" containerName="manager" Jul 27 19:37:54.096604 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.096470 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3847c98d-a365-4001-82dc-fef1f8dba96c" containerName="manager" Jul 27 19:37:54.100600 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.100565 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.103204 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.103184 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 27 19:37:54.103204 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.103202 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 27 19:37:54.104288 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.104271 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8bbw6\"" Jul 27 19:37:54.104367 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.104307 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 27 19:37:54.109332 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.109311 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79"] Jul 27 19:37:54.240973 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.240938 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b46b42-7238-4303-918c-2d6cdcbd4f69-maas-api-tls\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.241145 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.240990 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz68g\" (UniqueName: \"kubernetes.io/projected/31b46b42-7238-4303-918c-2d6cdcbd4f69-kube-api-access-rz68g\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.241145 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.241049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b46b42-7238-4303-918c-2d6cdcbd4f69-openshift-service-ca\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.341552 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.341517 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz68g\" (UniqueName: \"kubernetes.io/projected/31b46b42-7238-4303-918c-2d6cdcbd4f69-kube-api-access-rz68g\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.341741 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.341600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b46b42-7238-4303-918c-2d6cdcbd4f69-openshift-service-ca\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.341741 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.341666 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b46b42-7238-4303-918c-2d6cdcbd4f69-maas-api-tls\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.342202 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.342178 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b46b42-7238-4303-918c-2d6cdcbd4f69-openshift-service-ca\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.344166 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.344145 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b46b42-7238-4303-918c-2d6cdcbd4f69-maas-api-tls\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.348765 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.348715 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz68g\" (UniqueName: \"kubernetes.io/projected/31b46b42-7238-4303-918c-2d6cdcbd4f69-kube-api-access-rz68g\") pod \"maas-api-dd85d7bc7-6ff79\" (UID: \"31b46b42-7238-4303-918c-2d6cdcbd4f69\") " pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.411430 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.411389 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:54.541436 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.541408 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79"] Jul 27 19:37:54.543195 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:37:54.543169 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b46b42_7238_4303_918c_2d6cdcbd4f69.slice/crio-b9e8abb6c4a9a17c1c54dcfbc111500aac8e06ccfe66d3e536e8cee0e3546132 WatchSource:0}: Error finding container b9e8abb6c4a9a17c1c54dcfbc111500aac8e06ccfe66d3e536e8cee0e3546132: Status 404 returned error can't find the container with id b9e8abb6c4a9a17c1c54dcfbc111500aac8e06ccfe66d3e536e8cee0e3546132 Jul 27 19:37:54.544535 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.544516 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 19:37:54.613674 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.613576 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-p5r5v"] Jul 27 19:37:54.617889 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.617870 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.620694 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.620676 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 27 19:37:54.620793 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.620678 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-njz4k\"" Jul 27 19:37:54.634548 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.634519 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-p5r5v"] Jul 27 19:37:54.745603 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.745552 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vj6w\" (UniqueName: \"kubernetes.io/projected/a235a516-dcb9-47ad-943c-7439d976868b-kube-api-access-5vj6w\") pod \"payload-processing-5cc6cd444b-p5r5v\" (UID: \"a235a516-dcb9-47ad-943c-7439d976868b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.745756 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.745670 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a235a516-dcb9-47ad-943c-7439d976868b-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-p5r5v\" (UID: \"a235a516-dcb9-47ad-943c-7439d976868b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.846917 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.846887 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vj6w\" (UniqueName: \"kubernetes.io/projected/a235a516-dcb9-47ad-943c-7439d976868b-kube-api-access-5vj6w\") pod \"payload-processing-5cc6cd444b-p5r5v\" (UID: \"a235a516-dcb9-47ad-943c-7439d976868b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.847075 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.846944 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a235a516-dcb9-47ad-943c-7439d976868b-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-p5r5v\" (UID: \"a235a516-dcb9-47ad-943c-7439d976868b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.847551 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.847533 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a235a516-dcb9-47ad-943c-7439d976868b-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-p5r5v\" (UID: \"a235a516-dcb9-47ad-943c-7439d976868b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.855111 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.855091 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vj6w\" (UniqueName: \"kubernetes.io/projected/a235a516-dcb9-47ad-943c-7439d976868b-kube-api-access-5vj6w\") pod \"payload-processing-5cc6cd444b-p5r5v\" (UID: \"a235a516-dcb9-47ad-943c-7439d976868b\") " pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:54.931044 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:54.930967 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:55.059363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:55.059333 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-p5r5v"] Jul 27 19:37:55.060942 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:37:55.060916 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda235a516_dcb9_47ad_943c_7439d976868b.slice/crio-0fb7d6475332cbb28298688dd390eabb37ab4754c234a93ad291de964b9c2fc0 WatchSource:0}: Error finding container 0fb7d6475332cbb28298688dd390eabb37ab4754c234a93ad291de964b9c2fc0: Status 404 returned error can't find the container with id 0fb7d6475332cbb28298688dd390eabb37ab4754c234a93ad291de964b9c2fc0 Jul 27 19:37:55.448474 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:55.448433 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" event={"ID":"31b46b42-7238-4303-918c-2d6cdcbd4f69","Type":"ContainerStarted","Data":"b9e8abb6c4a9a17c1c54dcfbc111500aac8e06ccfe66d3e536e8cee0e3546132"} Jul 27 19:37:55.449722 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:55.449693 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" event={"ID":"a235a516-dcb9-47ad-943c-7439d976868b","Type":"ContainerStarted","Data":"0fb7d6475332cbb28298688dd390eabb37ab4754c234a93ad291de964b9c2fc0"} Jul 27 19:37:57.460290 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:57.460257 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" event={"ID":"31b46b42-7238-4303-918c-2d6cdcbd4f69","Type":"ContainerStarted","Data":"0b4a7be41d3b91d9e9a003d5c6f05f976574fb4fc4f64a85e83085d7b9304620"} Jul 27 19:37:57.460743 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:57.460341 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:37:57.461802 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:57.461779 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" event={"ID":"a235a516-dcb9-47ad-943c-7439d976868b","Type":"ContainerStarted","Data":"f8268a77655165373cc4620cd1d5488afe4dc3d914a2aea639ce04f22b76f401"} Jul 27 19:37:57.461879 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:57.461825 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:37:57.478828 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:57.478775 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" podStartSLOduration=1.4367244719999999 podStartE2EDuration="3.478760708s" totalImagesPullingTime="2.042036236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:57.476520064 +0000 UTC m=+735.295772715" watchObservedRunningTime="2026-07-27 19:37:57.478760708 +0000 UTC m=+735.298013343" Jul 27 19:37:57.491745 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:37:57.491701 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" podStartSLOduration=1.961573324 podStartE2EDuration="3.491688298s" totalImagesPullingTime="1.530114974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:37:57.490761084 +0000 UTC m=+735.310013720" watchObservedRunningTime="2026-07-27 19:37:57.491688298 +0000 UTC m=+735.310940933" Jul 27 19:38:03.471161 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:03.471131 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dd85d7bc7-6ff79" Jul 27 19:38:08.468435 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:08.468406 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-p5r5v" Jul 27 19:38:24.786678 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.786647 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw"] Jul 27 19:38:24.789979 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.789961 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.793857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.793815 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pt647\"" Jul 27 19:38:24.793857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.793830 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 27 19:38:24.793857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.793818 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 27 19:38:24.793857 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.793819 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 27 19:38:24.799595 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.799559 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw"] Jul 27 19:38:24.873339 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.873309 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2p7r\" (UniqueName: \"kubernetes.io/projected/35ffabcb-869c-4e9e-bf22-b6249b601832-kube-api-access-q2p7r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.873499 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.873346 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.873499 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.873370 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.873499 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.873415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.873499 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.873490 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ffabcb-869c-4e9e-bf22-b6249b601832-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.873702 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.873519 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974401 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974371 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974606 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974421 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ffabcb-869c-4e9e-bf22-b6249b601832-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974606 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974576 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2p7r\" (UniqueName: \"kubernetes.io/projected/35ffabcb-869c-4e9e-bf22-b6249b601832-kube-api-access-q2p7r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974700 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.974887 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.974846 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.975045 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.975021 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.975083 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.975045 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.976887 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.976866 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35ffabcb-869c-4e9e-bf22-b6249b601832-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.977052 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.977037 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35ffabcb-869c-4e9e-bf22-b6249b601832-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:24.982520 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:24.982501 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2p7r\" (UniqueName: \"kubernetes.io/projected/35ffabcb-869c-4e9e-bf22-b6249b601832-kube-api-access-q2p7r\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hvpgw\" (UID: \"35ffabcb-869c-4e9e-bf22-b6249b601832\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:25.100763 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:25.100693 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:25.226203 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:25.226178 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw"] Jul 27 19:38:25.228137 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:38:25.228110 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ffabcb_869c_4e9e_bf22_b6249b601832.slice/crio-2ebb23ccbd53557015a6110d70fc06b5d4815205a9ab39ec303e262e06e767e3 WatchSource:0}: Error finding container 2ebb23ccbd53557015a6110d70fc06b5d4815205a9ab39ec303e262e06e767e3: Status 404 returned error can't find the container with id 2ebb23ccbd53557015a6110d70fc06b5d4815205a9ab39ec303e262e06e767e3 Jul 27 19:38:25.592317 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:25.592275 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" event={"ID":"35ffabcb-869c-4e9e-bf22-b6249b601832","Type":"ContainerStarted","Data":"2ebb23ccbd53557015a6110d70fc06b5d4815205a9ab39ec303e262e06e767e3"} Jul 27 19:38:26.597768 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:26.597732 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" event={"ID":"35ffabcb-869c-4e9e-bf22-b6249b601832","Type":"ContainerStarted","Data":"0238191f6c3df78ebe015bec26b02096d474387c6ee55d0c6cc8a4786452b0cb"} Jul 27 19:38:26.615559 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:26.615509 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" podStartSLOduration=1.6968541099999999 podStartE2EDuration="2.615493136s" totalImagesPullingTime="918.639026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:38:26.614527543 +0000 UTC m=+764.433780201" watchObservedRunningTime="2026-07-27 19:38:26.615493136 +0000 UTC m=+764.434745772" Jul 27 19:38:35.101530 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:35.101496 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:35.102021 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:35.101561 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:35.113877 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:35.113852 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:38:35.648881 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:38:35.648851 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hvpgw" Jul 27 19:39:06.027707 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.027629 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt"] Jul 27 19:39:06.030804 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.030786 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.033372 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.033341 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 27 19:39:06.040848 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.040819 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt"] Jul 27 19:39:06.210820 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.210788 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.210982 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.210834 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.210982 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.210879 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d278d8d4-30fc-4b77-a405-02b8f9056efd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.210982 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.210929 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.210982 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.210947 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.210982 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.210972 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcbjz\" (UniqueName: \"kubernetes.io/projected/d278d8d4-30fc-4b77-a405-02b8f9056efd-kube-api-access-qcbjz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312183 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312113 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312183 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312151 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312183 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d278d8d4-30fc-4b77-a405-02b8f9056efd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312393 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312192 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312393 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312210 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312393 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcbjz\" (UniqueName: \"kubernetes.io/projected/d278d8d4-30fc-4b77-a405-02b8f9056efd-kube-api-access-qcbjz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312616 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312568 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312688 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312634 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.312731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.312718 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.314411 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.314395 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d278d8d4-30fc-4b77-a405-02b8f9056efd-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.315235 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.315218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d278d8d4-30fc-4b77-a405-02b8f9056efd-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.320073 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.320056 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcbjz\" (UniqueName: \"kubernetes.io/projected/d278d8d4-30fc-4b77-a405-02b8f9056efd-kube-api-access-qcbjz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-b6srt\" (UID: \"d278d8d4-30fc-4b77-a405-02b8f9056efd\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.341920 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.341901 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:06.468048 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.468021 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt"] Jul 27 19:39:06.470664 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:39:06.470640 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd278d8d4_30fc_4b77_a405_02b8f9056efd.slice/crio-97f44aa37e78d7768cff7624c4a4fdf0e46c4f3533d5be143750b076db9fee82 WatchSource:0}: Error finding container 97f44aa37e78d7768cff7624c4a4fdf0e46c4f3533d5be143750b076db9fee82: Status 404 returned error can't find the container with id 97f44aa37e78d7768cff7624c4a4fdf0e46c4f3533d5be143750b076db9fee82 Jul 27 19:39:06.777807 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.777773 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" event={"ID":"d278d8d4-30fc-4b77-a405-02b8f9056efd","Type":"ContainerStarted","Data":"3bb6bbec9e0cc14e9fef71990664916dd2a8fd206e22d733e24d830c912b4d69"} Jul 27 19:39:06.777956 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.777836 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" event={"ID":"d278d8d4-30fc-4b77-a405-02b8f9056efd","Type":"ContainerStarted","Data":"97f44aa37e78d7768cff7624c4a4fdf0e46c4f3533d5be143750b076db9fee82"} Jul 27 19:39:06.794846 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:06.794795 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" podStartSLOduration=0.571461053 podStartE2EDuration="794.779019ms" totalImagesPullingTime="223.317966ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:39:06.793065247 +0000 UTC m=+804.612317894" watchObservedRunningTime="2026-07-27 19:39:06.794779019 +0000 UTC m=+804.614031689" Jul 27 19:39:16.342150 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:16.342116 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:16.342712 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:16.342170 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:16.354432 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:16.354411 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:39:16.835882 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:39:16.835849 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-b6srt" Jul 27 19:55:43.101998 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.101962 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k"] Jul 27 19:55:43.105693 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.105674 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.108204 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.108184 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6154550c-serving-cert\"" Jul 27 19:55:43.115876 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.115850 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k"] Jul 27 19:55:43.147217 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.147188 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae577cd-1190-4d80-841a-6a3aeb0de91c-openshift-service-ca\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.147217 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.147217 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4f5t\" (UniqueName: \"kubernetes.io/projected/8ae577cd-1190-4d80-841a-6a3aeb0de91c-kube-api-access-d4f5t\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.147406 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.147265 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae577cd-1190-4d80-841a-6a3aeb0de91c-maas-api-tls\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.248056 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.248022 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae577cd-1190-4d80-841a-6a3aeb0de91c-openshift-service-ca\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.248216 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.248063 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4f5t\" (UniqueName: \"kubernetes.io/projected/8ae577cd-1190-4d80-841a-6a3aeb0de91c-kube-api-access-d4f5t\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.248216 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.248119 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae577cd-1190-4d80-841a-6a3aeb0de91c-maas-api-tls\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.248676 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.248652 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae577cd-1190-4d80-841a-6a3aeb0de91c-openshift-service-ca\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.250527 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.250510 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae577cd-1190-4d80-841a-6a3aeb0de91c-maas-api-tls\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.255730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.255707 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4f5t\" (UniqueName: \"kubernetes.io/projected/8ae577cd-1190-4d80-841a-6a3aeb0de91c-kube-api-access-d4f5t\") pod \"maas-api-e2e-ait-6154550c-668457b6df-hll6k\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.416860 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.416782 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:43.551628 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.551564 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k"] Jul 27 19:55:43.555086 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:55:43.555055 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae577cd_1190_4d80_841a_6a3aeb0de91c.slice/crio-a61a109e532601c740c4d62dab8fa81bad431f5bd9e0d9a27185659792a6c91a WatchSource:0}: Error finding container a61a109e532601c740c4d62dab8fa81bad431f5bd9e0d9a27185659792a6c91a: Status 404 returned error can't find the container with id a61a109e532601c740c4d62dab8fa81bad431f5bd9e0d9a27185659792a6c91a Jul 27 19:55:43.556744 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:43.556721 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 19:55:44.444824 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:44.444739 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" event={"ID":"8ae577cd-1190-4d80-841a-6a3aeb0de91c","Type":"ContainerStarted","Data":"966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d"} Jul 27 19:55:44.444824 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:44.444792 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" event={"ID":"8ae577cd-1190-4d80-841a-6a3aeb0de91c","Type":"ContainerStarted","Data":"a61a109e532601c740c4d62dab8fa81bad431f5bd9e0d9a27185659792a6c91a"} Jul 27 19:55:44.445232 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:44.444860 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:55:44.463801 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:44.463753 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" podStartSLOduration=0.958031944 podStartE2EDuration="1.463736923s" totalImagesPullingTime="505.704979ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:55:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:55:44.461038672 +0000 UTC m=+1802.280291308" watchObservedRunningTime="2026-07-27 19:55:44.463736923 +0000 UTC m=+1802.282989559" Jul 27 19:55:50.454954 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:55:50.454926 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:56:18.702805 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:18.702774 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k"] Jul 27 19:56:18.703399 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:18.702977 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" podUID="8ae577cd-1190-4d80-841a-6a3aeb0de91c" containerName="maas-api" containerID="cri-o://966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d" gracePeriod=30 Jul 27 19:56:18.948335 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:18.948312 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:56:19.038241 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.038215 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae577cd-1190-4d80-841a-6a3aeb0de91c-openshift-service-ca\") pod \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " Jul 27 19:56:19.038402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.038266 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae577cd-1190-4d80-841a-6a3aeb0de91c-maas-api-tls\") pod \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " Jul 27 19:56:19.038402 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.038286 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4f5t\" (UniqueName: \"kubernetes.io/projected/8ae577cd-1190-4d80-841a-6a3aeb0de91c-kube-api-access-d4f5t\") pod \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\" (UID: \"8ae577cd-1190-4d80-841a-6a3aeb0de91c\") " Jul 27 19:56:19.038675 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.038647 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae577cd-1190-4d80-841a-6a3aeb0de91c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ae577cd-1190-4d80-841a-6a3aeb0de91c" (UID: "8ae577cd-1190-4d80-841a-6a3aeb0de91c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:56:19.040608 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.040570 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ae577cd-1190-4d80-841a-6a3aeb0de91c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ae577cd-1190-4d80-841a-6a3aeb0de91c" (UID: "8ae577cd-1190-4d80-841a-6a3aeb0de91c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:56:19.040690 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.040671 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae577cd-1190-4d80-841a-6a3aeb0de91c-kube-api-access-d4f5t" (OuterVolumeSpecName: "kube-api-access-d4f5t") pod "8ae577cd-1190-4d80-841a-6a3aeb0de91c" (UID: "8ae577cd-1190-4d80-841a-6a3aeb0de91c"). InnerVolumeSpecName "kube-api-access-d4f5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:56:19.139762 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.139735 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae577cd-1190-4d80-841a-6a3aeb0de91c-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:56:19.139762 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.139759 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae577cd-1190-4d80-841a-6a3aeb0de91c-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:56:19.139762 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.139768 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4f5t\" (UniqueName: \"kubernetes.io/projected/8ae577cd-1190-4d80-841a-6a3aeb0de91c-kube-api-access-d4f5t\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:56:19.607380 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.607345 2584 generic.go:356] "Generic (PLEG): container finished" podID="8ae577cd-1190-4d80-841a-6a3aeb0de91c" containerID="966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d" exitCode=0 Jul 27 19:56:19.607574 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.607393 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" event={"ID":"8ae577cd-1190-4d80-841a-6a3aeb0de91c","Type":"ContainerDied","Data":"966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d"} Jul 27 19:56:19.607574 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.607399 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" Jul 27 19:56:19.607574 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.607432 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k" event={"ID":"8ae577cd-1190-4d80-841a-6a3aeb0de91c","Type":"ContainerDied","Data":"a61a109e532601c740c4d62dab8fa81bad431f5bd9e0d9a27185659792a6c91a"} Jul 27 19:56:19.607574 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.607453 2584 scope.go:117] "RemoveContainer" containerID="966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d" Jul 27 19:56:19.616278 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.616258 2584 scope.go:117] "RemoveContainer" containerID="966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d" Jul 27 19:56:19.616545 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:56:19.616524 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d\": container with ID starting with 966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d not found: ID does not exist" containerID="966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d" Jul 27 19:56:19.616679 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.616552 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d"} err="failed to get container status \"966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d\": rpc error: code = NotFound desc = could not find container \"966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d\": container with ID starting with 966f3bb3db75e7227535120cfd9686a5384a28160da706f862b54e1064eb043d not found: ID does not exist" Jul 27 19:56:19.628616 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.628570 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k"] Jul 27 19:56:19.632209 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:19.632191 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6154550c-668457b6df-hll6k"] Jul 27 19:56:20.656405 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:20.656368 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae577cd-1190-4d80-841a-6a3aeb0de91c" path="/var/lib/kubelet/pods/8ae577cd-1190-4d80-841a-6a3aeb0de91c/volumes" Jul 27 19:56:27.215644 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.215564 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8"] Jul 27 19:56:27.218072 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.216033 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae577cd-1190-4d80-841a-6a3aeb0de91c" containerName="maas-api" Jul 27 19:56:27.218072 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.216047 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae577cd-1190-4d80-841a-6a3aeb0de91c" containerName="maas-api" Jul 27 19:56:27.218072 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.216096 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae577cd-1190-4d80-841a-6a3aeb0de91c" containerName="maas-api" Jul 27 19:56:27.218895 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.218881 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.221336 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.221312 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c241bf21-serving-cert\"" Jul 27 19:56:27.229211 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.229191 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8"] Jul 27 19:56:27.313610 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.313452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/197a8d42-453a-49bc-9297-c5cbc2d79872-openshift-service-ca\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.313610 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.313522 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qltn4\" (UniqueName: \"kubernetes.io/projected/197a8d42-453a-49bc-9297-c5cbc2d79872-kube-api-access-qltn4\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.313610 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.313613 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/197a8d42-453a-49bc-9297-c5cbc2d79872-maas-api-tls\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.414376 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.414341 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/197a8d42-453a-49bc-9297-c5cbc2d79872-maas-api-tls\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.414542 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.414399 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/197a8d42-453a-49bc-9297-c5cbc2d79872-openshift-service-ca\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.414542 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.414439 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qltn4\" (UniqueName: \"kubernetes.io/projected/197a8d42-453a-49bc-9297-c5cbc2d79872-kube-api-access-qltn4\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.415118 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.415097 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/197a8d42-453a-49bc-9297-c5cbc2d79872-openshift-service-ca\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.417006 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.416985 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/197a8d42-453a-49bc-9297-c5cbc2d79872-maas-api-tls\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.422600 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.422553 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qltn4\" (UniqueName: \"kubernetes.io/projected/197a8d42-453a-49bc-9297-c5cbc2d79872-kube-api-access-qltn4\") pod \"maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.531051 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.531021 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:27.660882 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:27.660859 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8"] Jul 27 19:56:27.662890 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:56:27.662865 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197a8d42_453a_49bc_9297_c5cbc2d79872.slice/crio-109bb1b0fe8b8c1e4671cb5b2761ec985eaa1e8013f16e5b37df097bff2763a3 WatchSource:0}: Error finding container 109bb1b0fe8b8c1e4671cb5b2761ec985eaa1e8013f16e5b37df097bff2763a3: Status 404 returned error can't find the container with id 109bb1b0fe8b8c1e4671cb5b2761ec985eaa1e8013f16e5b37df097bff2763a3 Jul 27 19:56:28.659027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:28.658993 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" event={"ID":"197a8d42-453a-49bc-9297-c5cbc2d79872","Type":"ContainerStarted","Data":"61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901"} Jul 27 19:56:28.659401 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:28.659041 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" event={"ID":"197a8d42-453a-49bc-9297-c5cbc2d79872","Type":"ContainerStarted","Data":"109bb1b0fe8b8c1e4671cb5b2761ec985eaa1e8013f16e5b37df097bff2763a3"} Jul 27 19:56:28.659401 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:28.659067 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:28.676030 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:28.675958 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" podStartSLOduration=1.267190325 podStartE2EDuration="1.675943045s" totalImagesPullingTime="408.75272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:56:28.67512225 +0000 UTC m=+1846.494374887" watchObservedRunningTime="2026-07-27 19:56:28.675943045 +0000 UTC m=+1846.495195724" Jul 27 19:56:34.669222 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:34.669194 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:56:52.112805 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.112768 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq"] Jul 27 19:56:52.116243 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.116225 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:56:52.119017 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.118991 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 19:56:52.124107 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.124083 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq"] Jul 27 19:56:52.199058 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.199024 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be63da2f-5982-492a-9a52-46f877445278-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq\" (UID: \"be63da2f-5982-492a-9a52-46f877445278\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:56:52.300382 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.300344 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be63da2f-5982-492a-9a52-46f877445278-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq\" (UID: \"be63da2f-5982-492a-9a52-46f877445278\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:56:52.300999 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.300978 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be63da2f-5982-492a-9a52-46f877445278-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq\" (UID: \"be63da2f-5982-492a-9a52-46f877445278\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:56:52.427525 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.427451 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:56:52.557738 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.557714 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq"] Jul 27 19:56:52.559506 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:56:52.559486 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe63da2f_5982_492a_9a52_46f877445278.slice/crio-85ee77e5d9ce2663ab8f7b68b4d1cae2d5dc3680bb736056e141d2caa8bbcd52 WatchSource:0}: Error finding container 85ee77e5d9ce2663ab8f7b68b4d1cae2d5dc3680bb736056e141d2caa8bbcd52: Status 404 returned error can't find the container with id 85ee77e5d9ce2663ab8f7b68b4d1cae2d5dc3680bb736056e141d2caa8bbcd52 Jul 27 19:56:52.774027 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:52.773990 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" event={"ID":"be63da2f-5982-492a-9a52-46f877445278","Type":"ContainerStarted","Data":"85ee77e5d9ce2663ab8f7b68b4d1cae2d5dc3680bb736056e141d2caa8bbcd52"} Jul 27 19:56:56.796171 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:56.796136 2584 generic.go:356] "Generic (PLEG): container finished" podID="be63da2f-5982-492a-9a52-46f877445278" containerID="326fd912ae1c71d523393dd9fa60d59cbf9d9b2397305460ed034095dc6fe8aa" exitCode=0 Jul 27 19:56:56.796548 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:56.796225 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" event={"ID":"be63da2f-5982-492a-9a52-46f877445278","Type":"ContainerDied","Data":"326fd912ae1c71d523393dd9fa60d59cbf9d9b2397305460ed034095dc6fe8aa"} Jul 27 19:56:57.930358 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:57.930329 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:56:58.055571 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:58.055469 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be63da2f-5982-492a-9a52-46f877445278-maas-api-service-ca\") pod \"be63da2f-5982-492a-9a52-46f877445278\" (UID: \"be63da2f-5982-492a-9a52-46f877445278\") " Jul 27 19:56:58.055885 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:58.055862 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be63da2f-5982-492a-9a52-46f877445278-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be63da2f-5982-492a-9a52-46f877445278" (UID: "be63da2f-5982-492a-9a52-46f877445278"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:56:58.156420 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:58.156384 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be63da2f-5982-492a-9a52-46f877445278-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:56:58.813484 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:58.813450 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" event={"ID":"be63da2f-5982-492a-9a52-46f877445278","Type":"ContainerDied","Data":"85ee77e5d9ce2663ab8f7b68b4d1cae2d5dc3680bb736056e141d2caa8bbcd52"} Jul 27 19:56:58.813674 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:58.813524 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85ee77e5d9ce2663ab8f7b68b4d1cae2d5dc3680bb736056e141d2caa8bbcd52" Jul 27 19:56:58.813674 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:56:58.813457 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq" Jul 27 19:57:02.525519 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.525488 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8"] Jul 27 19:57:02.525929 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.525707 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" podUID="197a8d42-453a-49bc-9297-c5cbc2d79872" containerName="maas-api" containerID="cri-o://61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901" gracePeriod=30 Jul 27 19:57:02.776612 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.776531 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:57:02.834024 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.833995 2584 generic.go:356] "Generic (PLEG): container finished" podID="197a8d42-453a-49bc-9297-c5cbc2d79872" containerID="61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901" exitCode=0 Jul 27 19:57:02.834201 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.834047 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" Jul 27 19:57:02.834201 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.834059 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" event={"ID":"197a8d42-453a-49bc-9297-c5cbc2d79872","Type":"ContainerDied","Data":"61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901"} Jul 27 19:57:02.834201 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.834101 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8" event={"ID":"197a8d42-453a-49bc-9297-c5cbc2d79872","Type":"ContainerDied","Data":"109bb1b0fe8b8c1e4671cb5b2761ec985eaa1e8013f16e5b37df097bff2763a3"} Jul 27 19:57:02.834201 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.834124 2584 scope.go:117] "RemoveContainer" containerID="61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901" Jul 27 19:57:02.843065 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.843045 2584 scope.go:117] "RemoveContainer" containerID="61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901" Jul 27 19:57:02.843316 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:57:02.843295 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901\": container with ID starting with 61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901 not found: ID does not exist" containerID="61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901" Jul 27 19:57:02.843362 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.843326 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901"} err="failed to get container status \"61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901\": rpc error: code = NotFound desc = could not find container \"61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901\": container with ID starting with 61f926db64885c169c53928fe9a3ef71d7c1f7c1f8ff1d3bf6e54ff4908a5901 not found: ID does not exist" Jul 27 19:57:02.896014 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.895977 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/197a8d42-453a-49bc-9297-c5cbc2d79872-maas-api-tls\") pod \"197a8d42-453a-49bc-9297-c5cbc2d79872\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " Jul 27 19:57:02.896188 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.896040 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/197a8d42-453a-49bc-9297-c5cbc2d79872-openshift-service-ca\") pod \"197a8d42-453a-49bc-9297-c5cbc2d79872\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " Jul 27 19:57:02.896188 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.896083 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qltn4\" (UniqueName: \"kubernetes.io/projected/197a8d42-453a-49bc-9297-c5cbc2d79872-kube-api-access-qltn4\") pod \"197a8d42-453a-49bc-9297-c5cbc2d79872\" (UID: \"197a8d42-453a-49bc-9297-c5cbc2d79872\") " Jul 27 19:57:02.896487 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.896457 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/197a8d42-453a-49bc-9297-c5cbc2d79872-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "197a8d42-453a-49bc-9297-c5cbc2d79872" (UID: "197a8d42-453a-49bc-9297-c5cbc2d79872"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:57:02.898295 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.898264 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/197a8d42-453a-49bc-9297-c5cbc2d79872-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "197a8d42-453a-49bc-9297-c5cbc2d79872" (UID: "197a8d42-453a-49bc-9297-c5cbc2d79872"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:57:02.898384 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.898298 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/197a8d42-453a-49bc-9297-c5cbc2d79872-kube-api-access-qltn4" (OuterVolumeSpecName: "kube-api-access-qltn4") pod "197a8d42-453a-49bc-9297-c5cbc2d79872" (UID: "197a8d42-453a-49bc-9297-c5cbc2d79872"). InnerVolumeSpecName "kube-api-access-qltn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:57:02.997731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.997688 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/197a8d42-453a-49bc-9297-c5cbc2d79872-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:02.997731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.997723 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/197a8d42-453a-49bc-9297-c5cbc2d79872-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:02.997731 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:02.997733 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qltn4\" (UniqueName: \"kubernetes.io/projected/197a8d42-453a-49bc-9297-c5cbc2d79872-kube-api-access-qltn4\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:03.156215 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:03.156181 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8"] Jul 27 19:57:03.159625 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:03.159599 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c241bf21-5b96c964c8-g4lq8"] Jul 27 19:57:04.656462 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:04.656430 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="197a8d42-453a-49bc-9297-c5cbc2d79872" path="/var/lib/kubelet/pods/197a8d42-453a-49bc-9297-c5cbc2d79872/volumes" Jul 27 19:57:07.185412 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:07.185374 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq"] Jul 27 19:57:07.189095 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:07.189071 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c241bf21-z96kq"] Jul 27 19:57:08.656939 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:08.656898 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be63da2f-5982-492a-9a52-46f877445278" path="/var/lib/kubelet/pods/be63da2f-5982-492a-9a52-46f877445278/volumes" Jul 27 19:57:10.622054 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622021 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj"] Jul 27 19:57:10.622398 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622329 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be63da2f-5982-492a-9a52-46f877445278" containerName="revoke-keys" Jul 27 19:57:10.622398 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622339 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="be63da2f-5982-492a-9a52-46f877445278" containerName="revoke-keys" Jul 27 19:57:10.622398 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622350 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="197a8d42-453a-49bc-9297-c5cbc2d79872" containerName="maas-api" Jul 27 19:57:10.622398 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622355 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="197a8d42-453a-49bc-9297-c5cbc2d79872" containerName="maas-api" Jul 27 19:57:10.622541 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622430 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="be63da2f-5982-492a-9a52-46f877445278" containerName="revoke-keys" Jul 27 19:57:10.622541 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.622440 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="197a8d42-453a-49bc-9297-c5cbc2d79872" containerName="maas-api" Jul 27 19:57:10.626614 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.626597 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.629349 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.629325 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3ace1558-serving-cert\"" Jul 27 19:57:10.635863 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.635839 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj"] Jul 27 19:57:10.761954 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.761923 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8620db82-1d53-417e-ab0b-4fdc0313663c-maas-api-tls\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.762149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.761972 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8620db82-1d53-417e-ab0b-4fdc0313663c-openshift-service-ca\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.762149 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.761995 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctc5f\" (UniqueName: \"kubernetes.io/projected/8620db82-1d53-417e-ab0b-4fdc0313663c-kube-api-access-ctc5f\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.863019 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.862979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8620db82-1d53-417e-ab0b-4fdc0313663c-openshift-service-ca\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.863178 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.863031 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctc5f\" (UniqueName: \"kubernetes.io/projected/8620db82-1d53-417e-ab0b-4fdc0313663c-kube-api-access-ctc5f\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.863178 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.863095 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8620db82-1d53-417e-ab0b-4fdc0313663c-maas-api-tls\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.863621 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.863575 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8620db82-1d53-417e-ab0b-4fdc0313663c-openshift-service-ca\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.865483 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.865462 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8620db82-1d53-417e-ab0b-4fdc0313663c-maas-api-tls\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.873825 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.873756 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctc5f\" (UniqueName: \"kubernetes.io/projected/8620db82-1d53-417e-ab0b-4fdc0313663c-kube-api-access-ctc5f\") pod \"maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:10.938389 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:10.938284 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:11.069783 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:11.069693 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj"] Jul 27 19:57:11.072056 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:57:11.072023 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8620db82_1d53_417e_ab0b_4fdc0313663c.slice/crio-75ee499102264caffd5fb0daf2f54a0621a0fcdb401bc9b7909ae976ee53017f WatchSource:0}: Error finding container 75ee499102264caffd5fb0daf2f54a0621a0fcdb401bc9b7909ae976ee53017f: Status 404 returned error can't find the container with id 75ee499102264caffd5fb0daf2f54a0621a0fcdb401bc9b7909ae976ee53017f Jul 27 19:57:11.881366 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:11.881327 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" event={"ID":"8620db82-1d53-417e-ab0b-4fdc0313663c","Type":"ContainerStarted","Data":"b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da"} Jul 27 19:57:11.881772 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:11.881380 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" event={"ID":"8620db82-1d53-417e-ab0b-4fdc0313663c","Type":"ContainerStarted","Data":"75ee499102264caffd5fb0daf2f54a0621a0fcdb401bc9b7909ae976ee53017f"} Jul 27 19:57:11.881772 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:11.881468 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:11.908417 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:11.908372 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" podStartSLOduration=1.552960642 podStartE2EDuration="1.908357145s" totalImagesPullingTime="355.396503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:11.907092698 +0000 UTC m=+1889.726345350" watchObservedRunningTime="2026-07-27 19:57:11.908357145 +0000 UTC m=+1889.727609782" Jul 27 19:57:17.892643 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:17.892614 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:36.096868 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.096833 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k"] Jul 27 19:57:36.104671 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.104645 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k"] Jul 27 19:57:36.104854 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.104731 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:36.107363 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.107343 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 19:57:36.188365 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.188336 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c2d337-3c86-49ef-9587-d5940c68d357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k\" (UID: \"27c2d337-3c86-49ef-9587-d5940c68d357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:36.289162 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.289131 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c2d337-3c86-49ef-9587-d5940c68d357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k\" (UID: \"27c2d337-3c86-49ef-9587-d5940c68d357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:36.289761 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.289741 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c2d337-3c86-49ef-9587-d5940c68d357-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k\" (UID: \"27c2d337-3c86-49ef-9587-d5940c68d357\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:36.416141 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.416064 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:36.546064 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:36.546040 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k"] Jul 27 19:57:36.548721 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:57:36.548693 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c2d337_3c86_49ef_9587_d5940c68d357.slice/crio-80c4d39c807d2cc40e097f078a6d9f02c583d18d8394a52ab74b6df8725ae148 WatchSource:0}: Error finding container 80c4d39c807d2cc40e097f078a6d9f02c583d18d8394a52ab74b6df8725ae148: Status 404 returned error can't find the container with id 80c4d39c807d2cc40e097f078a6d9f02c583d18d8394a52ab74b6df8725ae148 Jul 27 19:57:37.012374 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:37.012341 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" event={"ID":"27c2d337-3c86-49ef-9587-d5940c68d357","Type":"ContainerStarted","Data":"9c56ebc80143d8d0ead03c4e2e292d9ed2bb87b406d45339f62d9cb7ac9dce96"} Jul 27 19:57:37.012529 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:37.012388 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" event={"ID":"27c2d337-3c86-49ef-9587-d5940c68d357","Type":"ContainerStarted","Data":"80c4d39c807d2cc40e097f078a6d9f02c583d18d8394a52ab74b6df8725ae148"} Jul 27 19:57:37.029960 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:37.029911 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" podStartSLOduration=1.029895161 podStartE2EDuration="1.029895161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:37.02712593 +0000 UTC m=+1914.846378568" watchObservedRunningTime="2026-07-27 19:57:37.029895161 +0000 UTC m=+1914.849147799" Jul 27 19:57:38.019191 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:38.019159 2584 generic.go:356] "Generic (PLEG): container finished" podID="27c2d337-3c86-49ef-9587-d5940c68d357" containerID="9c56ebc80143d8d0ead03c4e2e292d9ed2bb87b406d45339f62d9cb7ac9dce96" exitCode=0 Jul 27 19:57:38.019610 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:38.019249 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" event={"ID":"27c2d337-3c86-49ef-9587-d5940c68d357","Type":"ContainerDied","Data":"9c56ebc80143d8d0ead03c4e2e292d9ed2bb87b406d45339f62d9cb7ac9dce96"} Jul 27 19:57:39.151655 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:39.151631 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:39.209984 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:39.209956 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c2d337-3c86-49ef-9587-d5940c68d357-maas-api-service-ca\") pod \"27c2d337-3c86-49ef-9587-d5940c68d357\" (UID: \"27c2d337-3c86-49ef-9587-d5940c68d357\") " Jul 27 19:57:39.210262 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:39.210240 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27c2d337-3c86-49ef-9587-d5940c68d357-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27c2d337-3c86-49ef-9587-d5940c68d357" (UID: "27c2d337-3c86-49ef-9587-d5940c68d357"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:57:39.310791 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:39.310722 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27c2d337-3c86-49ef-9587-d5940c68d357-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:40.029860 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:40.029829 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" Jul 27 19:57:40.030035 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:40.029824 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k" event={"ID":"27c2d337-3c86-49ef-9587-d5940c68d357","Type":"ContainerDied","Data":"80c4d39c807d2cc40e097f078a6d9f02c583d18d8394a52ab74b6df8725ae148"} Jul 27 19:57:40.030035 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:40.029948 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80c4d39c807d2cc40e097f078a6d9f02c583d18d8394a52ab74b6df8725ae148" Jul 27 19:57:46.578869 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.578832 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj"] Jul 27 19:57:46.579376 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.579088 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" podUID="8620db82-1d53-417e-ab0b-4fdc0313663c" containerName="maas-api" containerID="cri-o://b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da" gracePeriod=30 Jul 27 19:57:46.822224 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.822200 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:46.871483 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.871399 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctc5f\" (UniqueName: \"kubernetes.io/projected/8620db82-1d53-417e-ab0b-4fdc0313663c-kube-api-access-ctc5f\") pod \"8620db82-1d53-417e-ab0b-4fdc0313663c\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " Jul 27 19:57:46.871672 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.871523 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8620db82-1d53-417e-ab0b-4fdc0313663c-openshift-service-ca\") pod \"8620db82-1d53-417e-ab0b-4fdc0313663c\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " Jul 27 19:57:46.871672 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.871632 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8620db82-1d53-417e-ab0b-4fdc0313663c-maas-api-tls\") pod \"8620db82-1d53-417e-ab0b-4fdc0313663c\" (UID: \"8620db82-1d53-417e-ab0b-4fdc0313663c\") " Jul 27 19:57:46.871902 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.871875 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8620db82-1d53-417e-ab0b-4fdc0313663c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8620db82-1d53-417e-ab0b-4fdc0313663c" (UID: "8620db82-1d53-417e-ab0b-4fdc0313663c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:57:46.873681 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.873657 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8620db82-1d53-417e-ab0b-4fdc0313663c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8620db82-1d53-417e-ab0b-4fdc0313663c" (UID: "8620db82-1d53-417e-ab0b-4fdc0313663c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:57:46.873792 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.873774 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8620db82-1d53-417e-ab0b-4fdc0313663c-kube-api-access-ctc5f" (OuterVolumeSpecName: "kube-api-access-ctc5f") pod "8620db82-1d53-417e-ab0b-4fdc0313663c" (UID: "8620db82-1d53-417e-ab0b-4fdc0313663c"). InnerVolumeSpecName "kube-api-access-ctc5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:57:46.972173 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.972146 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8620db82-1d53-417e-ab0b-4fdc0313663c-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:46.972173 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.972173 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctc5f\" (UniqueName: \"kubernetes.io/projected/8620db82-1d53-417e-ab0b-4fdc0313663c-kube-api-access-ctc5f\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:46.972342 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:46.972183 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8620db82-1d53-417e-ab0b-4fdc0313663c-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:57:47.064730 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.064700 2584 generic.go:356] "Generic (PLEG): container finished" podID="8620db82-1d53-417e-ab0b-4fdc0313663c" containerID="b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da" exitCode=0 Jul 27 19:57:47.064874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.064749 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" Jul 27 19:57:47.064874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.064766 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" event={"ID":"8620db82-1d53-417e-ab0b-4fdc0313663c","Type":"ContainerDied","Data":"b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da"} Jul 27 19:57:47.064874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.064810 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj" event={"ID":"8620db82-1d53-417e-ab0b-4fdc0313663c","Type":"ContainerDied","Data":"75ee499102264caffd5fb0daf2f54a0621a0fcdb401bc9b7909ae976ee53017f"} Jul 27 19:57:47.064874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.064831 2584 scope.go:117] "RemoveContainer" containerID="b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da" Jul 27 19:57:47.075341 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.075325 2584 scope.go:117] "RemoveContainer" containerID="b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da" Jul 27 19:57:47.075612 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:57:47.075568 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da\": container with ID starting with b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da not found: ID does not exist" containerID="b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da" Jul 27 19:57:47.075713 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.075615 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da"} err="failed to get container status \"b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da\": rpc error: code = NotFound desc = could not find container \"b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da\": container with ID starting with b02c13bb23ebfe23db780f18cc8f4e6cf3be80b9d386b2146c2cbd74d8a174da not found: ID does not exist" Jul 27 19:57:47.080113 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:57:47.080093 2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8620db82_1d53_417e_ab0b_4fdc0313663c.slice\": RecentStats: unable to find data in memory cache]" Jul 27 19:57:47.088686 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.088665 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj"] Jul 27 19:57:47.092045 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:47.092026 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ace1558-7cb64f544f-8lxwj"] Jul 27 19:57:48.656870 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:48.656837 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8620db82-1d53-417e-ab0b-4fdc0313663c" path="/var/lib/kubelet/pods/8620db82-1d53-417e-ab0b-4fdc0313663c/volumes" Jul 27 19:57:51.163576 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:51.163490 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k"] Jul 27 19:57:51.165334 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:51.165314 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ace1558-ddx4k"] Jul 27 19:57:52.656428 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:52.656393 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27c2d337-3c86-49ef-9587-d5940c68d357" path="/var/lib/kubelet/pods/27c2d337-3c86-49ef-9587-d5940c68d357/volumes" Jul 27 19:57:55.592025 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.591995 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf"] Jul 27 19:57:55.592461 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.592386 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8620db82-1d53-417e-ab0b-4fdc0313663c" containerName="maas-api" Jul 27 19:57:55.592461 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.592400 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8620db82-1d53-417e-ab0b-4fdc0313663c" containerName="maas-api" Jul 27 19:57:55.592461 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.592415 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27c2d337-3c86-49ef-9587-d5940c68d357" containerName="revoke-keys" Jul 27 19:57:55.592461 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.592420 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="27c2d337-3c86-49ef-9587-d5940c68d357" containerName="revoke-keys" Jul 27 19:57:55.592622 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.592482 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8620db82-1d53-417e-ab0b-4fdc0313663c" containerName="maas-api" Jul 27 19:57:55.592622 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.592490 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="27c2d337-3c86-49ef-9587-d5940c68d357" containerName="revoke-keys" Jul 27 19:57:55.596567 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.596547 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.600320 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.600299 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-6ac18d4b-serving-cert\"" Jul 27 19:57:55.609870 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.609850 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf"] Jul 27 19:57:55.642739 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.642710 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-maas-api-tls\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.642874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.642790 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7dt\" (UniqueName: \"kubernetes.io/projected/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-kube-api-access-zj7dt\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.642874 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.642827 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-openshift-service-ca\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.743623 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.743566 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7dt\" (UniqueName: \"kubernetes.io/projected/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-kube-api-access-zj7dt\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.743623 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.743625 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-openshift-service-ca\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.743832 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.743661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-maas-api-tls\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.744261 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.744238 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-openshift-service-ca\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.746239 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.746214 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-maas-api-tls\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.751235 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.751213 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7dt\" (UniqueName: \"kubernetes.io/projected/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-kube-api-access-zj7dt\") pod \"maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:55.906185 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:55.906106 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:56.040748 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:56.040715 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf"] Jul 27 19:57:56.042333 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:57:56.042310 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd345c2ca_1cc0_409a_b5d8_1f4bde41e8dc.slice/crio-05ca3909e1585c1ed985ac8696b941dc9f652638f4c4f875e7ddcc7c8ab5d327 WatchSource:0}: Error finding container 05ca3909e1585c1ed985ac8696b941dc9f652638f4c4f875e7ddcc7c8ab5d327: Status 404 returned error can't find the container with id 05ca3909e1585c1ed985ac8696b941dc9f652638f4c4f875e7ddcc7c8ab5d327 Jul 27 19:57:56.111961 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:56.111929 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" event={"ID":"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc","Type":"ContainerStarted","Data":"05ca3909e1585c1ed985ac8696b941dc9f652638f4c4f875e7ddcc7c8ab5d327"} Jul 27 19:57:57.119031 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:57.118990 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" event={"ID":"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc","Type":"ContainerStarted","Data":"a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916"} Jul 27 19:57:57.119514 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:57.119123 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:57:57.148906 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:57:57.148860 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" podStartSLOduration=1.7407219999999999 podStartE2EDuration="2.148845913s" totalImagesPullingTime="408.123913ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:57:57.147030044 +0000 UTC m=+1934.966282681" watchObservedRunningTime="2026-07-27 19:57:57.148845913 +0000 UTC m=+1934.968098549" Jul 27 19:58:03.128789 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:03.128760 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:58:20.353999 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.353963 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p"] Jul 27 19:58:20.364506 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.364472 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:20.364704 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.364628 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p"] Jul 27 19:58:20.367133 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.367107 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 19:58:20.455114 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.455085 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ff50bda-2a40-40bb-9937-00033f239d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p\" (UID: \"5ff50bda-2a40-40bb-9937-00033f239d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:20.556002 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.555973 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ff50bda-2a40-40bb-9937-00033f239d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p\" (UID: \"5ff50bda-2a40-40bb-9937-00033f239d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:20.556560 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.556520 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ff50bda-2a40-40bb-9937-00033f239d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p\" (UID: \"5ff50bda-2a40-40bb-9937-00033f239d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:20.675824 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.675748 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:20.805283 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:20.805256 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p"] Jul 27 19:58:20.807310 ip-10-0-136-113 kubenswrapper[2584]: W0727 19:58:20.807283 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff50bda_2a40_40bb_9937_00033f239d44.slice/crio-0e2790c774151ac74ba44da30203f6d8653f41318fb6e2b7ff7548fb460ec391 WatchSource:0}: Error finding container 0e2790c774151ac74ba44da30203f6d8653f41318fb6e2b7ff7548fb460ec391: Status 404 returned error can't find the container with id 0e2790c774151ac74ba44da30203f6d8653f41318fb6e2b7ff7548fb460ec391 Jul 27 19:58:21.247101 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:21.247064 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" event={"ID":"5ff50bda-2a40-40bb-9937-00033f239d44","Type":"ContainerStarted","Data":"f2f6e9aff9d4d60d4821474d2d642ba6887a383bf43d8ecb4f1d578938dbfdf6"} Jul 27 19:58:21.247292 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:21.247122 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" event={"ID":"5ff50bda-2a40-40bb-9937-00033f239d44","Type":"ContainerStarted","Data":"0e2790c774151ac74ba44da30203f6d8653f41318fb6e2b7ff7548fb460ec391"} Jul 27 19:58:21.264330 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:21.264237 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" podStartSLOduration=1.264222253 podStartE2EDuration="1.264222253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:58:21.261334799 +0000 UTC m=+1959.080587435" watchObservedRunningTime="2026-07-27 19:58:21.264222253 +0000 UTC m=+1959.083474890" Jul 27 19:58:22.253649 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:22.253605 2584 generic.go:356] "Generic (PLEG): container finished" podID="5ff50bda-2a40-40bb-9937-00033f239d44" containerID="f2f6e9aff9d4d60d4821474d2d642ba6887a383bf43d8ecb4f1d578938dbfdf6" exitCode=0 Jul 27 19:58:22.254036 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:22.253699 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" event={"ID":"5ff50bda-2a40-40bb-9937-00033f239d44","Type":"ContainerDied","Data":"f2f6e9aff9d4d60d4821474d2d642ba6887a383bf43d8ecb4f1d578938dbfdf6"} Jul 27 19:58:23.389361 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:23.389338 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:23.480464 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:23.480430 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ff50bda-2a40-40bb-9937-00033f239d44-maas-api-service-ca\") pod \"5ff50bda-2a40-40bb-9937-00033f239d44\" (UID: \"5ff50bda-2a40-40bb-9937-00033f239d44\") " Jul 27 19:58:23.480810 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:23.480789 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff50bda-2a40-40bb-9937-00033f239d44-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ff50bda-2a40-40bb-9937-00033f239d44" (UID: "5ff50bda-2a40-40bb-9937-00033f239d44"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:58:23.581998 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:23.581929 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ff50bda-2a40-40bb-9937-00033f239d44-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:58:24.265773 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:24.265740 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" Jul 27 19:58:24.265970 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:24.265776 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p" event={"ID":"5ff50bda-2a40-40bb-9937-00033f239d44","Type":"ContainerDied","Data":"0e2790c774151ac74ba44da30203f6d8653f41318fb6e2b7ff7548fb460ec391"} Jul 27 19:58:24.265970 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:24.265845 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e2790c774151ac74ba44da30203f6d8653f41318fb6e2b7ff7548fb460ec391" Jul 27 19:58:30.761763 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:30.761727 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf"] Jul 27 19:58:30.762195 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:30.761931 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" podUID="d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" containerName="maas-api" containerID="cri-o://a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916" gracePeriod=30 Jul 27 19:58:31.018311 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.018256 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:58:31.044693 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.044668 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-maas-api-tls\") pod \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " Jul 27 19:58:31.044826 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.044701 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-openshift-service-ca\") pod \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " Jul 27 19:58:31.044826 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.044740 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj7dt\" (UniqueName: \"kubernetes.io/projected/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-kube-api-access-zj7dt\") pod \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\" (UID: \"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc\") " Jul 27 19:58:31.045099 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.045069 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" (UID: "d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 19:58:31.047009 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.046981 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-kube-api-access-zj7dt" (OuterVolumeSpecName: "kube-api-access-zj7dt") pod "d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" (UID: "d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc"). InnerVolumeSpecName "kube-api-access-zj7dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 19:58:31.047092 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.047004 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" (UID: "d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 19:58:31.145993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.145968 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:58:31.145993 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.145993 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:58:31.146169 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.146004 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj7dt\" (UniqueName: \"kubernetes.io/projected/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc-kube-api-access-zj7dt\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 19:58:31.301407 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.301317 2584 generic.go:356] "Generic (PLEG): container finished" podID="d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" containerID="a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916" exitCode=0 Jul 27 19:58:31.301407 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.301363 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" Jul 27 19:58:31.301615 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.301401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" event={"ID":"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc","Type":"ContainerDied","Data":"a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916"} Jul 27 19:58:31.301615 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.301452 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf" event={"ID":"d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc","Type":"ContainerDied","Data":"05ca3909e1585c1ed985ac8696b941dc9f652638f4c4f875e7ddcc7c8ab5d327"} Jul 27 19:58:31.301615 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.301474 2584 scope.go:117] "RemoveContainer" containerID="a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916" Jul 27 19:58:31.310634 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.310613 2584 scope.go:117] "RemoveContainer" containerID="a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916" Jul 27 19:58:31.310882 ip-10-0-136-113 kubenswrapper[2584]: E0727 19:58:31.310864 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916\": container with ID starting with a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916 not found: ID does not exist" containerID="a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916" Jul 27 19:58:31.310950 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.310890 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916"} err="failed to get container status \"a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916\": rpc error: code = NotFound desc = could not find container \"a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916\": container with ID starting with a589200deaa3f1db4d94fb8478eb06c9dceb5f60aeab4b28b638fb97f810a916 not found: ID does not exist" Jul 27 19:58:31.322541 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.322516 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf"] Jul 27 19:58:31.326166 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:31.326146 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6ac18d4b-5dc875c7bd-ngwpf"] Jul 27 19:58:32.656637 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:32.656604 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" path="/var/lib/kubelet/pods/d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc/volumes" Jul 27 19:58:35.468895 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:35.468784 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p"] Jul 27 19:58:35.470963 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:35.470943 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-6ac18d4b-c798p"] Jul 27 19:58:36.656464 ip-10-0-136-113 kubenswrapper[2584]: I0727 19:58:36.656423 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ff50bda-2a40-40bb-9937-00033f239d44" path="/var/lib/kubelet/pods/5ff50bda-2a40-40bb-9937-00033f239d44/volumes" Jul 27 20:00:17.092838 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.092802 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg"] Jul 27 20:00:17.093401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.093120 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" containerName="maas-api" Jul 27 20:00:17.093401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.093130 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" containerName="maas-api" Jul 27 20:00:17.093401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.093147 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff50bda-2a40-40bb-9937-00033f239d44" containerName="revoke-keys" Jul 27 20:00:17.093401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.093153 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff50bda-2a40-40bb-9937-00033f239d44" containerName="revoke-keys" Jul 27 20:00:17.093401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.093206 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d345c2ca-1cc0-409a-b5d8-1f4bde41e8dc" containerName="maas-api" Jul 27 20:00:17.093401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.093216 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff50bda-2a40-40bb-9937-00033f239d44" containerName="revoke-keys" Jul 27 20:00:17.096241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.096222 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.099375 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.099359 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-61128fd0-serving-cert\"" Jul 27 20:00:17.108898 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.108877 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg"] Jul 27 20:00:17.210552 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.210520 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.210724 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.210564 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a1c86-b572-4dce-911c-93e5379a006c-openshift-service-ca\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.210724 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.210652 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw6ss\" (UniqueName: \"kubernetes.io/projected/7a6a1c86-b572-4dce-911c-93e5379a006c-kube-api-access-pw6ss\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.311389 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.311359 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw6ss\" (UniqueName: \"kubernetes.io/projected/7a6a1c86-b572-4dce-911c-93e5379a006c-kube-api-access-pw6ss\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.311550 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.311421 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.311550 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.311446 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a1c86-b572-4dce-911c-93e5379a006c-openshift-service-ca\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.311695 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:00:17.311572 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-serving-cert: secret "maas-api-e2e-mt-61128fd0-serving-cert" not found Jul 27 20:00:17.311695 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:00:17.311656 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls podName:7a6a1c86-b572-4dce-911c-93e5379a006c nodeName:}" failed. No retries permitted until 2026-07-27 20:00:17.811638849 +0000 UTC m=+2075.630891464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls") pod "maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" (UID: "7a6a1c86-b572-4dce-911c-93e5379a006c") : secret "maas-api-e2e-mt-61128fd0-serving-cert" not found Jul 27 20:00:17.312034 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.312016 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a1c86-b572-4dce-911c-93e5379a006c-openshift-service-ca\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.321909 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.321877 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw6ss\" (UniqueName: \"kubernetes.io/projected/7a6a1c86-b572-4dce-911c-93e5379a006c-kube-api-access-pw6ss\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.815456 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.815417 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:17.817944 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:17.817919 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls\") pod \"maas-api-e2e-mt-61128fd0-595dff698f-tvhwg\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:18.008887 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:18.008849 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:18.141104 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:18.141080 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg"] Jul 27 20:00:18.143031 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:00:18.143006 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6a1c86_b572_4dce_911c_93e5379a006c.slice/crio-c8b1c581025ba6fda7652f4bd60aed9977f607d19c884eb2ec785ba10284ab8c WatchSource:0}: Error finding container c8b1c581025ba6fda7652f4bd60aed9977f607d19c884eb2ec785ba10284ab8c: Status 404 returned error can't find the container with id c8b1c581025ba6fda7652f4bd60aed9977f607d19c884eb2ec785ba10284ab8c Jul 27 20:00:18.830983 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:18.830959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" event={"ID":"7a6a1c86-b572-4dce-911c-93e5379a006c","Type":"ContainerStarted","Data":"c8b1c581025ba6fda7652f4bd60aed9977f607d19c884eb2ec785ba10284ab8c"} Jul 27 20:00:19.837443 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:19.837407 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" event={"ID":"7a6a1c86-b572-4dce-911c-93e5379a006c","Type":"ContainerStarted","Data":"48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83"} Jul 27 20:00:19.837957 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:19.837547 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:19.854841 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:19.854783 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" podStartSLOduration=2.201139405 podStartE2EDuration="2.854764353s" totalImagesPullingTime="653.624948ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:19.853044807 +0000 UTC m=+2077.672297445" watchObservedRunningTime="2026-07-27 20:00:19.854764353 +0000 UTC m=+2077.674016991" Jul 27 20:00:25.848600 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:25.848555 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:28.844406 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:28.844371 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5"] Jul 27 20:00:28.847749 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:28.847734 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:28.850591 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:28.850554 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 20:00:28.856007 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:28.855983 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5"] Jul 27 20:00:28.908911 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:28.908880 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5123cfa-e363-4141-b030-e4f36d6fbb52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5\" (UID: \"e5123cfa-e363-4141-b030-e4f36d6fbb52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:29.010246 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.010215 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5123cfa-e363-4141-b030-e4f36d6fbb52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5\" (UID: \"e5123cfa-e363-4141-b030-e4f36d6fbb52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:29.010832 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.010815 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5123cfa-e363-4141-b030-e4f36d6fbb52-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5\" (UID: \"e5123cfa-e363-4141-b030-e4f36d6fbb52\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:29.159274 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.159198 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:29.288568 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.288539 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5"] Jul 27 20:00:29.290317 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:00:29.290284 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5123cfa_e363_4141_b030_e4f36d6fbb52.slice/crio-1078d651677031981298b463b481109d436c536750437e003a7d3e0086e96100 WatchSource:0}: Error finding container 1078d651677031981298b463b481109d436c536750437e003a7d3e0086e96100: Status 404 returned error can't find the container with id 1078d651677031981298b463b481109d436c536750437e003a7d3e0086e96100 Jul 27 20:00:29.888136 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.888103 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" event={"ID":"e5123cfa-e363-4141-b030-e4f36d6fbb52","Type":"ContainerStarted","Data":"2724a882dbca7371a12c7e3efe1fe87fd63002e96c78de628cb087a1992fbfba"} Jul 27 20:00:29.888529 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.888150 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" event={"ID":"e5123cfa-e363-4141-b030-e4f36d6fbb52","Type":"ContainerStarted","Data":"1078d651677031981298b463b481109d436c536750437e003a7d3e0086e96100"} Jul 27 20:00:29.904919 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:29.904872 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" podStartSLOduration=1.9048549430000001 podStartE2EDuration="1.904854943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:00:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:00:29.902981227 +0000 UTC m=+2087.722233884" watchObservedRunningTime="2026-07-27 20:00:29.904854943 +0000 UTC m=+2087.724107600" Jul 27 20:00:30.894296 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:30.894267 2584 generic.go:356] "Generic (PLEG): container finished" podID="e5123cfa-e363-4141-b030-e4f36d6fbb52" containerID="2724a882dbca7371a12c7e3efe1fe87fd63002e96c78de628cb087a1992fbfba" exitCode=0 Jul 27 20:00:30.894718 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:30.894359 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" event={"ID":"e5123cfa-e363-4141-b030-e4f36d6fbb52","Type":"ContainerDied","Data":"2724a882dbca7371a12c7e3efe1fe87fd63002e96c78de628cb087a1992fbfba"} Jul 27 20:00:32.040462 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.040436 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:32.137483 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.137451 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5123cfa-e363-4141-b030-e4f36d6fbb52-maas-api-service-ca\") pod \"e5123cfa-e363-4141-b030-e4f36d6fbb52\" (UID: \"e5123cfa-e363-4141-b030-e4f36d6fbb52\") " Jul 27 20:00:32.137880 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.137849 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5123cfa-e363-4141-b030-e4f36d6fbb52-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e5123cfa-e363-4141-b030-e4f36d6fbb52" (UID: "e5123cfa-e363-4141-b030-e4f36d6fbb52"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:00:32.238873 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.238806 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5123cfa-e363-4141-b030-e4f36d6fbb52-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:00:32.905931 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.905895 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" event={"ID":"e5123cfa-e363-4141-b030-e4f36d6fbb52","Type":"ContainerDied","Data":"1078d651677031981298b463b481109d436c536750437e003a7d3e0086e96100"} Jul 27 20:00:32.906096 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.905945 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1078d651677031981298b463b481109d436c536750437e003a7d3e0086e96100" Jul 27 20:00:32.906096 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:32.905904 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5" Jul 27 20:00:39.371471 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.371438 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg"] Jul 27 20:00:39.371863 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.371690 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" podUID="7a6a1c86-b572-4dce-911c-93e5379a006c" containerName="maas-api" containerID="cri-o://48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83" gracePeriod=30 Jul 27 20:00:39.625251 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.625195 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:39.695774 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.695745 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls\") pod \"7a6a1c86-b572-4dce-911c-93e5379a006c\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " Jul 27 20:00:39.695969 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.695846 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw6ss\" (UniqueName: \"kubernetes.io/projected/7a6a1c86-b572-4dce-911c-93e5379a006c-kube-api-access-pw6ss\") pod \"7a6a1c86-b572-4dce-911c-93e5379a006c\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " Jul 27 20:00:39.695969 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.695884 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a1c86-b572-4dce-911c-93e5379a006c-openshift-service-ca\") pod \"7a6a1c86-b572-4dce-911c-93e5379a006c\" (UID: \"7a6a1c86-b572-4dce-911c-93e5379a006c\") " Jul 27 20:00:39.696280 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.696251 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a6a1c86-b572-4dce-911c-93e5379a006c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a6a1c86-b572-4dce-911c-93e5379a006c" (UID: "7a6a1c86-b572-4dce-911c-93e5379a006c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:00:39.697944 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.697922 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a6a1c86-b572-4dce-911c-93e5379a006c" (UID: "7a6a1c86-b572-4dce-911c-93e5379a006c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:00:39.698053 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.698033 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6a1c86-b572-4dce-911c-93e5379a006c-kube-api-access-pw6ss" (OuterVolumeSpecName: "kube-api-access-pw6ss") pod "7a6a1c86-b572-4dce-911c-93e5379a006c" (UID: "7a6a1c86-b572-4dce-911c-93e5379a006c"). InnerVolumeSpecName "kube-api-access-pw6ss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:00:39.797284 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.797258 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a6a1c86-b572-4dce-911c-93e5379a006c-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:00:39.797284 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.797285 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw6ss\" (UniqueName: \"kubernetes.io/projected/7a6a1c86-b572-4dce-911c-93e5379a006c-kube-api-access-pw6ss\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:00:39.797473 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.797299 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6a1c86-b572-4dce-911c-93e5379a006c-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:00:39.940979 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.940888 2584 generic.go:356] "Generic (PLEG): container finished" podID="7a6a1c86-b572-4dce-911c-93e5379a006c" containerID="48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83" exitCode=0 Jul 27 20:00:39.940979 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.940957 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" Jul 27 20:00:39.940979 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.940968 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" event={"ID":"7a6a1c86-b572-4dce-911c-93e5379a006c","Type":"ContainerDied","Data":"48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83"} Jul 27 20:00:39.941249 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.941032 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg" event={"ID":"7a6a1c86-b572-4dce-911c-93e5379a006c","Type":"ContainerDied","Data":"c8b1c581025ba6fda7652f4bd60aed9977f607d19c884eb2ec785ba10284ab8c"} Jul 27 20:00:39.941249 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.941051 2584 scope.go:117] "RemoveContainer" containerID="48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83" Jul 27 20:00:39.950896 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.950879 2584 scope.go:117] "RemoveContainer" containerID="48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83" Jul 27 20:00:39.951121 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:00:39.951100 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83\": container with ID starting with 48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83 not found: ID does not exist" containerID="48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83" Jul 27 20:00:39.951192 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.951131 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83"} err="failed to get container status \"48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83\": rpc error: code = NotFound desc = could not find container \"48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83\": container with ID starting with 48b475873dabe3c97113278316e11728fb6842aacaa42c457ab9152200093c83 not found: ID does not exist" Jul 27 20:00:39.961651 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.961630 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg"] Jul 27 20:00:39.965183 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:39.965162 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-61128fd0-595dff698f-tvhwg"] Jul 27 20:00:40.657104 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:40.657075 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6a1c86-b572-4dce-911c-93e5379a006c" path="/var/lib/kubelet/pods/7a6a1c86-b572-4dce-911c-93e5379a006c/volumes" Jul 27 20:00:43.915904 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:43.915866 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5"] Jul 27 20:00:43.918439 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:43.918414 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-61128fd0-hjtt5"] Jul 27 20:00:44.657237 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:00:44.657205 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5123cfa-e363-4141-b030-e4f36d6fbb52" path="/var/lib/kubelet/pods/e5123cfa-e363-4141-b030-e4f36d6fbb52/volumes" Jul 27 20:01:12.130830 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.130792 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt"] Jul 27 20:01:12.131428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.131104 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5123cfa-e363-4141-b030-e4f36d6fbb52" containerName="revoke-keys" Jul 27 20:01:12.131428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.131115 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5123cfa-e363-4141-b030-e4f36d6fbb52" containerName="revoke-keys" Jul 27 20:01:12.131428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.131133 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6a1c86-b572-4dce-911c-93e5379a006c" containerName="maas-api" Jul 27 20:01:12.131428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.131138 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6a1c86-b572-4dce-911c-93e5379a006c" containerName="maas-api" Jul 27 20:01:12.131428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.131190 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5123cfa-e363-4141-b030-e4f36d6fbb52" containerName="revoke-keys" Jul 27 20:01:12.131428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.131202 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6a1c86-b572-4dce-911c-93e5379a006c" containerName="maas-api" Jul 27 20:01:12.134560 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.134540 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.137314 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.137287 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5fa9bc6b-serving-cert\"" Jul 27 20:01:12.143549 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.143517 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt"] Jul 27 20:01:12.262003 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.261973 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.262203 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.262023 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b36112-fa40-4fce-8700-0c5e98c11d95-openshift-service-ca\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.262203 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.262051 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brs4q\" (UniqueName: \"kubernetes.io/projected/d3b36112-fa40-4fce-8700-0c5e98c11d95-kube-api-access-brs4q\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.362841 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.362801 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.363033 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.362868 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b36112-fa40-4fce-8700-0c5e98c11d95-openshift-service-ca\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.363033 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.362898 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brs4q\" (UniqueName: \"kubernetes.io/projected/d3b36112-fa40-4fce-8700-0c5e98c11d95-kube-api-access-brs4q\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.363033 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:01:12.362968 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-serving-cert: secret "maas-api-e2e-mt-5fa9bc6b-serving-cert" not found Jul 27 20:01:12.363206 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:01:12.363062 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls podName:d3b36112-fa40-4fce-8700-0c5e98c11d95 nodeName:}" failed. No retries permitted until 2026-07-27 20:01:12.863041614 +0000 UTC m=+2130.682294247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls") pod "maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" (UID: "d3b36112-fa40-4fce-8700-0c5e98c11d95") : secret "maas-api-e2e-mt-5fa9bc6b-serving-cert" not found Jul 27 20:01:12.363550 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.363530 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b36112-fa40-4fce-8700-0c5e98c11d95-openshift-service-ca\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.370907 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.370889 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brs4q\" (UniqueName: \"kubernetes.io/projected/d3b36112-fa40-4fce-8700-0c5e98c11d95-kube-api-access-brs4q\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.868162 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.868124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:12.870817 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:12.870785 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls\") pod \"maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:13.046626 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:13.046576 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:13.185334 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:13.185301 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt"] Jul 27 20:01:13.188539 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:01:13.188507 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b36112_fa40_4fce_8700_0c5e98c11d95.slice/crio-254f90daaf7c1bce8db728fd70c1211a7366ffd0212d805daa4ed9feca372ead WatchSource:0}: Error finding container 254f90daaf7c1bce8db728fd70c1211a7366ffd0212d805daa4ed9feca372ead: Status 404 returned error can't find the container with id 254f90daaf7c1bce8db728fd70c1211a7366ffd0212d805daa4ed9feca372ead Jul 27 20:01:13.189854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:13.189839 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:01:14.120124 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:14.120087 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" event={"ID":"d3b36112-fa40-4fce-8700-0c5e98c11d95","Type":"ContainerStarted","Data":"675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789"} Jul 27 20:01:14.120308 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:14.120140 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" event={"ID":"d3b36112-fa40-4fce-8700-0c5e98c11d95","Type":"ContainerStarted","Data":"254f90daaf7c1bce8db728fd70c1211a7366ffd0212d805daa4ed9feca372ead"} Jul 27 20:01:14.120308 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:14.120191 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:01:14.137484 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:14.137433 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" podStartSLOduration=1.727486414 podStartE2EDuration="2.137417584s" totalImagesPullingTime="409.93117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:01:14.135254003 +0000 UTC m=+2131.954506642" watchObservedRunningTime="2026-07-27 20:01:14.137417584 +0000 UTC m=+2131.956670252" Jul 27 20:01:20.131406 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:01:20.131373 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:02:06.352931 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.352892 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69"] Jul 27 20:02:06.356274 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.356254 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:06.358771 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.358754 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 20:02:06.363860 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.363546 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69"] Jul 27 20:02:06.509211 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.509182 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b74047-dc1d-4086-aa63-57447a87ba47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69\" (UID: \"69b74047-dc1d-4086-aa63-57447a87ba47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:06.610570 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.610491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b74047-dc1d-4086-aa63-57447a87ba47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69\" (UID: \"69b74047-dc1d-4086-aa63-57447a87ba47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:06.611077 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.611059 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b74047-dc1d-4086-aa63-57447a87ba47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69\" (UID: \"69b74047-dc1d-4086-aa63-57447a87ba47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:06.668267 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.668243 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:06.799446 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:06.799423 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69"] Jul 27 20:02:06.801169 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:02:06.801142 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b74047_dc1d_4086_aa63_57447a87ba47.slice/crio-fda573a384ed3897cc886247642176860cfa9b27ee7bbb3f9f5ee206863d3d51 WatchSource:0}: Error finding container fda573a384ed3897cc886247642176860cfa9b27ee7bbb3f9f5ee206863d3d51: Status 404 returned error can't find the container with id fda573a384ed3897cc886247642176860cfa9b27ee7bbb3f9f5ee206863d3d51 Jul 27 20:02:07.384555 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:07.384466 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" event={"ID":"69b74047-dc1d-4086-aa63-57447a87ba47","Type":"ContainerStarted","Data":"bc86a64eb46cb2ddac989bf7756f257eaa1f0bcab9e2860b61cf0452c37ad9eb"} Jul 27 20:02:07.384555 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:07.384518 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" event={"ID":"69b74047-dc1d-4086-aa63-57447a87ba47","Type":"ContainerStarted","Data":"fda573a384ed3897cc886247642176860cfa9b27ee7bbb3f9f5ee206863d3d51"} Jul 27 20:02:07.402014 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:07.401956 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" podStartSLOduration=1.401940848 podStartE2EDuration="1.401940848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:02:07.399930319 +0000 UTC m=+2185.219182957" watchObservedRunningTime="2026-07-27 20:02:07.401940848 +0000 UTC m=+2185.221193486" Jul 27 20:02:08.390992 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:08.390960 2584 generic.go:356] "Generic (PLEG): container finished" podID="69b74047-dc1d-4086-aa63-57447a87ba47" containerID="bc86a64eb46cb2ddac989bf7756f257eaa1f0bcab9e2860b61cf0452c37ad9eb" exitCode=0 Jul 27 20:02:08.391378 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:08.391024 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" event={"ID":"69b74047-dc1d-4086-aa63-57447a87ba47","Type":"ContainerDied","Data":"bc86a64eb46cb2ddac989bf7756f257eaa1f0bcab9e2860b61cf0452c37ad9eb"} Jul 27 20:02:09.529700 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:09.529670 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:09.639878 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:09.639832 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b74047-dc1d-4086-aa63-57447a87ba47-maas-api-service-ca\") pod \"69b74047-dc1d-4086-aa63-57447a87ba47\" (UID: \"69b74047-dc1d-4086-aa63-57447a87ba47\") " Jul 27 20:02:09.640159 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:09.640139 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69b74047-dc1d-4086-aa63-57447a87ba47-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69b74047-dc1d-4086-aa63-57447a87ba47" (UID: "69b74047-dc1d-4086-aa63-57447a87ba47"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:02:09.740789 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:09.740723 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69b74047-dc1d-4086-aa63-57447a87ba47-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:02:10.401878 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:10.401851 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" Jul 27 20:02:10.402039 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:10.401851 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69" event={"ID":"69b74047-dc1d-4086-aa63-57447a87ba47","Type":"ContainerDied","Data":"fda573a384ed3897cc886247642176860cfa9b27ee7bbb3f9f5ee206863d3d51"} Jul 27 20:02:10.402039 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:10.401974 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fda573a384ed3897cc886247642176860cfa9b27ee7bbb3f9f5ee206863d3d51" Jul 27 20:02:21.832164 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:21.832130 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt"] Jul 27 20:02:21.832619 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:21.832381 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" podUID="d3b36112-fa40-4fce-8700-0c5e98c11d95" containerName="maas-api" containerID="cri-o://675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789" gracePeriod=30 Jul 27 20:02:22.075959 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.075938 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:02:22.141832 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.141764 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls\") pod \"d3b36112-fa40-4fce-8700-0c5e98c11d95\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " Jul 27 20:02:22.141967 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.141849 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brs4q\" (UniqueName: \"kubernetes.io/projected/d3b36112-fa40-4fce-8700-0c5e98c11d95-kube-api-access-brs4q\") pod \"d3b36112-fa40-4fce-8700-0c5e98c11d95\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " Jul 27 20:02:22.141967 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.141876 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b36112-fa40-4fce-8700-0c5e98c11d95-openshift-service-ca\") pod \"d3b36112-fa40-4fce-8700-0c5e98c11d95\" (UID: \"d3b36112-fa40-4fce-8700-0c5e98c11d95\") " Jul 27 20:02:22.142246 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.142217 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3b36112-fa40-4fce-8700-0c5e98c11d95-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d3b36112-fa40-4fce-8700-0c5e98c11d95" (UID: "d3b36112-fa40-4fce-8700-0c5e98c11d95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:02:22.143988 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.143965 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d3b36112-fa40-4fce-8700-0c5e98c11d95" (UID: "d3b36112-fa40-4fce-8700-0c5e98c11d95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:02:22.143988 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.143977 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3b36112-fa40-4fce-8700-0c5e98c11d95-kube-api-access-brs4q" (OuterVolumeSpecName: "kube-api-access-brs4q") pod "d3b36112-fa40-4fce-8700-0c5e98c11d95" (UID: "d3b36112-fa40-4fce-8700-0c5e98c11d95"). InnerVolumeSpecName "kube-api-access-brs4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:02:22.242910 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.242878 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3b36112-fa40-4fce-8700-0c5e98c11d95-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:02:22.242910 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.242907 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brs4q\" (UniqueName: \"kubernetes.io/projected/d3b36112-fa40-4fce-8700-0c5e98c11d95-kube-api-access-brs4q\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:02:22.242910 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.242916 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b36112-fa40-4fce-8700-0c5e98c11d95-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:02:22.462444 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.462370 2584 generic.go:356] "Generic (PLEG): container finished" podID="d3b36112-fa40-4fce-8700-0c5e98c11d95" containerID="675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789" exitCode=0 Jul 27 20:02:22.462444 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.462407 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" Jul 27 20:02:22.462444 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.462435 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" event={"ID":"d3b36112-fa40-4fce-8700-0c5e98c11d95","Type":"ContainerDied","Data":"675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789"} Jul 27 20:02:22.462671 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.462473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt" event={"ID":"d3b36112-fa40-4fce-8700-0c5e98c11d95","Type":"ContainerDied","Data":"254f90daaf7c1bce8db728fd70c1211a7366ffd0212d805daa4ed9feca372ead"} Jul 27 20:02:22.462671 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.462497 2584 scope.go:117] "RemoveContainer" containerID="675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789" Jul 27 20:02:22.471781 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.471760 2584 scope.go:117] "RemoveContainer" containerID="675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789" Jul 27 20:02:22.472019 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:02:22.472000 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789\": container with ID starting with 675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789 not found: ID does not exist" containerID="675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789" Jul 27 20:02:22.472065 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.472028 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789"} err="failed to get container status \"675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789\": rpc error: code = NotFound desc = could not find container \"675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789\": container with ID starting with 675995a28b07d81401e84fa1dc34ba2f3da09c0124d008776699a041fd680789 not found: ID does not exist" Jul 27 20:02:22.483194 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.483166 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt"] Jul 27 20:02:22.486714 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.486693 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5fa9bc6b-5f48b6d8c-8n8qt"] Jul 27 20:02:22.656688 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:22.656653 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3b36112-fa40-4fce-8700-0c5e98c11d95" path="/var/lib/kubelet/pods/d3b36112-fa40-4fce-8700-0c5e98c11d95/volumes" Jul 27 20:02:26.534745 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:26.534712 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69"] Jul 27 20:02:26.536751 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:26.536729 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5fa9bc6b-swc69"] Jul 27 20:02:26.656692 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:02:26.656661 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69b74047-dc1d-4086-aa63-57447a87ba47" path="/var/lib/kubelet/pods/69b74047-dc1d-4086-aa63-57447a87ba47/volumes" Jul 27 20:03:42.807203 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:03:42.807165 2584 scope.go:117] "RemoveContainer" containerID="9c56ebc80143d8d0ead03c4e2e292d9ed2bb87b406d45339f62d9cb7ac9dce96" Jul 27 20:03:42.815469 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:03:42.815448 2584 scope.go:117] "RemoveContainer" containerID="326fd912ae1c71d523393dd9fa60d59cbf9d9b2397305460ed034095dc6fe8aa" Jul 27 20:04:17.105043 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105010 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp"] Jul 27 20:04:17.105477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105354 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69b74047-dc1d-4086-aa63-57447a87ba47" containerName="revoke-keys" Jul 27 20:04:17.105477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105366 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="69b74047-dc1d-4086-aa63-57447a87ba47" containerName="revoke-keys" Jul 27 20:04:17.105477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105374 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3b36112-fa40-4fce-8700-0c5e98c11d95" containerName="maas-api" Jul 27 20:04:17.105477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105380 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3b36112-fa40-4fce-8700-0c5e98c11d95" containerName="maas-api" Jul 27 20:04:17.105477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105429 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3b36112-fa40-4fce-8700-0c5e98c11d95" containerName="maas-api" Jul 27 20:04:17.105477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.105441 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="69b74047-dc1d-4086-aa63-57447a87ba47" containerName="revoke-keys" Jul 27 20:04:17.108431 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.108413 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.112399 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.112379 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-20b70e-serving-cert\"" Jul 27 20:04:17.142809 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.142784 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp"] Jul 27 20:04:17.205424 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.205390 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5w5f\" (UniqueName: \"kubernetes.io/projected/da45573c-7d9d-42bf-9f97-437fef98476b-kube-api-access-r5w5f\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.205740 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.205664 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da45573c-7d9d-42bf-9f97-437fef98476b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.205740 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.205730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.306706 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.306668 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.306864 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.306802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5w5f\" (UniqueName: \"kubernetes.io/projected/da45573c-7d9d-42bf-9f97-437fef98476b-kube-api-access-r5w5f\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.306864 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:04:17.306832 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-serving-cert: secret "maas-api-e2e-inf-a-20b70e-serving-cert" not found Jul 27 20:04:17.306864 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.306850 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da45573c-7d9d-42bf-9f97-437fef98476b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.307003 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:04:17.306935 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls podName:da45573c-7d9d-42bf-9f97-437fef98476b nodeName:}" failed. No retries permitted until 2026-07-27 20:04:17.806913522 +0000 UTC m=+2315.626166142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls") pod "maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" (UID: "da45573c-7d9d-42bf-9f97-437fef98476b") : secret "maas-api-e2e-inf-a-20b70e-serving-cert" not found Jul 27 20:04:17.307447 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.307430 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da45573c-7d9d-42bf-9f97-437fef98476b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.327927 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.327895 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5w5f\" (UniqueName: \"kubernetes.io/projected/da45573c-7d9d-42bf-9f97-437fef98476b-kube-api-access-r5w5f\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.812755 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.812716 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:17.815473 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:17.815445 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls\") pod \"maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:18.021640 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:18.021603 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:18.153839 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:18.153813 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp"] Jul 27 20:04:18.155479 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:04:18.155452 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda45573c_7d9d_42bf_9f97_437fef98476b.slice/crio-70e262123f95571695440b25d84a9a958f47f55a3c8d26908621852822a30b29 WatchSource:0}: Error finding container 70e262123f95571695440b25d84a9a958f47f55a3c8d26908621852822a30b29: Status 404 returned error can't find the container with id 70e262123f95571695440b25d84a9a958f47f55a3c8d26908621852822a30b29 Jul 27 20:04:19.039877 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:19.039837 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" event={"ID":"da45573c-7d9d-42bf-9f97-437fef98476b","Type":"ContainerStarted","Data":"86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc"} Jul 27 20:04:19.040056 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:19.039898 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" event={"ID":"da45573c-7d9d-42bf-9f97-437fef98476b","Type":"ContainerStarted","Data":"70e262123f95571695440b25d84a9a958f47f55a3c8d26908621852822a30b29"} Jul 27 20:04:19.040056 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:19.039921 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:19.058397 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:19.058350 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" podStartSLOduration=1.602590228 podStartE2EDuration="2.058336139s" totalImagesPullingTime="455.745911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:19.057452111 +0000 UTC m=+2316.876704748" watchObservedRunningTime="2026-07-27 20:04:19.058336139 +0000 UTC m=+2316.877588787" Jul 27 20:04:25.049974 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.049946 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:04:25.227528 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.227493 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc"] Jul 27 20:04:25.231487 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.231467 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.233739 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.233718 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-461c95-serving-cert\"" Jul 27 20:04:25.243389 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.243361 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc"] Jul 27 20:04:25.275042 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.275017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-maas-api-tls\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.275179 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.275052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.275179 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.275115 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-766nx\" (UniqueName: \"kubernetes.io/projected/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-kube-api-access-766nx\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.376141 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.376052 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-maas-api-tls\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.376141 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.376094 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.376354 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.376276 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-766nx\" (UniqueName: \"kubernetes.io/projected/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-kube-api-access-766nx\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.376773 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.376755 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.378796 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.378772 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-maas-api-tls\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.387030 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.387010 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-766nx\" (UniqueName: \"kubernetes.io/projected/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-kube-api-access-766nx\") pod \"maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.545118 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.545086 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:25.679256 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.679234 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc"] Jul 27 20:04:25.681453 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:04:25.681415 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc2dc53_ea98_44b3_95aa_aba333dda8d8.slice/crio-c457f5bba796531dac149c3234b302d703975706dc278afc01879f4cd0be18a5 WatchSource:0}: Error finding container c457f5bba796531dac149c3234b302d703975706dc278afc01879f4cd0be18a5: Status 404 returned error can't find the container with id c457f5bba796531dac149c3234b302d703975706dc278afc01879f4cd0be18a5 Jul 27 20:04:25.877128 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.877099 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg"] Jul 27 20:04:25.881858 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.881796 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:25.884136 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.884115 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-461c95\"" Jul 27 20:04:25.884263 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.884161 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-461c95-dockercfg-2knzx\"" Jul 27 20:04:25.890747 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.890725 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg"] Jul 27 20:04:25.981428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.981394 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmcpq\" (UniqueName: \"kubernetes.io/projected/1b2d4f52-48e9-4d49-8872-b318b9a90d13-kube-api-access-xmcpq\") pod \"payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:25.981611 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:25.981457 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2d4f52-48e9-4d49-8872-b318b9a90d13-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:26.081725 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.081701 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" event={"ID":"1bc2dc53-ea98-44b3-95aa-aba333dda8d8","Type":"ContainerStarted","Data":"c457f5bba796531dac149c3234b302d703975706dc278afc01879f4cd0be18a5"} Jul 27 20:04:26.082014 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.081872 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmcpq\" (UniqueName: \"kubernetes.io/projected/1b2d4f52-48e9-4d49-8872-b318b9a90d13-kube-api-access-xmcpq\") pod \"payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:26.082014 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.081921 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2d4f52-48e9-4d49-8872-b318b9a90d13-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:26.082552 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.082533 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2d4f52-48e9-4d49-8872-b318b9a90d13-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:26.089457 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.089438 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmcpq\" (UniqueName: \"kubernetes.io/projected/1b2d4f52-48e9-4d49-8872-b318b9a90d13-kube-api-access-xmcpq\") pod \"payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:26.193141 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.193073 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:26.325972 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:26.325942 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg"] Jul 27 20:04:26.327236 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:04:26.327208 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2d4f52_48e9_4d49_8872_b318b9a90d13.slice/crio-5036714e99bf09880fb7896e108910729a2f08c143ba75ff13677fbd0980e891 WatchSource:0}: Error finding container 5036714e99bf09880fb7896e108910729a2f08c143ba75ff13677fbd0980e891: Status 404 returned error can't find the container with id 5036714e99bf09880fb7896e108910729a2f08c143ba75ff13677fbd0980e891 Jul 27 20:04:27.094429 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.094394 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" event={"ID":"1b2d4f52-48e9-4d49-8872-b318b9a90d13","Type":"ContainerStarted","Data":"d37035d39b7a9faa89dbd25430a2a265f4e05bade092e5c182fc3cd445df8b81"} Jul 27 20:04:27.094956 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.094492 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:27.094956 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.094520 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" event={"ID":"1b2d4f52-48e9-4d49-8872-b318b9a90d13","Type":"ContainerStarted","Data":"5036714e99bf09880fb7896e108910729a2f08c143ba75ff13677fbd0980e891"} Jul 27 20:04:27.096244 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.096207 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" event={"ID":"1bc2dc53-ea98-44b3-95aa-aba333dda8d8","Type":"ContainerStarted","Data":"bb85214b0b0387070d505908e6610b6955ea700888c1254ddc155967692fd59d"} Jul 27 20:04:27.096362 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.096342 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:27.110887 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.110835 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" podStartSLOduration=2.110817866 podStartE2EDuration="2.110817866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:27.110254571 +0000 UTC m=+2324.929507210" watchObservedRunningTime="2026-07-27 20:04:27.110817866 +0000 UTC m=+2324.930070503" Jul 27 20:04:27.127086 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:27.127034 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" podStartSLOduration=1.746601874 podStartE2EDuration="2.127015316s" totalImagesPullingTime="380.413442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:04:27.125504557 +0000 UTC m=+2324.944757193" watchObservedRunningTime="2026-07-27 20:04:27.127015316 +0000 UTC m=+2324.946267956" Jul 27 20:04:33.106682 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:33.106655 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:04:38.102732 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:38.102705 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:04:42.839412 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:04:42.839376 2584 scope.go:117] "RemoveContainer" containerID="f2f6e9aff9d4d60d4821474d2d642ba6887a383bf43d8ecb4f1d578938dbfdf6" Jul 27 20:05:29.242676 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.242639 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9cb5bc76-gnlc4"] Jul 27 20:05:29.246435 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.246418 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.256878 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.256852 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cb5bc76-gnlc4"] Jul 27 20:05:29.329668 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329636 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196cead2-1f6d-4e76-9bea-700765f5297c-console-oauth-config\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.329668 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329670 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-console-config\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.329873 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329696 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-oauth-serving-cert\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.329873 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329751 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-service-ca\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.329873 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329813 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvd8p\" (UniqueName: \"kubernetes.io/projected/196cead2-1f6d-4e76-9bea-700765f5297c-kube-api-access-pvd8p\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.329873 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196cead2-1f6d-4e76-9bea-700765f5297c-console-serving-cert\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.330006 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.329887 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-trusted-ca-bundle\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431012 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.430968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196cead2-1f6d-4e76-9bea-700765f5297c-console-oauth-config\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431012 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-console-config\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431220 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431129 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-oauth-serving-cert\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431220 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431168 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-service-ca\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431220 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431187 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvd8p\" (UniqueName: \"kubernetes.io/projected/196cead2-1f6d-4e76-9bea-700765f5297c-kube-api-access-pvd8p\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431220 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431210 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196cead2-1f6d-4e76-9bea-700765f5297c-console-serving-cert\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431419 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-trusted-ca-bundle\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431758 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431736 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-oauth-serving-cert\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.431891 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.431790 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-console-config\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.432168 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.432144 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-trusted-ca-bundle\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.432309 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.432292 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/196cead2-1f6d-4e76-9bea-700765f5297c-service-ca\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.433638 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.433615 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/196cead2-1f6d-4e76-9bea-700765f5297c-console-oauth-config\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.433764 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.433748 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/196cead2-1f6d-4e76-9bea-700765f5297c-console-serving-cert\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.439805 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.439784 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvd8p\" (UniqueName: \"kubernetes.io/projected/196cead2-1f6d-4e76-9bea-700765f5297c-kube-api-access-pvd8p\") pod \"console-5f9cb5bc76-gnlc4\" (UID: \"196cead2-1f6d-4e76-9bea-700765f5297c\") " pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.555959 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.555931 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:29.691070 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:29.691044 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cb5bc76-gnlc4"] Jul 27 20:05:29.692751 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:05:29.692722 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196cead2_1f6d_4e76_9bea_700765f5297c.slice/crio-25998e1f62cc383196846fb0b8b7274223d43625bec857821ad2be5114c8a4e3 WatchSource:0}: Error finding container 25998e1f62cc383196846fb0b8b7274223d43625bec857821ad2be5114c8a4e3: Status 404 returned error can't find the container with id 25998e1f62cc383196846fb0b8b7274223d43625bec857821ad2be5114c8a4e3 Jul 27 20:05:30.420285 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:30.420245 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cb5bc76-gnlc4" event={"ID":"196cead2-1f6d-4e76-9bea-700765f5297c","Type":"ContainerStarted","Data":"9dc5c2cd0148958de43e65d1214d005bcb3f53be8f49e370ac0a2c73572efe47"} Jul 27 20:05:30.420708 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:30.420305 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cb5bc76-gnlc4" event={"ID":"196cead2-1f6d-4e76-9bea-700765f5297c","Type":"ContainerStarted","Data":"25998e1f62cc383196846fb0b8b7274223d43625bec857821ad2be5114c8a4e3"} Jul 27 20:05:30.439377 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:30.439326 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9cb5bc76-gnlc4" podStartSLOduration=1.439311623 podStartE2EDuration="1.439311623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:05:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:05:30.437333808 +0000 UTC m=+2388.256586452" watchObservedRunningTime="2026-07-27 20:05:30.439311623 +0000 UTC m=+2388.258564330" Jul 27 20:05:39.556852 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:39.556811 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:39.557448 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:39.556889 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:39.562172 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:39.562137 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:40.480364 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:40.480333 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9cb5bc76-gnlc4" Jul 27 20:05:40.534322 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:05:40.534282 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6b8d9cc-xrzfp"] Jul 27 20:06:05.559392 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.559291 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c6b8d9cc-xrzfp" podUID="bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" containerName="console" containerID="cri-o://3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b" gracePeriod=15 Jul 27 20:06:05.815648 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.815549 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 20:06:05.878907 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.878865 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-oauth-serving-cert\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.878907 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.878911 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-serving-cert\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.879178 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.878930 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsgl4\" (UniqueName: \"kubernetes.io/projected/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-kube-api-access-vsgl4\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.879178 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.878952 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-config\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.879178 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.878971 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-trusted-ca-bundle\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.879178 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.879043 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-service-ca\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.879178 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.879098 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-oauth-config\") pod \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\" (UID: \"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc\") " Jul 27 20:06:05.879444 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.879388 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-config" (OuterVolumeSpecName: "console-config") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:05.879536 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.879510 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:05.879635 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.879612 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:05.879712 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.879635 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:05.881537 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.881501 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:06:05.881537 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.881513 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:06:05.881795 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.881618 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-kube-api-access-vsgl4" (OuterVolumeSpecName: "kube-api-access-vsgl4") pod "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" (UID: "bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc"). InnerVolumeSpecName "kube-api-access-vsgl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:06:05.980226 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980187 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-oauth-config\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:05.980226 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980220 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-oauth-serving-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:05.980226 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980230 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-serving-cert\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:05.980226 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980238 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsgl4\" (UniqueName: \"kubernetes.io/projected/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-kube-api-access-vsgl4\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:05.980533 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980247 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-console-config\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:05.980533 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980256 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-trusted-ca-bundle\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:05.980533 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:05.980265 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:06.614264 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.614224 2584 generic.go:356] "Generic (PLEG): container finished" podID="bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" containerID="3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b" exitCode=0 Jul 27 20:06:06.614802 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.614274 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6b8d9cc-xrzfp" Jul 27 20:06:06.614802 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.614319 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6b8d9cc-xrzfp" event={"ID":"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc","Type":"ContainerDied","Data":"3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b"} Jul 27 20:06:06.614802 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.614388 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6b8d9cc-xrzfp" event={"ID":"bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc","Type":"ContainerDied","Data":"6af27379c78c9dd1f4b1c7fc6be99aeb86a3139ffaca69e910a0d92f436f4628"} Jul 27 20:06:06.614802 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.614420 2584 scope.go:117] "RemoveContainer" containerID="3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b" Jul 27 20:06:06.624788 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.624767 2584 scope.go:117] "RemoveContainer" containerID="3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b" Jul 27 20:06:06.625166 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:06:06.625145 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b\": container with ID starting with 3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b not found: ID does not exist" containerID="3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b" Jul 27 20:06:06.625222 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.625177 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b"} err="failed to get container status \"3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b\": rpc error: code = NotFound desc = could not find container \"3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b\": container with ID starting with 3b01735d443c9babe0408e0ee7d93cf105d355b20c6a0bb873a503f1b9b1cb6b not found: ID does not exist" Jul 27 20:06:06.635850 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.635814 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6b8d9cc-xrzfp"] Jul 27 20:06:06.639186 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.639152 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6b8d9cc-xrzfp"] Jul 27 20:06:06.658060 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:06.658022 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" path="/var/lib/kubelet/pods/bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc/volumes" Jul 27 20:06:10.670734 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:10.670697 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp"] Jul 27 20:06:10.671280 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:10.670948 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" podUID="da45573c-7d9d-42bf-9f97-437fef98476b" containerName="maas-api" containerID="cri-o://86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc" gracePeriod=30 Jul 27 20:06:10.923241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:10.923184 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:06:11.027253 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.027221 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5w5f\" (UniqueName: \"kubernetes.io/projected/da45573c-7d9d-42bf-9f97-437fef98476b-kube-api-access-r5w5f\") pod \"da45573c-7d9d-42bf-9f97-437fef98476b\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " Jul 27 20:06:11.027421 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.027288 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls\") pod \"da45573c-7d9d-42bf-9f97-437fef98476b\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " Jul 27 20:06:11.027421 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.027319 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da45573c-7d9d-42bf-9f97-437fef98476b-openshift-service-ca\") pod \"da45573c-7d9d-42bf-9f97-437fef98476b\" (UID: \"da45573c-7d9d-42bf-9f97-437fef98476b\") " Jul 27 20:06:11.027827 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.027800 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da45573c-7d9d-42bf-9f97-437fef98476b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da45573c-7d9d-42bf-9f97-437fef98476b" (UID: "da45573c-7d9d-42bf-9f97-437fef98476b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:11.029839 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.029796 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da45573c-7d9d-42bf-9f97-437fef98476b" (UID: "da45573c-7d9d-42bf-9f97-437fef98476b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:06:11.030044 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.030021 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da45573c-7d9d-42bf-9f97-437fef98476b-kube-api-access-r5w5f" (OuterVolumeSpecName: "kube-api-access-r5w5f") pod "da45573c-7d9d-42bf-9f97-437fef98476b" (UID: "da45573c-7d9d-42bf-9f97-437fef98476b"). InnerVolumeSpecName "kube-api-access-r5w5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:06:11.128534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.128500 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5w5f\" (UniqueName: \"kubernetes.io/projected/da45573c-7d9d-42bf-9f97-437fef98476b-kube-api-access-r5w5f\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:11.128534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.128528 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da45573c-7d9d-42bf-9f97-437fef98476b-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:11.128534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.128539 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da45573c-7d9d-42bf-9f97-437fef98476b-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:11.645423 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.645388 2584 generic.go:356] "Generic (PLEG): container finished" podID="da45573c-7d9d-42bf-9f97-437fef98476b" containerID="86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc" exitCode=0 Jul 27 20:06:11.645642 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.645439 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" Jul 27 20:06:11.645642 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.645479 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" event={"ID":"da45573c-7d9d-42bf-9f97-437fef98476b","Type":"ContainerDied","Data":"86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc"} Jul 27 20:06:11.645642 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.645532 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp" event={"ID":"da45573c-7d9d-42bf-9f97-437fef98476b","Type":"ContainerDied","Data":"70e262123f95571695440b25d84a9a958f47f55a3c8d26908621852822a30b29"} Jul 27 20:06:11.645642 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.645556 2584 scope.go:117] "RemoveContainer" containerID="86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc" Jul 27 20:06:11.654949 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.654931 2584 scope.go:117] "RemoveContainer" containerID="86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc" Jul 27 20:06:11.655246 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:06:11.655228 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc\": container with ID starting with 86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc not found: ID does not exist" containerID="86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc" Jul 27 20:06:11.655312 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.655256 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc"} err="failed to get container status \"86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc\": rpc error: code = NotFound desc = could not find container \"86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc\": container with ID starting with 86757ea32446ef63e5b251b9c1c24b87f69428a12fbfd64605391647bcdc4adc not found: ID does not exist" Jul 27 20:06:11.666433 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.666402 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp"] Jul 27 20:06:11.672412 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:11.672384 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-20b70e-6675f68b5c-vvwzp"] Jul 27 20:06:12.656390 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:12.656358 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da45573c-7d9d-42bf-9f97-437fef98476b" path="/var/lib/kubelet/pods/da45573c-7d9d-42bf-9f97-437fef98476b/volumes" Jul 27 20:06:32.537328 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.537291 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc"] Jul 27 20:06:32.537745 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.537509 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" podUID="1bc2dc53-ea98-44b3-95aa-aba333dda8d8" containerName="maas-api" containerID="cri-o://bb85214b0b0387070d505908e6610b6955ea700888c1254ddc155967692fd59d" gracePeriod=30 Jul 27 20:06:32.582665 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.582632 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg"] Jul 27 20:06:32.583255 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.583203 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" podUID="1b2d4f52-48e9-4d49-8872-b318b9a90d13" containerName="payload-processing" containerID="cri-o://d37035d39b7a9faa89dbd25430a2a265f4e05bade092e5c182fc3cd445df8b81" gracePeriod=30 Jul 27 20:06:32.761272 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.761237 2584 generic.go:356] "Generic (PLEG): container finished" podID="1b2d4f52-48e9-4d49-8872-b318b9a90d13" containerID="d37035d39b7a9faa89dbd25430a2a265f4e05bade092e5c182fc3cd445df8b81" exitCode=0 Jul 27 20:06:32.761453 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.761429 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" event={"ID":"1b2d4f52-48e9-4d49-8872-b318b9a90d13","Type":"ContainerDied","Data":"d37035d39b7a9faa89dbd25430a2a265f4e05bade092e5c182fc3cd445df8b81"} Jul 27 20:06:32.763001 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.762976 2584 generic.go:356] "Generic (PLEG): container finished" podID="1bc2dc53-ea98-44b3-95aa-aba333dda8d8" containerID="bb85214b0b0387070d505908e6610b6955ea700888c1254ddc155967692fd59d" exitCode=0 Jul 27 20:06:32.763110 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.763033 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" event={"ID":"1bc2dc53-ea98-44b3-95aa-aba333dda8d8","Type":"ContainerDied","Data":"bb85214b0b0387070d505908e6610b6955ea700888c1254ddc155967692fd59d"} Jul 27 20:06:32.839466 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.839444 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:06:32.842108 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.842089 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:06:32.908513 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.908475 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmcpq\" (UniqueName: \"kubernetes.io/projected/1b2d4f52-48e9-4d49-8872-b318b9a90d13-kube-api-access-xmcpq\") pod \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " Jul 27 20:06:32.908716 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.908528 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2d4f52-48e9-4d49-8872-b318b9a90d13-plugins-config-volume\") pod \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\" (UID: \"1b2d4f52-48e9-4d49-8872-b318b9a90d13\") " Jul 27 20:06:32.908716 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.908554 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-766nx\" (UniqueName: \"kubernetes.io/projected/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-kube-api-access-766nx\") pod \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " Jul 27 20:06:32.908716 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.908646 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-openshift-service-ca\") pod \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " Jul 27 20:06:32.908716 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.908671 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-maas-api-tls\") pod \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\" (UID: \"1bc2dc53-ea98-44b3-95aa-aba333dda8d8\") " Jul 27 20:06:32.908978 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.908951 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2d4f52-48e9-4d49-8872-b318b9a90d13-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b2d4f52-48e9-4d49-8872-b318b9a90d13" (UID: "1b2d4f52-48e9-4d49-8872-b318b9a90d13"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:32.909037 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.909016 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bc2dc53-ea98-44b3-95aa-aba333dda8d8" (UID: "1bc2dc53-ea98-44b3-95aa-aba333dda8d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:06:32.910788 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.910765 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-kube-api-access-766nx" (OuterVolumeSpecName: "kube-api-access-766nx") pod "1bc2dc53-ea98-44b3-95aa-aba333dda8d8" (UID: "1bc2dc53-ea98-44b3-95aa-aba333dda8d8"). InnerVolumeSpecName "kube-api-access-766nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:06:32.910856 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.910786 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bc2dc53-ea98-44b3-95aa-aba333dda8d8" (UID: "1bc2dc53-ea98-44b3-95aa-aba333dda8d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:06:32.910856 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:32.910812 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2d4f52-48e9-4d49-8872-b318b9a90d13-kube-api-access-xmcpq" (OuterVolumeSpecName: "kube-api-access-xmcpq") pod "1b2d4f52-48e9-4d49-8872-b318b9a90d13" (UID: "1b2d4f52-48e9-4d49-8872-b318b9a90d13"). InnerVolumeSpecName "kube-api-access-xmcpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:06:33.009669 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.009639 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmcpq\" (UniqueName: \"kubernetes.io/projected/1b2d4f52-48e9-4d49-8872-b318b9a90d13-kube-api-access-xmcpq\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:33.009669 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.009666 2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2d4f52-48e9-4d49-8872-b318b9a90d13-plugins-config-volume\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:33.009833 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.009680 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-766nx\" (UniqueName: \"kubernetes.io/projected/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-kube-api-access-766nx\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:33.009833 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.009692 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:33.009833 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.009705 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bc2dc53-ea98-44b3-95aa-aba333dda8d8-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:06:33.769345 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.769319 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" Jul 27 20:06:33.769345 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.769341 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc" event={"ID":"1bc2dc53-ea98-44b3-95aa-aba333dda8d8","Type":"ContainerDied","Data":"c457f5bba796531dac149c3234b302d703975706dc278afc01879f4cd0be18a5"} Jul 27 20:06:33.769939 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.769400 2584 scope.go:117] "RemoveContainer" containerID="bb85214b0b0387070d505908e6610b6955ea700888c1254ddc155967692fd59d" Jul 27 20:06:33.770837 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.770784 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" event={"ID":"1b2d4f52-48e9-4d49-8872-b318b9a90d13","Type":"ContainerDied","Data":"5036714e99bf09880fb7896e108910729a2f08c143ba75ff13677fbd0980e891"} Jul 27 20:06:33.770837 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.770789 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg" Jul 27 20:06:33.778775 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.778760 2584 scope.go:117] "RemoveContainer" containerID="d37035d39b7a9faa89dbd25430a2a265f4e05bade092e5c182fc3cd445df8b81" Jul 27 20:06:33.798335 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.793392 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc"] Jul 27 20:06:33.801025 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.801000 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-461c95-9ff56b964-wmvjc"] Jul 27 20:06:33.810818 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.810766 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg"] Jul 27 20:06:33.814240 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:33.814221 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-461c95-96f978d9b-74pqg"] Jul 27 20:06:34.657109 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:34.657074 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2d4f52-48e9-4d49-8872-b318b9a90d13" path="/var/lib/kubelet/pods/1b2d4f52-48e9-4d49-8872-b318b9a90d13/volumes" Jul 27 20:06:34.657453 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:34.657440 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc2dc53-ea98-44b3-95aa-aba333dda8d8" path="/var/lib/kubelet/pods/1bc2dc53-ea98-44b3-95aa-aba333dda8d8/volumes" Jul 27 20:06:42.866422 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:42.866385 2584 scope.go:117] "RemoveContainer" containerID="2724a882dbca7371a12c7e3efe1fe87fd63002e96c78de628cb087a1992fbfba" Jul 27 20:06:47.898092 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898059 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9"] Jul 27 20:06:47.898564 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898508 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da45573c-7d9d-42bf-9f97-437fef98476b" containerName="maas-api" Jul 27 20:06:47.898564 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898522 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="da45573c-7d9d-42bf-9f97-437fef98476b" containerName="maas-api" Jul 27 20:06:47.898564 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898546 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" containerName="console" Jul 27 20:06:47.898564 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898554 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" containerName="console" Jul 27 20:06:47.898564 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898563 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2d4f52-48e9-4d49-8872-b318b9a90d13" containerName="payload-processing" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898571 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2d4f52-48e9-4d49-8872-b318b9a90d13" containerName="payload-processing" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898611 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc2dc53-ea98-44b3-95aa-aba333dda8d8" containerName="maas-api" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898620 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc2dc53-ea98-44b3-95aa-aba333dda8d8" containerName="maas-api" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898688 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc2dc53-ea98-44b3-95aa-aba333dda8d8" containerName="maas-api" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898700 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb79e2a9-eb07-4fb1-aa86-28a2e0cd13cc" containerName="console" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898709 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2d4f52-48e9-4d49-8872-b318b9a90d13" containerName="payload-processing" Jul 27 20:06:47.898902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.898718 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="da45573c-7d9d-42bf-9f97-437fef98476b" containerName="maas-api" Jul 27 20:06:47.901844 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.901823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:47.904252 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.904233 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-110a90-serving-cert\"" Jul 27 20:06:47.919171 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.919142 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9"] Jul 27 20:06:47.927031 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.927000 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-openshift-service-ca\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:47.927143 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.927068 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:47.927182 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:47.927140 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmh7\" (UniqueName: \"kubernetes.io/projected/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-kube-api-access-2gmh7\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.028254 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.028221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmh7\" (UniqueName: \"kubernetes.io/projected/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-kube-api-access-2gmh7\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.028436 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.028313 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-openshift-service-ca\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.028436 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.028364 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.028575 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:06:48.028489 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-serving-cert: secret "maas-api-e2e-api-a-110a90-serving-cert" not found Jul 27 20:06:48.028575 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:06:48.028561 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls podName:84a0856b-8fd8-4fc8-a5c3-55dfce31c23a nodeName:}" failed. No retries permitted until 2026-07-27 20:06:48.528537897 +0000 UTC m=+2466.347790533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls") pod "maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" (UID: "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a") : secret "maas-api-e2e-api-a-110a90-serving-cert" not found Jul 27 20:06:48.029272 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.029247 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-openshift-service-ca\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.036618 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.036566 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmh7\" (UniqueName: \"kubernetes.io/projected/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-kube-api-access-2gmh7\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.532681 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.532650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.535154 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.535124 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls\") pod \"maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.818198 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.818115 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:48.954630 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.954599 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9"] Jul 27 20:06:48.956231 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:06:48.956203 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a0856b_8fd8_4fc8_a5c3_55dfce31c23a.slice/crio-01cb7b54b3d09e591050e7aade1a8a34e91da0dea08afc376d9d2441b48c1e93 WatchSource:0}: Error finding container 01cb7b54b3d09e591050e7aade1a8a34e91da0dea08afc376d9d2441b48c1e93: Status 404 returned error can't find the container with id 01cb7b54b3d09e591050e7aade1a8a34e91da0dea08afc376d9d2441b48c1e93 Jul 27 20:06:48.957473 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:48.957457 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:06:49.851441 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:49.851406 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" event={"ID":"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a","Type":"ContainerStarted","Data":"c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a"} Jul 27 20:06:49.851646 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:49.851458 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" event={"ID":"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a","Type":"ContainerStarted","Data":"01cb7b54b3d09e591050e7aade1a8a34e91da0dea08afc376d9d2441b48c1e93"} Jul 27 20:06:49.851646 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:49.851546 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:49.886738 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:49.886690 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" podStartSLOduration=2.380413432 podStartE2EDuration="2.886675149s" totalImagesPullingTime="506.261717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:49.88482364 +0000 UTC m=+2467.704076279" watchObservedRunningTime="2026-07-27 20:06:49.886675149 +0000 UTC m=+2467.705927827" Jul 27 20:06:55.861442 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:55.861415 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:06:55.942468 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:55.942437 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw"] Jul 27 20:06:55.945860 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:55.945831 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:55.948957 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:55.948933 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-16dc17-serving-cert\"" Jul 27 20:06:55.956659 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:55.956631 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw"] Jul 27 20:06:56.001445 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.001415 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.001615 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.001475 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b979c7-cf21-4934-a38c-913cf0f9b8c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.001615 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.001562 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7857\" (UniqueName: \"kubernetes.io/projected/90b979c7-cf21-4934-a38c-913cf0f9b8c7-kube-api-access-d7857\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.102256 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.102224 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b979c7-cf21-4934-a38c-913cf0f9b8c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.102403 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.102275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7857\" (UniqueName: \"kubernetes.io/projected/90b979c7-cf21-4934-a38c-913cf0f9b8c7-kube-api-access-d7857\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.102403 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.102303 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.102496 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:06:56.102417 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-serving-cert: secret "maas-api-e2e-api-b-16dc17-serving-cert" not found Jul 27 20:06:56.102496 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:06:56.102469 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls podName:90b979c7-cf21-4934-a38c-913cf0f9b8c7 nodeName:}" failed. No retries permitted until 2026-07-27 20:06:56.602453872 +0000 UTC m=+2474.421706487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls") pod "maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" (UID: "90b979c7-cf21-4934-a38c-913cf0f9b8c7") : secret "maas-api-e2e-api-b-16dc17-serving-cert" not found Jul 27 20:06:56.102936 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.102917 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b979c7-cf21-4934-a38c-913cf0f9b8c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.110839 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.110813 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7857\" (UniqueName: \"kubernetes.io/projected/90b979c7-cf21-4934-a38c-913cf0f9b8c7-kube-api-access-d7857\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.570676 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.570638 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75"] Jul 27 20:06:56.574156 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.574134 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.576430 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.576410 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-16dc17-dockercfg-42ll4\"" Jul 27 20:06:56.576531 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.576453 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-16dc17\"" Jul 27 20:06:56.582229 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.581999 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75"] Jul 27 20:06:56.606827 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.606797 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.609298 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.609278 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls\") pod \"maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.707576 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.707549 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6jcx\" (UniqueName: \"kubernetes.io/projected/c2a81231-fe84-420d-8454-dd60f71feb61-kube-api-access-h6jcx\") pod \"payload-processing-e2e-api-b-16dc17-57794d4974-bjd75\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.707789 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.707639 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a81231-fe84-420d-8454-dd60f71feb61-plugins-config-volume\") pod \"payload-processing-e2e-api-b-16dc17-57794d4974-bjd75\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.808383 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.808353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6jcx\" (UniqueName: \"kubernetes.io/projected/c2a81231-fe84-420d-8454-dd60f71feb61-kube-api-access-h6jcx\") pod \"payload-processing-e2e-api-b-16dc17-57794d4974-bjd75\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.808536 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.808400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a81231-fe84-420d-8454-dd60f71feb61-plugins-config-volume\") pod \"payload-processing-e2e-api-b-16dc17-57794d4974-bjd75\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.809035 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.809015 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a81231-fe84-420d-8454-dd60f71feb61-plugins-config-volume\") pod \"payload-processing-e2e-api-b-16dc17-57794d4974-bjd75\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.816645 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.816624 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6jcx\" (UniqueName: \"kubernetes.io/projected/c2a81231-fe84-420d-8454-dd60f71feb61-kube-api-access-h6jcx\") pod \"payload-processing-e2e-api-b-16dc17-57794d4974-bjd75\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:56.858136 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.858053 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:56.885721 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:56.885683 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:57.009385 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.009359 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw"] Jul 27 20:06:57.011051 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:06:57.011026 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b979c7_cf21_4934_a38c_913cf0f9b8c7.slice/crio-25ff89491e700d770f7f5c437b82626becec08c4cfe0ff188c22b4883f4d4773 WatchSource:0}: Error finding container 25ff89491e700d770f7f5c437b82626becec08c4cfe0ff188c22b4883f4d4773: Status 404 returned error can't find the container with id 25ff89491e700d770f7f5c437b82626becec08c4cfe0ff188c22b4883f4d4773 Jul 27 20:06:57.035375 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.035352 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75"] Jul 27 20:06:57.037036 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:06:57.037013 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a81231_fe84_420d_8454_dd60f71feb61.slice/crio-8dbf8889cc59c5d4e5ee844d8752112542cfaad0a8a8a0933e158ff2801b29a4 WatchSource:0}: Error finding container 8dbf8889cc59c5d4e5ee844d8752112542cfaad0a8a8a0933e158ff2801b29a4: Status 404 returned error can't find the container with id 8dbf8889cc59c5d4e5ee844d8752112542cfaad0a8a8a0933e158ff2801b29a4 Jul 27 20:06:57.892162 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.892126 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" event={"ID":"c2a81231-fe84-420d-8454-dd60f71feb61","Type":"ContainerStarted","Data":"4f45f0f4934e4657386e9b6c56989f110891be0416caa6a1ce50b954e63c6bb3"} Jul 27 20:06:57.892675 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.892183 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" event={"ID":"c2a81231-fe84-420d-8454-dd60f71feb61","Type":"ContainerStarted","Data":"8dbf8889cc59c5d4e5ee844d8752112542cfaad0a8a8a0933e158ff2801b29a4"} Jul 27 20:06:57.892675 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.892212 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:06:57.893760 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.893734 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" event={"ID":"90b979c7-cf21-4934-a38c-913cf0f9b8c7","Type":"ContainerStarted","Data":"317f6b5c996cd3cc77f9bf060974aea4e4ec4791b018941c942b91e4a1fbd67d"} Jul 27 20:06:57.893851 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.893784 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:06:57.893851 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.893802 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" event={"ID":"90b979c7-cf21-4934-a38c-913cf0f9b8c7","Type":"ContainerStarted","Data":"25ff89491e700d770f7f5c437b82626becec08c4cfe0ff188c22b4883f4d4773"} Jul 27 20:06:57.907877 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.907824 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" podStartSLOduration=1.907805255 podStartE2EDuration="1.907805255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:57.906332706 +0000 UTC m=+2475.725585343" watchObservedRunningTime="2026-07-27 20:06:57.907805255 +0000 UTC m=+2475.727057875" Jul 27 20:06:57.922559 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:06:57.922506 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" podStartSLOduration=2.52690347 podStartE2EDuration="2.922487545s" totalImagesPullingTime="395.584075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:06:57.920784175 +0000 UTC m=+2475.740036815" watchObservedRunningTime="2026-07-27 20:06:57.922487545 +0000 UTC m=+2475.741740182" Jul 27 20:07:03.904212 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:03.904180 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:07:08.325798 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.325763 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc"] Jul 27 20:07:08.329081 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.329065 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:08.331724 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.331701 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 20:07:08.336815 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.336465 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc"] Jul 27 20:07:08.409176 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.409144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd20632-f705-4177-a1de-0799e8e0547c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-110a90-ktnwc\" (UID: \"edd20632-f705-4177-a1de-0799e8e0547c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:08.509634 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.509603 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd20632-f705-4177-a1de-0799e8e0547c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-110a90-ktnwc\" (UID: \"edd20632-f705-4177-a1de-0799e8e0547c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:08.510185 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.510168 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd20632-f705-4177-a1de-0799e8e0547c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-110a90-ktnwc\" (UID: \"edd20632-f705-4177-a1de-0799e8e0547c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:08.640321 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.640244 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:08.772945 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.772919 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc"] Jul 27 20:07:08.774125 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:07:08.774099 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd20632_f705_4177_a1de_0799e8e0547c.slice/crio-eda4d853cb172a2aad6268e780f989baeafb4270ff8fa3238ac695abee7cc3bd WatchSource:0}: Error finding container eda4d853cb172a2aad6268e780f989baeafb4270ff8fa3238ac695abee7cc3bd: Status 404 returned error can't find the container with id eda4d853cb172a2aad6268e780f989baeafb4270ff8fa3238ac695abee7cc3bd Jul 27 20:07:08.901121 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.901038 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:07:08.952240 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:08.952203 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" event={"ID":"edd20632-f705-4177-a1de-0799e8e0547c","Type":"ContainerStarted","Data":"eda4d853cb172a2aad6268e780f989baeafb4270ff8fa3238ac695abee7cc3bd"} Jul 27 20:07:09.958940 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:09.958908 2584 generic.go:356] "Generic (PLEG): container finished" podID="edd20632-f705-4177-a1de-0799e8e0547c" containerID="3ab905121b9b214492bb2d57478d36869376d21a14e29270f5b495f2f19e032a" exitCode=0 Jul 27 20:07:09.959322 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:09.958969 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" event={"ID":"edd20632-f705-4177-a1de-0799e8e0547c","Type":"ContainerDied","Data":"3ab905121b9b214492bb2d57478d36869376d21a14e29270f5b495f2f19e032a"} Jul 27 20:07:11.080484 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.080460 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:11.236283 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.236205 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd20632-f705-4177-a1de-0799e8e0547c-maas-api-service-ca\") pod \"edd20632-f705-4177-a1de-0799e8e0547c\" (UID: \"edd20632-f705-4177-a1de-0799e8e0547c\") " Jul 27 20:07:11.236561 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.236541 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edd20632-f705-4177-a1de-0799e8e0547c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "edd20632-f705-4177-a1de-0799e8e0547c" (UID: "edd20632-f705-4177-a1de-0799e8e0547c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:07:11.340197 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.340097 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/edd20632-f705-4177-a1de-0799e8e0547c-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:11.969551 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.969521 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" Jul 27 20:07:11.969734 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.969558 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc" event={"ID":"edd20632-f705-4177-a1de-0799e8e0547c","Type":"ContainerDied","Data":"eda4d853cb172a2aad6268e780f989baeafb4270ff8fa3238ac695abee7cc3bd"} Jul 27 20:07:11.969734 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:11.969623 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eda4d853cb172a2aad6268e780f989baeafb4270ff8fa3238ac695abee7cc3bd" Jul 27 20:07:23.914198 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:23.914164 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9"] Jul 27 20:07:23.914762 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:23.914407 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" podUID="84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" containerName="maas-api" containerID="cri-o://c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a" gracePeriod=30 Jul 27 20:07:24.165420 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.165359 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:07:24.251147 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.251116 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gmh7\" (UniqueName: \"kubernetes.io/projected/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-kube-api-access-2gmh7\") pod \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " Jul 27 20:07:24.251302 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.251157 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls\") pod \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " Jul 27 20:07:24.251302 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.251197 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-openshift-service-ca\") pod \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\" (UID: \"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a\") " Jul 27 20:07:24.251661 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.251639 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" (UID: "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:07:24.253315 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.253291 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-kube-api-access-2gmh7" (OuterVolumeSpecName: "kube-api-access-2gmh7") pod "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" (UID: "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a"). InnerVolumeSpecName "kube-api-access-2gmh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:07:24.253393 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.253332 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" (UID: "84a0856b-8fd8-4fc8-a5c3-55dfce31c23a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:07:24.351854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.351811 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:24.351854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.351847 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gmh7\" (UniqueName: \"kubernetes.io/projected/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-kube-api-access-2gmh7\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:24.352024 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:24.351860 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:25.032310 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.032271 2584 generic.go:356] "Generic (PLEG): container finished" podID="84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" containerID="c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a" exitCode=0 Jul 27 20:07:25.032769 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.032320 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" Jul 27 20:07:25.032769 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.032360 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" event={"ID":"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a","Type":"ContainerDied","Data":"c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a"} Jul 27 20:07:25.032769 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.032416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9" event={"ID":"84a0856b-8fd8-4fc8-a5c3-55dfce31c23a","Type":"ContainerDied","Data":"01cb7b54b3d09e591050e7aade1a8a34e91da0dea08afc376d9d2441b48c1e93"} Jul 27 20:07:25.032769 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.032443 2584 scope.go:117] "RemoveContainer" containerID="c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a" Jul 27 20:07:25.041405 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.041374 2584 scope.go:117] "RemoveContainer" containerID="c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a" Jul 27 20:07:25.041683 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:07:25.041661 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a\": container with ID starting with c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a not found: ID does not exist" containerID="c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a" Jul 27 20:07:25.041760 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.041694 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a"} err="failed to get container status \"c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a\": rpc error: code = NotFound desc = could not find container \"c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a\": container with ID starting with c2b4bf541679f8829ae228daa89379fe9ee6a86a276c6ac57997b133e3c3110a not found: ID does not exist" Jul 27 20:07:25.056141 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.056118 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9"] Jul 27 20:07:25.058842 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:25.058823 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-110a90-657ffc5c8-9zsj9"] Jul 27 20:07:26.656771 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:26.656735 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" path="/var/lib/kubelet/pods/84a0856b-8fd8-4fc8-a5c3-55dfce31c23a/volumes" Jul 27 20:07:28.408438 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:28.408407 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc"] Jul 27 20:07:28.410358 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:28.410338 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-110a90-ktnwc"] Jul 27 20:07:28.657121 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:28.657091 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edd20632-f705-4177-a1de-0799e8e0547c" path="/var/lib/kubelet/pods/edd20632-f705-4177-a1de-0799e8e0547c/volumes" Jul 27 20:07:50.952152 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:50.952123 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw"] Jul 27 20:07:50.953049 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:50.952989 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" podUID="90b979c7-cf21-4934-a38c-913cf0f9b8c7" containerName="maas-api" containerID="cri-o://317f6b5c996cd3cc77f9bf060974aea4e4ec4791b018941c942b91e4a1fbd67d" gracePeriod=30 Jul 27 20:07:51.008789 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.008750 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75"] Jul 27 20:07:51.009060 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.009007 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" podUID="c2a81231-fe84-420d-8454-dd60f71feb61" containerName="payload-processing" containerID="cri-o://4f45f0f4934e4657386e9b6c56989f110891be0416caa6a1ce50b954e63c6bb3" gracePeriod=30 Jul 27 20:07:51.172603 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.172414 2584 generic.go:356] "Generic (PLEG): container finished" podID="c2a81231-fe84-420d-8454-dd60f71feb61" containerID="4f45f0f4934e4657386e9b6c56989f110891be0416caa6a1ce50b954e63c6bb3" exitCode=0 Jul 27 20:07:51.172603 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.172510 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" event={"ID":"c2a81231-fe84-420d-8454-dd60f71feb61","Type":"ContainerDied","Data":"4f45f0f4934e4657386e9b6c56989f110891be0416caa6a1ce50b954e63c6bb3"} Jul 27 20:07:51.175544 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.175430 2584 generic.go:356] "Generic (PLEG): container finished" podID="90b979c7-cf21-4934-a38c-913cf0f9b8c7" containerID="317f6b5c996cd3cc77f9bf060974aea4e4ec4791b018941c942b91e4a1fbd67d" exitCode=0 Jul 27 20:07:51.175544 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.175467 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" event={"ID":"90b979c7-cf21-4934-a38c-913cf0f9b8c7","Type":"ContainerDied","Data":"317f6b5c996cd3cc77f9bf060974aea4e4ec4791b018941c942b91e4a1fbd67d"} Jul 27 20:07:51.245835 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.245810 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:07:51.278876 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.278853 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:07:51.362732 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.362702 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b979c7-cf21-4934-a38c-913cf0f9b8c7-openshift-service-ca\") pod \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " Jul 27 20:07:51.362897 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.362738 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7857\" (UniqueName: \"kubernetes.io/projected/90b979c7-cf21-4934-a38c-913cf0f9b8c7-kube-api-access-d7857\") pod \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " Jul 27 20:07:51.362897 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.362758 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a81231-fe84-420d-8454-dd60f71feb61-plugins-config-volume\") pod \"c2a81231-fe84-420d-8454-dd60f71feb61\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " Jul 27 20:07:51.363023 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.362900 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls\") pod \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\" (UID: \"90b979c7-cf21-4934-a38c-913cf0f9b8c7\") " Jul 27 20:07:51.363023 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.362973 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6jcx\" (UniqueName: \"kubernetes.io/projected/c2a81231-fe84-420d-8454-dd60f71feb61-kube-api-access-h6jcx\") pod \"c2a81231-fe84-420d-8454-dd60f71feb61\" (UID: \"c2a81231-fe84-420d-8454-dd60f71feb61\") " Jul 27 20:07:51.363122 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.363097 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b979c7-cf21-4934-a38c-913cf0f9b8c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90b979c7-cf21-4934-a38c-913cf0f9b8c7" (UID: "90b979c7-cf21-4934-a38c-913cf0f9b8c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:07:51.363122 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.363111 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a81231-fe84-420d-8454-dd60f71feb61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2a81231-fe84-420d-8454-dd60f71feb61" (UID: "c2a81231-fe84-420d-8454-dd60f71feb61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:07:51.363299 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.363281 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b979c7-cf21-4934-a38c-913cf0f9b8c7-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:51.363372 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.363304 2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a81231-fe84-420d-8454-dd60f71feb61-plugins-config-volume\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:51.364992 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.364969 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90b979c7-cf21-4934-a38c-913cf0f9b8c7" (UID: "90b979c7-cf21-4934-a38c-913cf0f9b8c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:07:51.365072 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.364984 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a81231-fe84-420d-8454-dd60f71feb61-kube-api-access-h6jcx" (OuterVolumeSpecName: "kube-api-access-h6jcx") pod "c2a81231-fe84-420d-8454-dd60f71feb61" (UID: "c2a81231-fe84-420d-8454-dd60f71feb61"). InnerVolumeSpecName "kube-api-access-h6jcx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:07:51.365072 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.365022 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b979c7-cf21-4934-a38c-913cf0f9b8c7-kube-api-access-d7857" (OuterVolumeSpecName: "kube-api-access-d7857") pod "90b979c7-cf21-4934-a38c-913cf0f9b8c7" (UID: "90b979c7-cf21-4934-a38c-913cf0f9b8c7"). InnerVolumeSpecName "kube-api-access-d7857". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:07:51.464310 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.464247 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b979c7-cf21-4934-a38c-913cf0f9b8c7-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:51.464310 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.464272 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6jcx\" (UniqueName: \"kubernetes.io/projected/c2a81231-fe84-420d-8454-dd60f71feb61-kube-api-access-h6jcx\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:51.464310 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:51.464285 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7857\" (UniqueName: \"kubernetes.io/projected/90b979c7-cf21-4934-a38c-913cf0f9b8c7-kube-api-access-d7857\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:07:52.181955 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.181924 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" Jul 27 20:07:52.181955 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.181931 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75" event={"ID":"c2a81231-fe84-420d-8454-dd60f71feb61","Type":"ContainerDied","Data":"8dbf8889cc59c5d4e5ee844d8752112542cfaad0a8a8a0933e158ff2801b29a4"} Jul 27 20:07:52.182414 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.181984 2584 scope.go:117] "RemoveContainer" containerID="4f45f0f4934e4657386e9b6c56989f110891be0416caa6a1ce50b954e63c6bb3" Jul 27 20:07:52.183356 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.183338 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" Jul 27 20:07:52.183520 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.183373 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw" event={"ID":"90b979c7-cf21-4934-a38c-913cf0f9b8c7","Type":"ContainerDied","Data":"25ff89491e700d770f7f5c437b82626becec08c4cfe0ff188c22b4883f4d4773"} Jul 27 20:07:52.190706 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.190688 2584 scope.go:117] "RemoveContainer" containerID="317f6b5c996cd3cc77f9bf060974aea4e4ec4791b018941c942b91e4a1fbd67d" Jul 27 20:07:52.205526 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.205505 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw"] Jul 27 20:07:52.210438 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.210417 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16dc17-5897bbb7f9-trgxw"] Jul 27 20:07:52.220923 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.220873 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75"] Jul 27 20:07:52.225944 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.225925 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-16dc17-57794d4974-bjd75"] Jul 27 20:07:52.656905 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.656876 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b979c7-cf21-4934-a38c-913cf0f9b8c7" path="/var/lib/kubelet/pods/90b979c7-cf21-4934-a38c-913cf0f9b8c7/volumes" Jul 27 20:07:52.657213 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:07:52.657201 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a81231-fe84-420d-8454-dd60f71feb61" path="/var/lib/kubelet/pods/c2a81231-fe84-420d-8454-dd60f71feb61/volumes" Jul 27 20:08:05.298565 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298535 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9"] Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298864 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b979c7-cf21-4934-a38c-913cf0f9b8c7" containerName="maas-api" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298875 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b979c7-cf21-4934-a38c-913cf0f9b8c7" containerName="maas-api" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298895 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a81231-fe84-420d-8454-dd60f71feb61" containerName="payload-processing" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298900 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a81231-fe84-420d-8454-dd60f71feb61" containerName="payload-processing" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298908 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edd20632-f705-4177-a1de-0799e8e0547c" containerName="revoke-keys" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298913 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="edd20632-f705-4177-a1de-0799e8e0547c" containerName="revoke-keys" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298923 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" containerName="maas-api" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298928 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" containerName="maas-api" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298978 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a0856b-8fd8-4fc8-a5c3-55dfce31c23a" containerName="maas-api" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298986 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a81231-fe84-420d-8454-dd60f71feb61" containerName="payload-processing" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298993 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="edd20632-f705-4177-a1de-0799e8e0547c" containerName="revoke-keys" Jul 27 20:08:05.299090 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.298999 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b979c7-cf21-4934-a38c-913cf0f9b8c7" containerName="maas-api" Jul 27 20:08:05.303231 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.303212 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.305666 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.305644 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-97e28d-serving-cert\"" Jul 27 20:08:05.309932 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.309910 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9"] Jul 27 20:08:05.378696 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.378663 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pldzn\" (UniqueName: \"kubernetes.io/projected/1b18435a-3e76-4df5-b02f-165012d00720-kube-api-access-pldzn\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.378845 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.378772 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b18435a-3e76-4df5-b02f-165012d00720-maas-api-tls\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.378845 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.378800 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b18435a-3e76-4df5-b02f-165012d00720-openshift-service-ca\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.480125 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.480088 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pldzn\" (UniqueName: \"kubernetes.io/projected/1b18435a-3e76-4df5-b02f-165012d00720-kube-api-access-pldzn\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.480295 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.480140 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b18435a-3e76-4df5-b02f-165012d00720-maas-api-tls\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.480295 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.480161 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b18435a-3e76-4df5-b02f-165012d00720-openshift-service-ca\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.480993 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.480923 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b18435a-3e76-4df5-b02f-165012d00720-openshift-service-ca\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.482818 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.482792 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b18435a-3e76-4df5-b02f-165012d00720-maas-api-tls\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.509968 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.509946 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pldzn\" (UniqueName: \"kubernetes.io/projected/1b18435a-3e76-4df5-b02f-165012d00720-kube-api-access-pldzn\") pod \"maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.615198 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.615131 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:05.745426 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:05.745400 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9"] Jul 27 20:08:05.747621 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:08:05.747564 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b18435a_3e76_4df5_b02f_165012d00720.slice/crio-d16bd68ba169da7f58d6d84674b9dfa039c016b5cf31f28adc4d412b9d744b0e WatchSource:0}: Error finding container d16bd68ba169da7f58d6d84674b9dfa039c016b5cf31f28adc4d412b9d744b0e: Status 404 returned error can't find the container with id d16bd68ba169da7f58d6d84674b9dfa039c016b5cf31f28adc4d412b9d744b0e Jul 27 20:08:06.250296 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:06.250262 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" event={"ID":"1b18435a-3e76-4df5-b02f-165012d00720","Type":"ContainerStarted","Data":"9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872"} Jul 27 20:08:06.250463 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:06.250324 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" event={"ID":"1b18435a-3e76-4df5-b02f-165012d00720","Type":"ContainerStarted","Data":"d16bd68ba169da7f58d6d84674b9dfa039c016b5cf31f28adc4d412b9d744b0e"} Jul 27 20:08:06.250463 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:06.250372 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:06.268207 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:06.268159 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" podStartSLOduration=0.920054061 podStartE2EDuration="1.268144781s" totalImagesPullingTime="348.09072ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:06.266157734 +0000 UTC m=+2544.085410373" watchObservedRunningTime="2026-07-27 20:08:06.268144781 +0000 UTC m=+2544.087397430" Jul 27 20:08:12.260540 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:12.260513 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:08:13.349704 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.349663 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk"] Jul 27 20:08:13.353347 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.353316 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.355788 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.355755 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-e837b8-serving-cert\"" Jul 27 20:08:13.364003 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.363981 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk"] Jul 27 20:08:13.445947 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.445916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5948c0c7-d70f-4f36-b10b-190e7aadbb63-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.446190 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.446170 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5948c0c7-d70f-4f36-b10b-190e7aadbb63-maas-api-tls\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.446405 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.446375 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfcp9\" (UniqueName: \"kubernetes.io/projected/5948c0c7-d70f-4f36-b10b-190e7aadbb63-kube-api-access-dfcp9\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.546809 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.546770 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5948c0c7-d70f-4f36-b10b-190e7aadbb63-maas-api-tls\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.546996 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.546862 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfcp9\" (UniqueName: \"kubernetes.io/projected/5948c0c7-d70f-4f36-b10b-190e7aadbb63-kube-api-access-dfcp9\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.546996 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.546902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5948c0c7-d70f-4f36-b10b-190e7aadbb63-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.547515 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.547489 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5948c0c7-d70f-4f36-b10b-190e7aadbb63-openshift-service-ca\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.549282 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.549261 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5948c0c7-d70f-4f36-b10b-190e7aadbb63-maas-api-tls\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.556602 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.556557 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfcp9\" (UniqueName: \"kubernetes.io/projected/5948c0c7-d70f-4f36-b10b-190e7aadbb63-kube-api-access-dfcp9\") pod \"maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.665063 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.664991 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:13.799675 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:13.799652 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk"] Jul 27 20:08:13.801235 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:08:13.801200 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5948c0c7_d70f_4f36_b10b_190e7aadbb63.slice/crio-01f234d2ff0e039be20990478886d28036d081d5fc7adea7dc01ccb47a664fe3 WatchSource:0}: Error finding container 01f234d2ff0e039be20990478886d28036d081d5fc7adea7dc01ccb47a664fe3: Status 404 returned error can't find the container with id 01f234d2ff0e039be20990478886d28036d081d5fc7adea7dc01ccb47a664fe3 Jul 27 20:08:14.102139 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.102108 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4"] Jul 27 20:08:14.106595 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.106557 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.108992 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.108971 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-e837b8\"" Jul 27 20:08:14.109099 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.109059 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-e837b8-dockercfg-khlgg\"" Jul 27 20:08:14.114373 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.114174 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4"] Jul 27 20:08:14.255383 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.254516 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.255383 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.254711 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvdmr\" (UniqueName: \"kubernetes.io/projected/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-kube-api-access-lvdmr\") pod \"payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.289569 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.289526 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" event={"ID":"5948c0c7-d70f-4f36-b10b-190e7aadbb63","Type":"ContainerStarted","Data":"01f234d2ff0e039be20990478886d28036d081d5fc7adea7dc01ccb47a664fe3"} Jul 27 20:08:14.355811 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.355730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.356154 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.355849 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvdmr\" (UniqueName: \"kubernetes.io/projected/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-kube-api-access-lvdmr\") pod \"payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.356417 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.356397 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.364095 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.364065 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvdmr\" (UniqueName: \"kubernetes.io/projected/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-kube-api-access-lvdmr\") pod \"payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.417876 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.417846 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:14.575982 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:14.575956 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4"] Jul 27 20:08:14.578805 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:08:14.578779 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3531cfb0_15cd_41a8_acd0_9ffc069e0fe4.slice/crio-5f2600d5f2e059a6d217a071850875fdc393154891c69e3f04f540175e08230d WatchSource:0}: Error finding container 5f2600d5f2e059a6d217a071850875fdc393154891c69e3f04f540175e08230d: Status 404 returned error can't find the container with id 5f2600d5f2e059a6d217a071850875fdc393154891c69e3f04f540175e08230d Jul 27 20:08:15.296929 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.296895 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" event={"ID":"5948c0c7-d70f-4f36-b10b-190e7aadbb63","Type":"ContainerStarted","Data":"1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248"} Jul 27 20:08:15.297125 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.297052 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:15.298663 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.298639 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" event={"ID":"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4","Type":"ContainerStarted","Data":"00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd"} Jul 27 20:08:15.298663 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.298672 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" event={"ID":"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4","Type":"ContainerStarted","Data":"5f2600d5f2e059a6d217a071850875fdc393154891c69e3f04f540175e08230d"} Jul 27 20:08:15.298859 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.298696 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:15.313464 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.313422 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" podStartSLOduration=1.614540158 podStartE2EDuration="2.313408568s" totalImagesPullingTime="698.86841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:15.311685655 +0000 UTC m=+2553.130938306" watchObservedRunningTime="2026-07-27 20:08:15.313408568 +0000 UTC m=+2553.132661230" Jul 27 20:08:15.327486 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:15.327441 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" podStartSLOduration=1.327427925 podStartE2EDuration="1.327427925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:08:15.325955708 +0000 UTC m=+2553.145208345" watchObservedRunningTime="2026-07-27 20:08:15.327427925 +0000 UTC m=+2553.146680625" Jul 27 20:08:21.308832 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:21.308803 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:08:26.305610 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:26.305557 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:08:42.910570 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:08:42.910535 2584 scope.go:117] "RemoveContainer" containerID="bc86a64eb46cb2ddac989bf7756f257eaa1f0bcab9e2860b61cf0452c37ad9eb" Jul 27 20:13:42.967941 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:13:42.967870 2584 scope.go:117] "RemoveContainer" containerID="3ab905121b9b214492bb2d57478d36869376d21a14e29270f5b495f2f19e032a" Jul 27 20:15:00.168315 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.168274 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28"] Jul 27 20:15:00.174884 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.174851 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" Jul 27 20:15:00.178798 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.178766 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn"] Jul 27 20:15:00.182889 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.182471 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" Jul 27 20:15:00.182889 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.182544 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 20:15:00.187974 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.187947 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" Jul 27 20:15:00.188108 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.188045 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28"] Jul 27 20:15:00.196268 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.196104 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" Jul 27 20:15:00.197574 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.197514 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn"] Jul 27 20:15:00.335605 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.335546 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28"] Jul 27 20:15:00.337682 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:15:00.337650 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd1c844_fc85_4e3c_8292_f53f8e8ea929.slice/crio-172bbaa8a973dd4aab5fcecd7174ad2c7f3e5755a3c63a23e501a25d07ec8568 WatchSource:0}: Error finding container 172bbaa8a973dd4aab5fcecd7174ad2c7f3e5755a3c63a23e501a25d07ec8568: Status 404 returned error can't find the container with id 172bbaa8a973dd4aab5fcecd7174ad2c7f3e5755a3c63a23e501a25d07ec8568 Jul 27 20:15:00.566127 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:00.566102 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn"] Jul 27 20:15:00.567354 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:15:00.567334 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b5973b_a76d_4d33_951d_5e7a97b4adb5.slice/crio-0a4846afa2bcc383b81e340f004772ec022aa5c4b841a1c5e6b3e2b19edc9ee0 WatchSource:0}: Error finding container 0a4846afa2bcc383b81e340f004772ec022aa5c4b841a1c5e6b3e2b19edc9ee0: Status 404 returned error can't find the container with id 0a4846afa2bcc383b81e340f004772ec022aa5c4b841a1c5e6b3e2b19edc9ee0 Jul 27 20:15:01.347158 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:01.347125 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" event={"ID":"37b5973b-a76d-4d33-951d-5e7a97b4adb5","Type":"ContainerStarted","Data":"a05d9e2f2177e63672334bbc080c90aebafef5b854632baf24e49b6b67a8119f"} Jul 27 20:15:01.347603 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:01.347184 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" event={"ID":"37b5973b-a76d-4d33-951d-5e7a97b4adb5","Type":"ContainerStarted","Data":"0a4846afa2bcc383b81e340f004772ec022aa5c4b841a1c5e6b3e2b19edc9ee0"} Jul 27 20:15:01.348653 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:01.348623 2584 generic.go:356] "Generic (PLEG): container finished" podID="1cd1c844-fc85-4e3c-8292-f53f8e8ea929" containerID="e016f455ced1823dede092767795ac2d17a0e842cf45f310b92e694cd3712a40" exitCode=0 Jul 27 20:15:01.348761 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:01.348661 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" event={"ID":"1cd1c844-fc85-4e3c-8292-f53f8e8ea929","Type":"ContainerDied","Data":"e016f455ced1823dede092767795ac2d17a0e842cf45f310b92e694cd3712a40"} Jul 27 20:15:01.348761 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:01.348693 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" event={"ID":"1cd1c844-fc85-4e3c-8292-f53f8e8ea929","Type":"ContainerStarted","Data":"172bbaa8a973dd4aab5fcecd7174ad2c7f3e5755a3c63a23e501a25d07ec8568"} Jul 27 20:15:01.364299 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:01.364254 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" podStartSLOduration=1.364240037 podStartE2EDuration="1.364240037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:15:01.362316729 +0000 UTC m=+2959.181569366" watchObservedRunningTime="2026-07-27 20:15:01.364240037 +0000 UTC m=+2959.183492722" Jul 27 20:15:02.355112 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:02.355078 2584 generic.go:356] "Generic (PLEG): container finished" podID="37b5973b-a76d-4d33-951d-5e7a97b4adb5" containerID="a05d9e2f2177e63672334bbc080c90aebafef5b854632baf24e49b6b67a8119f" exitCode=0 Jul 27 20:15:02.355543 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:02.355170 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" event={"ID":"37b5973b-a76d-4d33-951d-5e7a97b4adb5","Type":"ContainerDied","Data":"a05d9e2f2177e63672334bbc080c90aebafef5b854632baf24e49b6b67a8119f"} Jul 27 20:15:02.486231 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:02.486208 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" Jul 27 20:15:03.361035 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:03.360957 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" Jul 27 20:15:03.361456 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:03.360957 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29753055-srz28" event={"ID":"1cd1c844-fc85-4e3c-8292-f53f8e8ea929","Type":"ContainerDied","Data":"172bbaa8a973dd4aab5fcecd7174ad2c7f3e5755a3c63a23e501a25d07ec8568"} Jul 27 20:15:03.361456 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:03.361086 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="172bbaa8a973dd4aab5fcecd7174ad2c7f3e5755a3c63a23e501a25d07ec8568" Jul 27 20:15:03.489762 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:03.489737 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" Jul 27 20:15:04.367599 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:04.367553 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" Jul 27 20:15:04.367980 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:04.367609 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn" event={"ID":"37b5973b-a76d-4d33-951d-5e7a97b4adb5","Type":"ContainerDied","Data":"0a4846afa2bcc383b81e340f004772ec022aa5c4b841a1c5e6b3e2b19edc9ee0"} Jul 27 20:15:04.367980 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:15:04.367656 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a4846afa2bcc383b81e340f004772ec022aa5c4b841a1c5e6b3e2b19edc9ee0" Jul 27 20:18:37.635894 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.635857 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs"] Jul 27 20:18:37.636388 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.636253 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b5973b-a76d-4d33-951d-5e7a97b4adb5" containerName="cleanup" Jul 27 20:18:37.636388 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.636265 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b5973b-a76d-4d33-951d-5e7a97b4adb5" containerName="cleanup" Jul 27 20:18:37.636388 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.636278 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd1c844-fc85-4e3c-8292-f53f8e8ea929" containerName="cleanup" Jul 27 20:18:37.636388 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.636284 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd1c844-fc85-4e3c-8292-f53f8e8ea929" containerName="cleanup" Jul 27 20:18:37.636388 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.636343 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd1c844-fc85-4e3c-8292-f53f8e8ea929" containerName="cleanup" Jul 27 20:18:37.636388 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.636353 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="37b5973b-a76d-4d33-951d-5e7a97b4adb5" containerName="cleanup" Jul 27 20:18:37.639252 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.639234 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.641788 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.641765 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-6c472a-serving-cert\"" Jul 27 20:18:37.649422 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.649389 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs"] Jul 27 20:18:37.711375 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.711344 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.711563 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.711472 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44455413-0cd9-41fa-8149-9a9eef26c43a-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.711563 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.711499 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wkd\" (UniqueName: \"kubernetes.io/projected/44455413-0cd9-41fa-8149-9a9eef26c43a-kube-api-access-b2wkd\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.812463 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.812425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44455413-0cd9-41fa-8149-9a9eef26c43a-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.812463 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.812466 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wkd\" (UniqueName: \"kubernetes.io/projected/44455413-0cd9-41fa-8149-9a9eef26c43a-kube-api-access-b2wkd\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.812765 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.812503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.812765 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:18:37.812680 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-serving-cert: secret "maas-api-e2e-ipp-a-6c472a-serving-cert" not found Jul 27 20:18:37.812765 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:18:37.812751 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls podName:44455413-0cd9-41fa-8149-9a9eef26c43a nodeName:}" failed. No retries permitted until 2026-07-27 20:18:38.312728844 +0000 UTC m=+3176.131981466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls") pod "maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" (UID: "44455413-0cd9-41fa-8149-9a9eef26c43a") : secret "maas-api-e2e-ipp-a-6c472a-serving-cert" not found Jul 27 20:18:37.813089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.813068 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44455413-0cd9-41fa-8149-9a9eef26c43a-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:37.821167 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:37.821144 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wkd\" (UniqueName: \"kubernetes.io/projected/44455413-0cd9-41fa-8149-9a9eef26c43a-kube-api-access-b2wkd\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:38.317300 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:38.317261 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:38.319907 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:38.319880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:38.551790 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:38.551750 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:38.685650 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:38.685625 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs"] Jul 27 20:18:38.688050 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:18:38.688024 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44455413_0cd9_41fa_8149_9a9eef26c43a.slice/crio-e02854fa8e01d5b9edfba4b2c24b016312513e8f11c4f7d83af472fc64377e92 WatchSource:0}: Error finding container e02854fa8e01d5b9edfba4b2c24b016312513e8f11c4f7d83af472fc64377e92: Status 404 returned error can't find the container with id e02854fa8e01d5b9edfba4b2c24b016312513e8f11c4f7d83af472fc64377e92 Jul 27 20:18:38.689416 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:38.689398 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 20:18:39.462326 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:39.462243 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" event={"ID":"44455413-0cd9-41fa-8149-9a9eef26c43a","Type":"ContainerStarted","Data":"8e4d16b9eae9e3c02a49c9d583294f060cbfc36b8e42e44c5575b5246c489ba3"} Jul 27 20:18:39.462326 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:39.462293 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" event={"ID":"44455413-0cd9-41fa-8149-9a9eef26c43a","Type":"ContainerStarted","Data":"e02854fa8e01d5b9edfba4b2c24b016312513e8f11c4f7d83af472fc64377e92"} Jul 27 20:18:39.462558 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:39.462419 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:18:39.478373 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:39.478324 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" podStartSLOduration=1.989762674 podStartE2EDuration="2.478306309s" totalImagesPullingTime="488.543635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:18:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:18:39.478232687 +0000 UTC m=+3177.297485324" watchObservedRunningTime="2026-07-27 20:18:39.478306309 +0000 UTC m=+3177.297558947" Jul 27 20:18:45.473404 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:18:45.473375 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:19:06.901643 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.901611 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m"] Jul 27 20:19:06.905572 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.905544 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:06.908054 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.908026 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-d4162b-serving-cert\"" Jul 27 20:19:06.919403 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.919379 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m"] Jul 27 20:19:06.959795 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.959748 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d78dv\" (UniqueName: \"kubernetes.io/projected/7e7efec1-c921-4f90-b008-bc0f743ffb76-kube-api-access-d78dv\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:06.959954 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.959803 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:06.959954 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:06.959879 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7efec1-c921-4f90-b008-bc0f743ffb76-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.060405 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.060368 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.060617 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.060427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7efec1-c921-4f90-b008-bc0f743ffb76-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.060617 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.060516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d78dv\" (UniqueName: \"kubernetes.io/projected/7e7efec1-c921-4f90-b008-bc0f743ffb76-kube-api-access-d78dv\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.060617 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:19:07.060529 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-serving-cert: secret "maas-api-e2e-ipp-b-d4162b-serving-cert" not found Jul 27 20:19:07.060809 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:19:07.060639 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls podName:7e7efec1-c921-4f90-b008-bc0f743ffb76 nodeName:}" failed. No retries permitted until 2026-07-27 20:19:07.560615048 +0000 UTC m=+3205.379867667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls") pod "maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" (UID: "7e7efec1-c921-4f90-b008-bc0f743ffb76") : secret "maas-api-e2e-ipp-b-d4162b-serving-cert" not found Jul 27 20:19:07.061122 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.061104 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7efec1-c921-4f90-b008-bc0f743ffb76-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.068663 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.068632 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d78dv\" (UniqueName: \"kubernetes.io/projected/7e7efec1-c921-4f90-b008-bc0f743ffb76-kube-api-access-d78dv\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.564910 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.564879 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.567500 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.567474 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.817794 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.817707 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:07.951102 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:07.951077 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m"] Jul 27 20:19:07.952676 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:19:07.952649 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7efec1_c921_4f90_b008_bc0f743ffb76.slice/crio-e78e07909cdcf557c0040c9d2d55587187bce32af692aa3a72d48129d786faa2 WatchSource:0}: Error finding container e78e07909cdcf557c0040c9d2d55587187bce32af692aa3a72d48129d786faa2: Status 404 returned error can't find the container with id e78e07909cdcf557c0040c9d2d55587187bce32af692aa3a72d48129d786faa2 Jul 27 20:19:08.615763 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:08.615720 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" event={"ID":"7e7efec1-c921-4f90-b008-bc0f743ffb76","Type":"ContainerStarted","Data":"67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4"} Jul 27 20:19:08.615965 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:08.615824 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:08.615965 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:08.615841 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" event={"ID":"7e7efec1-c921-4f90-b008-bc0f743ffb76","Type":"ContainerStarted","Data":"e78e07909cdcf557c0040c9d2d55587187bce32af692aa3a72d48129d786faa2"} Jul 27 20:19:08.631811 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:08.631763 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" podStartSLOduration=2.152287608 podStartE2EDuration="2.631740758s" totalImagesPullingTime="479.45315ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:08.630073093 +0000 UTC m=+3206.449325731" watchObservedRunningTime="2026-07-27 20:19:08.631740758 +0000 UTC m=+3206.450993394" Jul 27 20:19:14.628354 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:14.628323 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:19:28.228267 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:28.228236 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-p5r5v_a235a516-dcb9-47ad-943c-7439d976868b/payload-processing/0.log" Jul 27 20:19:53.584324 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.584280 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hhr2z"] Jul 27 20:19:53.587704 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.587682 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:19:53.590182 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.590164 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vc5xh\"" Jul 27 20:19:53.595459 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.595360 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hhr2z"] Jul 27 20:19:53.763758 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.763719 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-474pw\" (UniqueName: \"kubernetes.io/projected/3ad24db6-97e8-4208-9af5-e6afced50418-kube-api-access-474pw\") pod \"kuadrant-operator-catalog-hhr2z\" (UID: \"3ad24db6-97e8-4208-9af5-e6afced50418\") " pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:19:53.864524 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.864441 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-474pw\" (UniqueName: \"kubernetes.io/projected/3ad24db6-97e8-4208-9af5-e6afced50418-kube-api-access-474pw\") pod \"kuadrant-operator-catalog-hhr2z\" (UID: \"3ad24db6-97e8-4208-9af5-e6afced50418\") " pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:19:53.872411 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.872382 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-474pw\" (UniqueName: \"kubernetes.io/projected/3ad24db6-97e8-4208-9af5-e6afced50418-kube-api-access-474pw\") pod \"kuadrant-operator-catalog-hhr2z\" (UID: \"3ad24db6-97e8-4208-9af5-e6afced50418\") " pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:19:53.898456 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:53.898430 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:19:54.030113 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:54.030086 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hhr2z"] Jul 27 20:19:54.031681 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:19:54.031655 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad24db6_97e8_4208_9af5_e6afced50418.slice/crio-bcffd8d8e90d15495f29b390a8b6477f980e6bd54444f5c54d392cfdece1bad2 WatchSource:0}: Error finding container bcffd8d8e90d15495f29b390a8b6477f980e6bd54444f5c54d392cfdece1bad2: Status 404 returned error can't find the container with id bcffd8d8e90d15495f29b390a8b6477f980e6bd54444f5c54d392cfdece1bad2 Jul 27 20:19:54.846712 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:54.846647 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" event={"ID":"3ad24db6-97e8-4208-9af5-e6afced50418","Type":"ContainerStarted","Data":"bcffd8d8e90d15495f29b390a8b6477f980e6bd54444f5c54d392cfdece1bad2"} Jul 27 20:19:55.853291 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:55.853258 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" event={"ID":"3ad24db6-97e8-4208-9af5-e6afced50418","Type":"ContainerStarted","Data":"b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73"} Jul 27 20:19:55.870034 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:19:55.869974 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" podStartSLOduration=1.145825669 podStartE2EDuration="2.869952709s" totalImagesPullingTime="1.72412704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:19:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:19:55.86839226 +0000 UTC m=+3253.687644911" watchObservedRunningTime="2026-07-27 20:19:55.869952709 +0000 UTC m=+3253.689205345" Jul 27 20:20:03.898664 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:03.898632 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:20:03.899076 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:03.898683 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:20:03.920465 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:03.920440 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:20:04.927204 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:04.927171 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:20:04.963350 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:04.963320 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hhr2z"] Jul 27 20:20:06.916995 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:06.916939 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" podUID="3ad24db6-97e8-4208-9af5-e6afced50418" containerName="registry-server" containerID="cri-o://b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73" gracePeriod=2 Jul 27 20:20:07.171364 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.171300 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:20:07.272613 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.272568 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-474pw\" (UniqueName: \"kubernetes.io/projected/3ad24db6-97e8-4208-9af5-e6afced50418-kube-api-access-474pw\") pod \"3ad24db6-97e8-4208-9af5-e6afced50418\" (UID: \"3ad24db6-97e8-4208-9af5-e6afced50418\") " Jul 27 20:20:07.274717 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.274693 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad24db6-97e8-4208-9af5-e6afced50418-kube-api-access-474pw" (OuterVolumeSpecName: "kube-api-access-474pw") pod "3ad24db6-97e8-4208-9af5-e6afced50418" (UID: "3ad24db6-97e8-4208-9af5-e6afced50418"). InnerVolumeSpecName "kube-api-access-474pw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:20:07.373923 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.373897 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-474pw\" (UniqueName: \"kubernetes.io/projected/3ad24db6-97e8-4208-9af5-e6afced50418-kube-api-access-474pw\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:07.922474 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.922438 2584 generic.go:356] "Generic (PLEG): container finished" podID="3ad24db6-97e8-4208-9af5-e6afced50418" containerID="b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73" exitCode=0 Jul 27 20:20:07.922930 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.922484 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" Jul 27 20:20:07.922930 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.922524 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" event={"ID":"3ad24db6-97e8-4208-9af5-e6afced50418","Type":"ContainerDied","Data":"b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73"} Jul 27 20:20:07.922930 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.922571 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hhr2z" event={"ID":"3ad24db6-97e8-4208-9af5-e6afced50418","Type":"ContainerDied","Data":"bcffd8d8e90d15495f29b390a8b6477f980e6bd54444f5c54d392cfdece1bad2"} Jul 27 20:20:07.922930 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.922621 2584 scope.go:117] "RemoveContainer" containerID="b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73" Jul 27 20:20:07.932533 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.932514 2584 scope.go:117] "RemoveContainer" containerID="b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73" Jul 27 20:20:07.932804 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:20:07.932787 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73\": container with ID starting with b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73 not found: ID does not exist" containerID="b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73" Jul 27 20:20:07.932858 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.932813 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73"} err="failed to get container status \"b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73\": rpc error: code = NotFound desc = could not find container \"b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73\": container with ID starting with b8e07662f11d7c66479611702c3b885d1c6f8407fa100eb521febbe71e905a73 not found: ID does not exist" Jul 27 20:20:07.943227 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.943202 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hhr2z"] Jul 27 20:20:07.946477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:07.946458 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hhr2z"] Jul 27 20:20:08.656479 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:08.656444 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad24db6-97e8-4208-9af5-e6afced50418" path="/var/lib/kubelet/pods/3ad24db6-97e8-4208-9af5-e6afced50418/volumes" Jul 27 20:20:23.409343 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:23.409292 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-p5r5v_a235a516-dcb9-47ad-943c-7439d976868b/payload-processing/0.log" Jul 27 20:20:27.247619 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.247569 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw"] Jul 27 20:20:27.248202 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.248111 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad24db6-97e8-4208-9af5-e6afced50418" containerName="registry-server" Jul 27 20:20:27.248202 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.248127 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad24db6-97e8-4208-9af5-e6afced50418" containerName="registry-server" Jul 27 20:20:27.248312 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.248260 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad24db6-97e8-4208-9af5-e6afced50418" containerName="registry-server" Jul 27 20:20:27.253359 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.253335 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.255804 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.255776 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-d4c0c3-serving-cert\"" Jul 27 20:20:27.261568 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.261540 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw"] Jul 27 20:20:27.347048 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.347017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.347239 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.347063 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gqmg\" (UniqueName: \"kubernetes.io/projected/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-kube-api-access-8gqmg\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.347239 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.347086 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.448706 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.448663 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.448874 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.448732 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gqmg\" (UniqueName: \"kubernetes.io/projected/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-kube-api-access-8gqmg\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.448874 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.448767 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.448874 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:20:27.448810 2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-serving-cert: secret "maas-api-e2e-ipp-cleanup-d4c0c3-serving-cert" not found Jul 27 20:20:27.448874 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:20:27.448870 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls podName:ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f nodeName:}" failed. No retries permitted until 2026-07-27 20:20:27.948853041 +0000 UTC m=+3285.768105656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" (UID: "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f") : secret "maas-api-e2e-ipp-cleanup-d4c0c3-serving-cert" not found Jul 27 20:20:27.449595 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.449551 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.459676 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.459648 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gqmg\" (UniqueName: \"kubernetes.io/projected/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-kube-api-access-8gqmg\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.910759 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.910724 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g"] Jul 27 20:20:27.914370 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.914353 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:27.918595 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.918559 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-d4c0c3-dockercfg-sn6nb\"" Jul 27 20:20:27.918711 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.918559 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-d4c0c3\"" Jul 27 20:20:27.926184 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.926165 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g"] Jul 27 20:20:27.953085 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.953051 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:27.953235 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.953102 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:27.953235 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.953140 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2gfp\" (UniqueName: \"kubernetes.io/projected/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-kube-api-access-z2gfp\") pod \"payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:27.955552 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:27.955532 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:28.054244 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.054176 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:28.054444 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.054279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2gfp\" (UniqueName: \"kubernetes.io/projected/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-kube-api-access-z2gfp\") pod \"payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:28.054946 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.054921 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:28.064642 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.064606 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2gfp\" (UniqueName: \"kubernetes.io/projected/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-kube-api-access-z2gfp\") pod \"payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:28.166958 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.166876 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:28.225794 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.225761 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:28.319303 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.319270 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw"] Jul 27 20:20:28.320788 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:20:28.320757 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebed8ec9_a0d3_4bfa_a0d2_ebe0fe524c7f.slice/crio-305ef4bdfe969d9b9d59ad509cb99aa93504cb36ed0cc6fb1db3d5480fca08ec WatchSource:0}: Error finding container 305ef4bdfe969d9b9d59ad509cb99aa93504cb36ed0cc6fb1db3d5480fca08ec: Status 404 returned error can't find the container with id 305ef4bdfe969d9b9d59ad509cb99aa93504cb36ed0cc6fb1db3d5480fca08ec Jul 27 20:20:28.374542 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:28.374519 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g"] Jul 27 20:20:28.376404 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:20:28.376373 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6cda03_8a98_4fbe_b91a_e46f05bb025a.slice/crio-13d51011a0bcd0ebdb71a7ca74e6bef692b250d338a8d56912f1dea11785ff67 WatchSource:0}: Error finding container 13d51011a0bcd0ebdb71a7ca74e6bef692b250d338a8d56912f1dea11785ff67: Status 404 returned error can't find the container with id 13d51011a0bcd0ebdb71a7ca74e6bef692b250d338a8d56912f1dea11785ff67 Jul 27 20:20:29.030674 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.030634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" event={"ID":"fc6cda03-8a98-4fbe-b91a-e46f05bb025a","Type":"ContainerStarted","Data":"eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da"} Jul 27 20:20:29.030840 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.030701 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" event={"ID":"fc6cda03-8a98-4fbe-b91a-e46f05bb025a","Type":"ContainerStarted","Data":"13d51011a0bcd0ebdb71a7ca74e6bef692b250d338a8d56912f1dea11785ff67"} Jul 27 20:20:29.030928 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.030846 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:29.032162 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.032142 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" event={"ID":"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f","Type":"ContainerStarted","Data":"119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb"} Jul 27 20:20:29.032241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.032191 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:29.032241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.032208 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" event={"ID":"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f","Type":"ContainerStarted","Data":"305ef4bdfe969d9b9d59ad509cb99aa93504cb36ed0cc6fb1db3d5480fca08ec"} Jul 27 20:20:29.048610 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.048547 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" podStartSLOduration=2.048534837 podStartE2EDuration="2.048534837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:29.046366328 +0000 UTC m=+3286.865618966" watchObservedRunningTime="2026-07-27 20:20:29.048534837 +0000 UTC m=+3286.867787474" Jul 27 20:20:29.061040 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:29.060976 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" podStartSLOduration=1.560132031 podStartE2EDuration="2.060966379s" totalImagesPullingTime="500.834348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 20:20:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:20:29.060815282 +0000 UTC m=+3286.880067920" watchObservedRunningTime="2026-07-27 20:20:29.060966379 +0000 UTC m=+3286.880219015" Jul 27 20:20:35.043793 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:35.043760 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:40.039485 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:40.039448 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:42.589000 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.588970 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf"] Jul 27 20:20:42.594109 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.594088 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:42.596740 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.596717 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 20:20:42.599690 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.599667 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf"] Jul 27 20:20:42.684857 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.684824 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da618b57-4ca8-4784-a421-ed18e6ab2c75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf\" (UID: \"da618b57-4ca8-4784-a421-ed18e6ab2c75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:42.785514 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.785472 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da618b57-4ca8-4784-a421-ed18e6ab2c75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf\" (UID: \"da618b57-4ca8-4784-a421-ed18e6ab2c75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:42.786188 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.786165 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da618b57-4ca8-4784-a421-ed18e6ab2c75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf\" (UID: \"da618b57-4ca8-4784-a421-ed18e6ab2c75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:42.906518 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:42.906431 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:43.039615 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:43.039554 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf"] Jul 27 20:20:43.041351 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:20:43.041325 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda618b57_4ca8_4784_a421_ed18e6ab2c75.slice/crio-c785df612634fe8d10b21bf2d0c298db2bc902fe0302418148eca4bb0b36b044 WatchSource:0}: Error finding container c785df612634fe8d10b21bf2d0c298db2bc902fe0302418148eca4bb0b36b044: Status 404 returned error can't find the container with id c785df612634fe8d10b21bf2d0c298db2bc902fe0302418148eca4bb0b36b044 Jul 27 20:20:43.113431 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:43.113401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" event={"ID":"da618b57-4ca8-4784-a421-ed18e6ab2c75","Type":"ContainerStarted","Data":"c785df612634fe8d10b21bf2d0c298db2bc902fe0302418148eca4bb0b36b044"} Jul 27 20:20:44.120909 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:44.120878 2584 generic.go:356] "Generic (PLEG): container finished" podID="da618b57-4ca8-4784-a421-ed18e6ab2c75" containerID="7093be058363c5b7b4df0725a95e37d090587ed75d013aea48d83c7dc18e3849" exitCode=0 Jul 27 20:20:44.121291 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:44.120935 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" event={"ID":"da618b57-4ca8-4784-a421-ed18e6ab2c75","Type":"ContainerDied","Data":"7093be058363c5b7b4df0725a95e37d090587ed75d013aea48d83c7dc18e3849"} Jul 27 20:20:45.258420 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:45.258397 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:45.409651 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:45.409558 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da618b57-4ca8-4784-a421-ed18e6ab2c75-maas-api-service-ca\") pod \"da618b57-4ca8-4784-a421-ed18e6ab2c75\" (UID: \"da618b57-4ca8-4784-a421-ed18e6ab2c75\") " Jul 27 20:20:45.409923 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:45.409899 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da618b57-4ca8-4784-a421-ed18e6ab2c75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da618b57-4ca8-4784-a421-ed18e6ab2c75" (UID: "da618b57-4ca8-4784-a421-ed18e6ab2c75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:20:45.510771 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:45.510735 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da618b57-4ca8-4784-a421-ed18e6ab2c75-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:46.132176 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:46.132143 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" Jul 27 20:20:46.132323 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:46.132181 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf" event={"ID":"da618b57-4ca8-4784-a421-ed18e6ab2c75","Type":"ContainerDied","Data":"c785df612634fe8d10b21bf2d0c298db2bc902fe0302418148eca4bb0b36b044"} Jul 27 20:20:46.132323 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:46.132227 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c785df612634fe8d10b21bf2d0c298db2bc902fe0302418148eca4bb0b36b044" Jul 27 20:20:53.110606 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.110548 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw"] Jul 27 20:20:53.111077 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.110834 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" podUID="ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" containerName="maas-api" containerID="cri-o://119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb" gracePeriod=30 Jul 27 20:20:53.168511 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.168475 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g"] Jul 27 20:20:53.168767 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.168738 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" podUID="fc6cda03-8a98-4fbe-b91a-e46f05bb025a" containerName="payload-pre-processing" containerID="cri-o://eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da" gracePeriod=30 Jul 27 20:20:53.421307 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.421279 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:53.465265 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.465231 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:53.579550 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.579491 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls\") pod \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " Jul 27 20:20:53.579550 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.579554 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2gfp\" (UniqueName: \"kubernetes.io/projected/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-kube-api-access-z2gfp\") pod \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " Jul 27 20:20:53.579844 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.579625 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gqmg\" (UniqueName: \"kubernetes.io/projected/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-kube-api-access-8gqmg\") pod \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " Jul 27 20:20:53.579844 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.579647 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-openshift-service-ca\") pod \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\" (UID: \"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f\") " Jul 27 20:20:53.579844 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.579736 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-plugins-config-volume\") pod \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\" (UID: \"fc6cda03-8a98-4fbe-b91a-e46f05bb025a\") " Jul 27 20:20:53.580039 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.580016 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" (UID: "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:20:53.580172 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.580146 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc6cda03-8a98-4fbe-b91a-e46f05bb025a" (UID: "fc6cda03-8a98-4fbe-b91a-e46f05bb025a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:20:53.581843 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.581823 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-kube-api-access-8gqmg" (OuterVolumeSpecName: "kube-api-access-8gqmg") pod "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" (UID: "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f"). InnerVolumeSpecName "kube-api-access-8gqmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:20:53.582383 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.582366 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-kube-api-access-z2gfp" (OuterVolumeSpecName: "kube-api-access-z2gfp") pod "fc6cda03-8a98-4fbe-b91a-e46f05bb025a" (UID: "fc6cda03-8a98-4fbe-b91a-e46f05bb025a"). InnerVolumeSpecName "kube-api-access-z2gfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:20:53.582427 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.582378 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" (UID: "ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:20:53.681147 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.681062 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:53.681147 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.681105 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2gfp\" (UniqueName: \"kubernetes.io/projected/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-kube-api-access-z2gfp\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:53.681147 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.681117 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gqmg\" (UniqueName: \"kubernetes.io/projected/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-kube-api-access-8gqmg\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:53.681147 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.681125 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:53.681147 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:53.681134 2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6cda03-8a98-4fbe-b91a-e46f05bb025a-plugins-config-volume\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:20:54.177937 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.177907 2584 generic.go:356] "Generic (PLEG): container finished" podID="fc6cda03-8a98-4fbe-b91a-e46f05bb025a" containerID="eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da" exitCode=0 Jul 27 20:20:54.178476 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.177956 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" Jul 27 20:20:54.178476 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.178003 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" event={"ID":"fc6cda03-8a98-4fbe-b91a-e46f05bb025a","Type":"ContainerDied","Data":"eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da"} Jul 27 20:20:54.178476 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.178053 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g" event={"ID":"fc6cda03-8a98-4fbe-b91a-e46f05bb025a","Type":"ContainerDied","Data":"13d51011a0bcd0ebdb71a7ca74e6bef692b250d338a8d56912f1dea11785ff67"} Jul 27 20:20:54.178476 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.178086 2584 scope.go:117] "RemoveContainer" containerID="eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da" Jul 27 20:20:54.179481 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.179382 2584 generic.go:356] "Generic (PLEG): container finished" podID="ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" containerID="119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb" exitCode=0 Jul 27 20:20:54.179481 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.179439 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" Jul 27 20:20:54.179611 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.179515 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" event={"ID":"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f","Type":"ContainerDied","Data":"119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb"} Jul 27 20:20:54.179611 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.179573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw" event={"ID":"ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f","Type":"ContainerDied","Data":"305ef4bdfe969d9b9d59ad509cb99aa93504cb36ed0cc6fb1db3d5480fca08ec"} Jul 27 20:20:54.188534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.188515 2584 scope.go:117] "RemoveContainer" containerID="eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da" Jul 27 20:20:54.188881 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:20:54.188861 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da\": container with ID starting with eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da not found: ID does not exist" containerID="eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da" Jul 27 20:20:54.189084 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.188887 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da"} err="failed to get container status \"eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da\": rpc error: code = NotFound desc = could not find container \"eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da\": container with ID starting with eed34b4338d59b82fb70513822b547b4c019ee56d2532a78869fca066ce2d4da not found: ID does not exist" Jul 27 20:20:54.189084 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.188908 2584 scope.go:117] "RemoveContainer" containerID="119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb" Jul 27 20:20:54.197087 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.197072 2584 scope.go:117] "RemoveContainer" containerID="119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb" Jul 27 20:20:54.197322 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:20:54.197304 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb\": container with ID starting with 119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb not found: ID does not exist" containerID="119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb" Jul 27 20:20:54.197366 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.197330 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb"} err="failed to get container status \"119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb\": rpc error: code = NotFound desc = could not find container \"119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb\": container with ID starting with 119bf61bff8f3f7a1497f89a0a8b7ad2c29a82d337be0ed5bdffb6b1e11b74bb not found: ID does not exist" Jul 27 20:20:54.203104 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.203083 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw"] Jul 27 20:20:54.206457 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.206436 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d4c0c3-86c6b49d87-pqrlw"] Jul 27 20:20:54.216902 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.216881 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g"] Jul 27 20:20:54.219846 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.219821 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d4c0c3-b557bc8bd-d777g"] Jul 27 20:20:54.657040 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.656998 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" path="/var/lib/kubelet/pods/ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f/volumes" Jul 27 20:20:54.657428 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:54.657409 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6cda03-8a98-4fbe-b91a-e46f05bb025a" path="/var/lib/kubelet/pods/fc6cda03-8a98-4fbe-b91a-e46f05bb025a/volumes" Jul 27 20:20:57.663270 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:57.663239 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf"] Jul 27 20:20:57.665441 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:57.665422 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-d4c0c3-xfssf"] Jul 27 20:20:58.657444 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:20:58.657413 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da618b57-4ca8-4784-a421-ed18e6ab2c75" path="/var/lib/kubelet/pods/da618b57-4ca8-4784-a421-ed18e6ab2c75/volumes" Jul 27 20:21:07.716726 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.716645 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm"] Jul 27 20:21:07.717089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717006 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" containerName="maas-api" Jul 27 20:21:07.717089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717017 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" containerName="maas-api" Jul 27 20:21:07.717089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717034 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6cda03-8a98-4fbe-b91a-e46f05bb025a" containerName="payload-pre-processing" Jul 27 20:21:07.717089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717039 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6cda03-8a98-4fbe-b91a-e46f05bb025a" containerName="payload-pre-processing" Jul 27 20:21:07.717089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717045 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da618b57-4ca8-4784-a421-ed18e6ab2c75" containerName="revoke-keys" Jul 27 20:21:07.717089 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717051 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="da618b57-4ca8-4784-a421-ed18e6ab2c75" containerName="revoke-keys" Jul 27 20:21:07.717281 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717102 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="da618b57-4ca8-4784-a421-ed18e6ab2c75" containerName="revoke-keys" Jul 27 20:21:07.717281 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717110 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6cda03-8a98-4fbe-b91a-e46f05bb025a" containerName="payload-pre-processing" Jul 27 20:21:07.717281 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.717118 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebed8ec9-a0d3-4bfa-a0d2-ebe0fe524c7f" containerName="maas-api" Jul 27 20:21:07.721781 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.721761 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:07.724688 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.724662 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-86v9x\"" Jul 27 20:21:07.727133 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.727100 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm"] Jul 27 20:21:07.808131 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.808090 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm\" (UID: \"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:07.908772 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.908724 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm\" (UID: \"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:07.909353 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:07.909334 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm\" (UID: \"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:08.034592 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:08.034551 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:08.175613 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:08.175562 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm"] Jul 27 20:21:08.177066 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:21:08.177042 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b2a2e8_6ccd_4a05_bf4c_6f262e2c1361.slice/crio-336cbaf361281e736ded8034b2a87e3e1f1ee1eb1cf3101d308139689116594e WatchSource:0}: Error finding container 336cbaf361281e736ded8034b2a87e3e1f1ee1eb1cf3101d308139689116594e: Status 404 returned error can't find the container with id 336cbaf361281e736ded8034b2a87e3e1f1ee1eb1cf3101d308139689116594e Jul 27 20:21:08.261219 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:08.261186 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" event={"ID":"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361","Type":"ContainerStarted","Data":"336cbaf361281e736ded8034b2a87e3e1f1ee1eb1cf3101d308139689116594e"} Jul 27 20:21:09.267790 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:09.267759 2584 generic.go:356] "Generic (PLEG): container finished" podID="46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361" containerID="ad39ddfe0cc255ce85efe743c366e7345f77c2cbd14fa6b426fd99772b6f01b3" exitCode=0 Jul 27 20:21:09.268183 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:09.267823 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" event={"ID":"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361","Type":"ContainerDied","Data":"ad39ddfe0cc255ce85efe743c366e7345f77c2cbd14fa6b426fd99772b6f01b3"} Jul 27 20:21:10.407680 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:10.407650 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:10.431776 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:10.431749 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361-maas-api-service-ca\") pod \"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361\" (UID: \"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361\") " Jul 27 20:21:10.432137 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:10.432113 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361" (UID: "46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:21:10.533086 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:10.533001 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361-maas-api-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:21:11.279915 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:11.279886 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" Jul 27 20:21:11.280062 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:11.279880 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm" event={"ID":"46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361","Type":"ContainerDied","Data":"336cbaf361281e736ded8034b2a87e3e1f1ee1eb1cf3101d308139689116594e"} Jul 27 20:21:11.280062 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:11.280041 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="336cbaf361281e736ded8034b2a87e3e1f1ee1eb1cf3101d308139689116594e" Jul 27 20:21:23.135058 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.135009 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs"] Jul 27 20:21:23.135519 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.135257 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" podUID="44455413-0cd9-41fa-8149-9a9eef26c43a" containerName="maas-api" containerID="cri-o://8e4d16b9eae9e3c02a49c9d583294f060cbfc36b8e42e44c5575b5246c489ba3" gracePeriod=30 Jul 27 20:21:23.349615 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.349565 2584 generic.go:356] "Generic (PLEG): container finished" podID="44455413-0cd9-41fa-8149-9a9eef26c43a" containerID="8e4d16b9eae9e3c02a49c9d583294f060cbfc36b8e42e44c5575b5246c489ba3" exitCode=0 Jul 27 20:21:23.349793 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.349640 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" event={"ID":"44455413-0cd9-41fa-8149-9a9eef26c43a","Type":"ContainerDied","Data":"8e4d16b9eae9e3c02a49c9d583294f060cbfc36b8e42e44c5575b5246c489ba3"} Jul 27 20:21:23.384689 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.384665 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:21:23.443899 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.443813 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2wkd\" (UniqueName: \"kubernetes.io/projected/44455413-0cd9-41fa-8149-9a9eef26c43a-kube-api-access-b2wkd\") pod \"44455413-0cd9-41fa-8149-9a9eef26c43a\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " Jul 27 20:21:23.444058 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.443947 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls\") pod \"44455413-0cd9-41fa-8149-9a9eef26c43a\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " Jul 27 20:21:23.444058 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.443993 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44455413-0cd9-41fa-8149-9a9eef26c43a-openshift-service-ca\") pod \"44455413-0cd9-41fa-8149-9a9eef26c43a\" (UID: \"44455413-0cd9-41fa-8149-9a9eef26c43a\") " Jul 27 20:21:23.444348 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.444322 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44455413-0cd9-41fa-8149-9a9eef26c43a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44455413-0cd9-41fa-8149-9a9eef26c43a" (UID: "44455413-0cd9-41fa-8149-9a9eef26c43a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:21:23.446137 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.446106 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44455413-0cd9-41fa-8149-9a9eef26c43a" (UID: "44455413-0cd9-41fa-8149-9a9eef26c43a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:21:23.446235 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.446168 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44455413-0cd9-41fa-8149-9a9eef26c43a-kube-api-access-b2wkd" (OuterVolumeSpecName: "kube-api-access-b2wkd") pod "44455413-0cd9-41fa-8149-9a9eef26c43a" (UID: "44455413-0cd9-41fa-8149-9a9eef26c43a"). InnerVolumeSpecName "kube-api-access-b2wkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:21:23.544700 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.544668 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44455413-0cd9-41fa-8149-9a9eef26c43a-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:21:23.544700 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.544692 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2wkd\" (UniqueName: \"kubernetes.io/projected/44455413-0cd9-41fa-8149-9a9eef26c43a-kube-api-access-b2wkd\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:21:23.544700 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:23.544705 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44455413-0cd9-41fa-8149-9a9eef26c43a-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:21:24.355527 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:24.355498 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" Jul 27 20:21:24.355527 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:24.355520 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs" event={"ID":"44455413-0cd9-41fa-8149-9a9eef26c43a","Type":"ContainerDied","Data":"e02854fa8e01d5b9edfba4b2c24b016312513e8f11c4f7d83af472fc64377e92"} Jul 27 20:21:24.356064 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:24.355573 2584 scope.go:117] "RemoveContainer" containerID="8e4d16b9eae9e3c02a49c9d583294f060cbfc36b8e42e44c5575b5246c489ba3" Jul 27 20:21:24.376571 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:24.376544 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs"] Jul 27 20:21:24.379875 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:24.379847 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6c472a-566cdfb65b-lvwzs"] Jul 27 20:21:24.656864 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:24.656785 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44455413-0cd9-41fa-8149-9a9eef26c43a" path="/var/lib/kubelet/pods/44455413-0cd9-41fa-8149-9a9eef26c43a/volumes" Jul 27 20:21:27.787965 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:27.787928 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm"] Jul 27 20:21:27.790450 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:27.790421 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6c472a-tqddm"] Jul 27 20:21:28.656763 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:21:28.656734 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361" path="/var/lib/kubelet/pods/46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361/volumes" Jul 27 20:22:26.854495 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:26.854462 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m"] Jul 27 20:22:26.855078 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:26.854704 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" podUID="7e7efec1-c921-4f90-b008-bc0f743ffb76" containerName="maas-api" containerID="cri-o://67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4" gracePeriod=30 Jul 27 20:22:27.110592 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.110497 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:22:27.178231 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.178193 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls\") pod \"7e7efec1-c921-4f90-b008-bc0f743ffb76\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " Jul 27 20:22:27.178436 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.178271 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7efec1-c921-4f90-b008-bc0f743ffb76-openshift-service-ca\") pod \"7e7efec1-c921-4f90-b008-bc0f743ffb76\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " Jul 27 20:22:27.178436 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.178305 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d78dv\" (UniqueName: \"kubernetes.io/projected/7e7efec1-c921-4f90-b008-bc0f743ffb76-kube-api-access-d78dv\") pod \"7e7efec1-c921-4f90-b008-bc0f743ffb76\" (UID: \"7e7efec1-c921-4f90-b008-bc0f743ffb76\") " Jul 27 20:22:27.178674 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.178649 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e7efec1-c921-4f90-b008-bc0f743ffb76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e7efec1-c921-4f90-b008-bc0f743ffb76" (UID: "7e7efec1-c921-4f90-b008-bc0f743ffb76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:22:27.180608 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.180562 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e7efec1-c921-4f90-b008-bc0f743ffb76-kube-api-access-d78dv" (OuterVolumeSpecName: "kube-api-access-d78dv") pod "7e7efec1-c921-4f90-b008-bc0f743ffb76" (UID: "7e7efec1-c921-4f90-b008-bc0f743ffb76"). InnerVolumeSpecName "kube-api-access-d78dv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:22:27.180608 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.180565 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e7efec1-c921-4f90-b008-bc0f743ffb76" (UID: "7e7efec1-c921-4f90-b008-bc0f743ffb76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:22:27.279241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.279189 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7efec1-c921-4f90-b008-bc0f743ffb76-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:22:27.279241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.279234 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d78dv\" (UniqueName: \"kubernetes.io/projected/7e7efec1-c921-4f90-b008-bc0f743ffb76-kube-api-access-d78dv\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:22:27.279241 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.279244 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7efec1-c921-4f90-b008-bc0f743ffb76-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:22:27.688783 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.688747 2584 generic.go:356] "Generic (PLEG): container finished" podID="7e7efec1-c921-4f90-b008-bc0f743ffb76" containerID="67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4" exitCode=0 Jul 27 20:22:27.688982 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.688797 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" Jul 27 20:22:27.688982 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.688837 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" event={"ID":"7e7efec1-c921-4f90-b008-bc0f743ffb76","Type":"ContainerDied","Data":"67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4"} Jul 27 20:22:27.688982 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.688891 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m" event={"ID":"7e7efec1-c921-4f90-b008-bc0f743ffb76","Type":"ContainerDied","Data":"e78e07909cdcf557c0040c9d2d55587187bce32af692aa3a72d48129d786faa2"} Jul 27 20:22:27.688982 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.688914 2584 scope.go:117] "RemoveContainer" containerID="67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4" Jul 27 20:22:27.699100 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.699081 2584 scope.go:117] "RemoveContainer" containerID="67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4" Jul 27 20:22:27.699413 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:22:27.699395 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4\": container with ID starting with 67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4 not found: ID does not exist" containerID="67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4" Jul 27 20:22:27.699481 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.699427 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4"} err="failed to get container status \"67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4\": rpc error: code = NotFound desc = could not find container \"67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4\": container with ID starting with 67f939a4ce08923af13903742e4df141e1c7aa68e36aaaf2f0e40e701fea0ed4 not found: ID does not exist" Jul 27 20:22:27.711245 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.711210 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m"] Jul 27 20:22:27.714470 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:27.714441 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d4162b-7b6f995fd7-4fd4m"] Jul 27 20:22:28.656765 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:28.656733 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e7efec1-c921-4f90-b008-bc0f743ffb76" path="/var/lib/kubelet/pods/7e7efec1-c921-4f90-b008-bc0f743ffb76/volumes" Jul 27 20:22:48.821713 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:48.821677 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9"] Jul 27 20:22:48.822220 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:48.821941 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" podUID="1b18435a-3e76-4df5-b02f-165012d00720" containerName="maas-api" containerID="cri-o://9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872" gracePeriod=30 Jul 27 20:22:49.067842 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.067816 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:22:49.166298 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.166200 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pldzn\" (UniqueName: \"kubernetes.io/projected/1b18435a-3e76-4df5-b02f-165012d00720-kube-api-access-pldzn\") pod \"1b18435a-3e76-4df5-b02f-165012d00720\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " Jul 27 20:22:49.166298 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.166248 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b18435a-3e76-4df5-b02f-165012d00720-openshift-service-ca\") pod \"1b18435a-3e76-4df5-b02f-165012d00720\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " Jul 27 20:22:49.166540 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.166394 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b18435a-3e76-4df5-b02f-165012d00720-maas-api-tls\") pod \"1b18435a-3e76-4df5-b02f-165012d00720\" (UID: \"1b18435a-3e76-4df5-b02f-165012d00720\") " Jul 27 20:22:49.166672 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.166651 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b18435a-3e76-4df5-b02f-165012d00720-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b18435a-3e76-4df5-b02f-165012d00720" (UID: "1b18435a-3e76-4df5-b02f-165012d00720"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:22:49.168491 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.168469 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b18435a-3e76-4df5-b02f-165012d00720-kube-api-access-pldzn" (OuterVolumeSpecName: "kube-api-access-pldzn") pod "1b18435a-3e76-4df5-b02f-165012d00720" (UID: "1b18435a-3e76-4df5-b02f-165012d00720"). InnerVolumeSpecName "kube-api-access-pldzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:22:49.168595 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.168530 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b18435a-3e76-4df5-b02f-165012d00720-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b18435a-3e76-4df5-b02f-165012d00720" (UID: "1b18435a-3e76-4df5-b02f-165012d00720"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:22:49.267848 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.267819 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pldzn\" (UniqueName: \"kubernetes.io/projected/1b18435a-3e76-4df5-b02f-165012d00720-kube-api-access-pldzn\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:22:49.267848 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.267846 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b18435a-3e76-4df5-b02f-165012d00720-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:22:49.268036 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.267858 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b18435a-3e76-4df5-b02f-165012d00720-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:22:49.797860 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.797827 2584 generic.go:356] "Generic (PLEG): container finished" podID="1b18435a-3e76-4df5-b02f-165012d00720" containerID="9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872" exitCode=0 Jul 27 20:22:49.798054 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.797875 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" Jul 27 20:22:49.798054 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.797918 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" event={"ID":"1b18435a-3e76-4df5-b02f-165012d00720","Type":"ContainerDied","Data":"9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872"} Jul 27 20:22:49.798054 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.797965 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9" event={"ID":"1b18435a-3e76-4df5-b02f-165012d00720","Type":"ContainerDied","Data":"d16bd68ba169da7f58d6d84674b9dfa039c016b5cf31f28adc4d412b9d744b0e"} Jul 27 20:22:49.798054 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.797987 2584 scope.go:117] "RemoveContainer" containerID="9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872" Jul 27 20:22:49.807276 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.807261 2584 scope.go:117] "RemoveContainer" containerID="9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872" Jul 27 20:22:49.807518 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:22:49.807501 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872\": container with ID starting with 9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872 not found: ID does not exist" containerID="9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872" Jul 27 20:22:49.807556 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.807528 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872"} err="failed to get container status \"9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872\": rpc error: code = NotFound desc = could not find container \"9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872\": container with ID starting with 9b52d9947278470f9a02f4c3d4e39ded05f7b1941c071b7186f4ae59710ef872 not found: ID does not exist" Jul 27 20:22:49.818279 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.818258 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9"] Jul 27 20:22:49.821649 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:49.821632 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-97e28d-c88869b84-z4fk9"] Jul 27 20:22:50.657172 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:22:50.657141 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b18435a-3e76-4df5-b02f-165012d00720" path="/var/lib/kubelet/pods/1b18435a-3e76-4df5-b02f-165012d00720/volumes" Jul 27 20:23:10.801654 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:10.801619 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk"] Jul 27 20:23:10.802169 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:10.801918 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" podUID="5948c0c7-d70f-4f36-b10b-190e7aadbb63" containerName="maas-api" containerID="cri-o://1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248" gracePeriod=30 Jul 27 20:23:10.827916 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:10.827838 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn"] Jul 27 20:23:10.830283 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:10.830253 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-e837b8-29753055-kz5zn"] Jul 27 20:23:10.856992 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:10.856949 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4"] Jul 27 20:23:10.857254 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:10.857218 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" podUID="3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" containerName="payload-processing" containerID="cri-o://00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd" gracePeriod=30 Jul 27 20:23:11.104635 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.104605 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:23:11.134236 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.134209 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:23:11.145554 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.145519 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfcp9\" (UniqueName: \"kubernetes.io/projected/5948c0c7-d70f-4f36-b10b-190e7aadbb63-kube-api-access-dfcp9\") pod \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " Jul 27 20:23:11.145758 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.145570 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5948c0c7-d70f-4f36-b10b-190e7aadbb63-openshift-service-ca\") pod \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " Jul 27 20:23:11.145836 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.145770 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5948c0c7-d70f-4f36-b10b-190e7aadbb63-maas-api-tls\") pod \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\" (UID: \"5948c0c7-d70f-4f36-b10b-190e7aadbb63\") " Jul 27 20:23:11.145975 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.145955 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5948c0c7-d70f-4f36-b10b-190e7aadbb63-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5948c0c7-d70f-4f36-b10b-190e7aadbb63" (UID: "5948c0c7-d70f-4f36-b10b-190e7aadbb63"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:23:11.146095 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.146079 2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5948c0c7-d70f-4f36-b10b-190e7aadbb63-openshift-service-ca\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:23:11.147919 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.147897 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5948c0c7-d70f-4f36-b10b-190e7aadbb63-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5948c0c7-d70f-4f36-b10b-190e7aadbb63" (UID: "5948c0c7-d70f-4f36-b10b-190e7aadbb63"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 20:23:11.147978 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.147945 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5948c0c7-d70f-4f36-b10b-190e7aadbb63-kube-api-access-dfcp9" (OuterVolumeSpecName: "kube-api-access-dfcp9") pod "5948c0c7-d70f-4f36-b10b-190e7aadbb63" (UID: "5948c0c7-d70f-4f36-b10b-190e7aadbb63"). InnerVolumeSpecName "kube-api-access-dfcp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:23:11.247120 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.247077 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvdmr\" (UniqueName: \"kubernetes.io/projected/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-kube-api-access-lvdmr\") pod \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " Jul 27 20:23:11.247305 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.247160 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-plugins-config-volume\") pod \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\" (UID: \"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4\") " Jul 27 20:23:11.247349 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.247311 2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5948c0c7-d70f-4f36-b10b-190e7aadbb63-maas-api-tls\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:23:11.247349 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.247323 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfcp9\" (UniqueName: \"kubernetes.io/projected/5948c0c7-d70f-4f36-b10b-190e7aadbb63-kube-api-access-dfcp9\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:23:11.247542 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.247511 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" (UID: "3531cfb0-15cd-41a8-acd0-9ffc069e0fe4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 20:23:11.249321 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.249296 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-kube-api-access-lvdmr" (OuterVolumeSpecName: "kube-api-access-lvdmr") pod "3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" (UID: "3531cfb0-15cd-41a8-acd0-9ffc069e0fe4"). InnerVolumeSpecName "kube-api-access-lvdmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 20:23:11.348108 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.348017 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvdmr\" (UniqueName: \"kubernetes.io/projected/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-kube-api-access-lvdmr\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:23:11.348108 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.348059 2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4-plugins-config-volume\") on node \"ip-10-0-136-113.ec2.internal\" DevicePath \"\"" Jul 27 20:23:11.910395 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.910362 2584 generic.go:356] "Generic (PLEG): container finished" podID="5948c0c7-d70f-4f36-b10b-190e7aadbb63" containerID="1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248" exitCode=0 Jul 27 20:23:11.910854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.910403 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" Jul 27 20:23:11.910854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.910438 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" event={"ID":"5948c0c7-d70f-4f36-b10b-190e7aadbb63","Type":"ContainerDied","Data":"1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248"} Jul 27 20:23:11.910854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.910493 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk" event={"ID":"5948c0c7-d70f-4f36-b10b-190e7aadbb63","Type":"ContainerDied","Data":"01f234d2ff0e039be20990478886d28036d081d5fc7adea7dc01ccb47a664fe3"} Jul 27 20:23:11.910854 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.910518 2584 scope.go:117] "RemoveContainer" containerID="1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248" Jul 27 20:23:11.911991 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.911824 2584 generic.go:356] "Generic (PLEG): container finished" podID="3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" containerID="00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd" exitCode=0 Jul 27 20:23:11.911991 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.911869 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" event={"ID":"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4","Type":"ContainerDied","Data":"00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd"} Jul 27 20:23:11.911991 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.911877 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" Jul 27 20:23:11.911991 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.911912 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4" event={"ID":"3531cfb0-15cd-41a8-acd0-9ffc069e0fe4","Type":"ContainerDied","Data":"5f2600d5f2e059a6d217a071850875fdc393154891c69e3f04f540175e08230d"} Jul 27 20:23:11.922617 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.922415 2584 scope.go:117] "RemoveContainer" containerID="1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248" Jul 27 20:23:11.923155 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:23:11.923126 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248\": container with ID starting with 1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248 not found: ID does not exist" containerID="1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248" Jul 27 20:23:11.923272 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.923163 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248"} err="failed to get container status \"1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248\": rpc error: code = NotFound desc = could not find container \"1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248\": container with ID starting with 1bedbe37d2cb3504f637d7e27f3191240ad772b085ad2a86d27af1e54aac6248 not found: ID does not exist" Jul 27 20:23:11.923272 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.923184 2584 scope.go:117] "RemoveContainer" containerID="00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd" Jul 27 20:23:11.931976 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.931954 2584 scope.go:117] "RemoveContainer" containerID="00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd" Jul 27 20:23:11.932278 ip-10-0-136-113 kubenswrapper[2584]: E0727 20:23:11.932254 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd\": container with ID starting with 00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd not found: ID does not exist" containerID="00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd" Jul 27 20:23:11.932383 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.932288 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd"} err="failed to get container status \"00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd\": rpc error: code = NotFound desc = could not find container \"00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd\": container with ID starting with 00915bf89bd4062d4ce769551790c18fa387ae5b40ca61df9f749975795d51cd not found: ID does not exist" Jul 27 20:23:11.935812 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.935782 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk"] Jul 27 20:23:11.938401 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.938370 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-e837b8-5fb86b846f-w4bmk"] Jul 27 20:23:11.947608 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.947561 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4"] Jul 27 20:23:11.950895 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:11.950868 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-e837b8-7cb444fcdb-jd8x4"] Jul 27 20:23:12.656832 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:12.656789 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" path="/var/lib/kubelet/pods/3531cfb0-15cd-41a8-acd0-9ffc069e0fe4/volumes" Jul 27 20:23:12.657167 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:12.657147 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37b5973b-a76d-4d33-951d-5e7a97b4adb5" path="/var/lib/kubelet/pods/37b5973b-a76d-4d33-951d-5e7a97b4adb5/volumes" Jul 27 20:23:12.657522 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:12.657504 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5948c0c7-d70f-4f36-b10b-190e7aadbb63" path="/var/lib/kubelet/pods/5948c0c7-d70f-4f36-b10b-190e7aadbb63/volumes" Jul 27 20:23:29.024983 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:29.024953 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-fxvkp_0c9de81e-d59f-42a3-818e-ecc9903cd5e5/copy-manifests/0.log" Jul 27 20:23:29.032621 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:29.032576 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-fxvkp_0c9de81e-d59f-42a3-818e-ecc9903cd5e5/manager/0.log" Jul 27 20:23:29.495044 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:29.494972 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dd85d7bc7-6ff79_31b46b42-7238-4303-918c-2d6cdcbd4f69/maas-api/0.log" Jul 27 20:23:29.834909 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:29.834882 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29753055-srz28_1cd1c844-fc85-4e3c-8292-f53f8e8ea929/cleanup/0.log" Jul 27 20:23:30.703123 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.703093 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26_0c22f5d5-14c8-4180-b643-3fd24e99d8b8/util/0.log" Jul 27 20:23:30.709041 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.709014 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26_0c22f5d5-14c8-4180-b643-3fd24e99d8b8/pull/0.log" Jul 27 20:23:30.714464 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.714447 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26_0c22f5d5-14c8-4180-b643-3fd24e99d8b8/extract/0.log" Jul 27 20:23:30.827263 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.827244 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98_02e1e877-242d-4814-8ee6-80c51135e86a/util/0.log" Jul 27 20:23:30.834506 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.834482 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98_02e1e877-242d-4814-8ee6-80c51135e86a/pull/0.log" Jul 27 20:23:30.840200 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.840186 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98_02e1e877-242d-4814-8ee6-80c51135e86a/extract/0.log" Jul 27 20:23:30.944639 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.944619 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf_7b0ed047-ed64-409c-a639-2824423ca06f/util/0.log" Jul 27 20:23:30.950787 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.950760 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf_7b0ed047-ed64-409c-a639-2824423ca06f/pull/0.log" Jul 27 20:23:30.956437 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:30.956376 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf_7b0ed047-ed64-409c-a639-2824423ca06f/extract/0.log" Jul 27 20:23:31.065500 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:31.065472 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb_c5bb441d-01c7-41a0-820a-6d51eb3c5471/util/0.log" Jul 27 20:23:31.071447 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:31.071422 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb_c5bb441d-01c7-41a0-820a-6d51eb3c5471/pull/0.log" Jul 27 20:23:31.076780 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:31.076761 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb_c5bb441d-01c7-41a0-820a-6d51eb3c5471/extract/0.log" Jul 27 20:23:31.999841 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:31.999806 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ktm74_3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2/manager/0.log" Jul 27 20:23:32.495759 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:32.495672 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xds6v_65b6987a-698f-4b20-afa1-04dbe16296b8/discovery/0.log" Jul 27 20:23:33.100477 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:33.100427 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-p5r5v_a235a516-dcb9-47ad-943c-7439d976868b/payload-processing/0.log" Jul 27 20:23:33.697487 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:33.697454 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hvpgw_35ffabcb-869c-4e9e-bf22-b6249b601832/main/0.log" Jul 27 20:23:34.046780 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:34.046750 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-b6srt_d278d8d4-30fc-4b77-a405-02b8f9056efd/main/0.log" Jul 27 20:23:42.840693 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:42.840663 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4rj6l_6f37b558-ccba-4fd8-8470-43dd2024e5f4/global-pull-secret-syncer/0.log" Jul 27 20:23:43.004309 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:43.004282 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m4z6w_f7cd79f2-9940-40f6-89b1-4677150981e5/konnectivity-agent/0.log" Jul 27 20:23:43.087071 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:43.087041 2584 scope.go:117] "RemoveContainer" containerID="a05d9e2f2177e63672334bbc080c90aebafef5b854632baf24e49b6b67a8119f" Jul 27 20:23:43.119156 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:43.119139 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-113.ec2.internal_1b21792b782558305c8012893bc9790e/haproxy/0.log" Jul 27 20:23:47.499811 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.499779 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26_0c22f5d5-14c8-4180-b643-3fd24e99d8b8/extract/0.log" Jul 27 20:23:47.537243 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.537212 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26_0c22f5d5-14c8-4180-b643-3fd24e99d8b8/util/0.log" Jul 27 20:23:47.588568 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.588542 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vtn26_0c22f5d5-14c8-4180-b643-3fd24e99d8b8/pull/0.log" Jul 27 20:23:47.619772 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.619745 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98_02e1e877-242d-4814-8ee6-80c51135e86a/extract/0.log" Jul 27 20:23:47.650514 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.650490 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98_02e1e877-242d-4814-8ee6-80c51135e86a/util/0.log" Jul 27 20:23:47.677786 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.677763 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vpd98_02e1e877-242d-4814-8ee6-80c51135e86a/pull/0.log" Jul 27 20:23:47.723571 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.723550 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf_7b0ed047-ed64-409c-a639-2824423ca06f/extract/0.log" Jul 27 20:23:47.754558 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.754503 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf_7b0ed047-ed64-409c-a639-2824423ca06f/util/0.log" Jul 27 20:23:47.780658 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.780635 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b4szf_7b0ed047-ed64-409c-a639-2824423ca06f/pull/0.log" Jul 27 20:23:47.811865 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.811842 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb_c5bb441d-01c7-41a0-820a-6d51eb3c5471/extract/0.log" Jul 27 20:23:47.833343 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.833322 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb_c5bb441d-01c7-41a0-820a-6d51eb3c5471/util/0.log" Jul 27 20:23:47.854925 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:47.854904 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cwgmb_c5bb441d-01c7-41a0-820a-6d51eb3c5471/pull/0.log" Jul 27 20:23:48.982536 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:48.982506 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-ktm74_3e98ecae-ea40-4fe3-b1f9-9881ff63a6c2/manager/0.log" Jul 27 20:23:50.985071 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:50.985044 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-c2dbh_f08e2eb6-a162-4147-83ee-b2e452d9a4dd/monitoring-plugin/0.log" Jul 27 20:23:51.018321 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:51.018293 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49qp2_39922aac-4a1c-42bd-8f85-5874aa6ed1b3/node-exporter/0.log" Jul 27 20:23:51.039691 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:51.039669 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49qp2_39922aac-4a1c-42bd-8f85-5874aa6ed1b3/kube-rbac-proxy/0.log" Jul 27 20:23:51.060862 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:51.060840 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-49qp2_39922aac-4a1c-42bd-8f85-5874aa6ed1b3/init-textfile/0.log" Jul 27 20:23:51.619757 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:51.619719 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb476b6bc-wlsr2_d3dc0b85-42ab-4840-99a0-f63fdadefa20/telemeter-client/0.log" Jul 27 20:23:51.649371 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:51.649349 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb476b6bc-wlsr2_d3dc0b85-42ab-4840-99a0-f63fdadefa20/reload/0.log" Jul 27 20:23:51.670688 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:51.670664 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb476b6bc-wlsr2_d3dc0b85-42ab-4840-99a0-f63fdadefa20/kube-rbac-proxy/0.log" Jul 27 20:23:53.158132 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158100 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8"] Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158412 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" containerName="payload-processing" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158424 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" containerName="payload-processing" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158435 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44455413-0cd9-41fa-8149-9a9eef26c43a" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158441 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="44455413-0cd9-41fa-8149-9a9eef26c43a" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158450 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361" containerName="revoke-keys" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158455 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361" containerName="revoke-keys" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158464 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b18435a-3e76-4df5-b02f-165012d00720" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158469 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b18435a-3e76-4df5-b02f-165012d00720" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158478 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5948c0c7-d70f-4f36-b10b-190e7aadbb63" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158482 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="5948c0c7-d70f-4f36-b10b-190e7aadbb63" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158494 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7efec1-c921-4f90-b008-bc0f743ffb76" containerName="maas-api" Jul 27 20:23:53.158534 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158499 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7efec1-c921-4f90-b008-bc0f743ffb76" containerName="maas-api" Jul 27 20:23:53.158985 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158543 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7efec1-c921-4f90-b008-bc0f743ffb76" containerName="maas-api" Jul 27 20:23:53.158985 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158550 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3531cfb0-15cd-41a8-acd0-9ffc069e0fe4" containerName="payload-processing" Jul 27 20:23:53.158985 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158556 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b18435a-3e76-4df5-b02f-165012d00720" containerName="maas-api" Jul 27 20:23:53.158985 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158561 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="44455413-0cd9-41fa-8149-9a9eef26c43a" containerName="maas-api" Jul 27 20:23:53.158985 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158567 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b2a2e8-6ccd-4a05-bf4c-6f262e2c1361" containerName="revoke-keys" Jul 27 20:23:53.158985 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.158573 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="5948c0c7-d70f-4f36-b10b-190e7aadbb63" containerName="maas-api" Jul 27 20:23:53.161552 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.161536 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.163905 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.163884 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ngh2\"/\"openshift-service-ca.crt\"" Jul 27 20:23:53.164880 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.164864 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8ngh2\"/\"default-dockercfg-gkqfh\"" Jul 27 20:23:53.164937 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.164892 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8ngh2\"/\"kube-root-ca.crt\"" Jul 27 20:23:53.167946 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.167923 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8"] Jul 27 20:23:53.201460 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.201433 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-lib-modules\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.201574 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.201474 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-sys\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.201574 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.201503 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-podres\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.201574 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.201530 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-proc\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.201709 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.201615 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc2wt\" (UniqueName: \"kubernetes.io/projected/84849580-0f36-4b65-a61d-a0ef7f0f1678-kube-api-access-nc2wt\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302302 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc2wt\" (UniqueName: \"kubernetes.io/projected/84849580-0f36-4b65-a61d-a0ef7f0f1678-kube-api-access-nc2wt\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302450 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302306 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-lib-modules\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302450 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302349 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-sys\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302450 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-podres\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302450 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302406 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-proc\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302677 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302472 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-sys\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302677 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302503 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-proc\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302677 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302512 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-podres\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.302677 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.302512 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84849580-0f36-4b65-a61d-a0ef7f0f1678-lib-modules\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.310234 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.310201 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc2wt\" (UniqueName: \"kubernetes.io/projected/84849580-0f36-4b65-a61d-a0ef7f0f1678-kube-api-access-nc2wt\") pod \"perf-node-gather-daemonset-bklv8\" (UID: \"84849580-0f36-4b65-a61d-a0ef7f0f1678\") " pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.472262 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.472197 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:53.605592 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:53.605546 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8"] Jul 27 20:23:53.610602 ip-10-0-136-113 kubenswrapper[2584]: W0727 20:23:53.610558 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84849580_0f36_4b65_a61d_a0ef7f0f1678.slice/crio-7271e74eee76aadb2f099c835188323830a945b7c4e0bb613faa09c176aece13 WatchSource:0}: Error finding container 7271e74eee76aadb2f099c835188323830a945b7c4e0bb613faa09c176aece13: Status 404 returned error can't find the container with id 7271e74eee76aadb2f099c835188323830a945b7c4e0bb613faa09c176aece13 Jul 27 20:23:54.127684 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:54.127648 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" event={"ID":"84849580-0f36-4b65-a61d-a0ef7f0f1678","Type":"ContainerStarted","Data":"5b46d8d74f88af534d4fd5a626ebf6876da41ce13b7d68e4e33e03faa7ef3d7f"} Jul 27 20:23:54.127906 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:54.127712 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:23:54.127906 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:54.127735 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" event={"ID":"84849580-0f36-4b65-a61d-a0ef7f0f1678","Type":"ContainerStarted","Data":"7271e74eee76aadb2f099c835188323830a945b7c4e0bb613faa09c176aece13"} Jul 27 20:23:54.131862 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:54.131842 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9cb5bc76-gnlc4_196cead2-1f6d-4e76-9bea-700765f5297c/console/0.log" Jul 27 20:23:54.144516 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:54.144477 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" podStartSLOduration=1.144462142 podStartE2EDuration="1.144462142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 20:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 20:23:54.142813011 +0000 UTC m=+3491.962065649" watchObservedRunningTime="2026-07-27 20:23:54.144462142 +0000 UTC m=+3491.963714778" Jul 27 20:23:54.168324 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:54.168301 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-khk8h_e0c90960-7c8c-41d0-815b-0da4cba96954/download-server/0.log" Jul 27 20:23:55.839436 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:55.839408 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dkmb6_cf1a6f4f-afda-4b01-a45f-6b7f0607a42e/dns/0.log" Jul 27 20:23:55.860540 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:55.860513 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dkmb6_cf1a6f4f-afda-4b01-a45f-6b7f0607a42e/kube-rbac-proxy/0.log" Jul 27 20:23:55.979905 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:55.979888 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x7k4j_5b04d6f9-bc80-4da8-af55-25fc9e46c8f0/dns-node-resolver/0.log" Jul 27 20:23:56.572213 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:56.572175 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-787bb4c475-khjsh_96f4b5db-f002-4e45-bfb7-819d21f7f190/registry/0.log" Jul 27 20:23:56.596502 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:56.596476 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8v285_275ca8c0-e814-498c-bcaa-36fa1cf06adb/node-ca/0.log" Jul 27 20:23:57.729048 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:57.729015 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xds6v_65b6987a-698f-4b20-afa1-04dbe16296b8/discovery/0.log" Jul 27 20:23:57.916495 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:57.916463 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-p5r5v_a235a516-dcb9-47ad-943c-7439d976868b/payload-processing/0.log" Jul 27 20:23:58.743659 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:58.743628 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h6flp_1b8f0150-bc95-4af1-817c-c58ec44564b7/serve-healthcheck-canary/0.log" Jul 27 20:23:59.354320 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:59.354287 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-czwz5_c1392a57-9ef2-4ae4-b1ff-35b2f8212568/kube-rbac-proxy/0.log" Jul 27 20:23:59.376384 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:59.376360 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-czwz5_c1392a57-9ef2-4ae4-b1ff-35b2f8212568/exporter/0.log" Jul 27 20:23:59.398813 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:23:59.398795 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-czwz5_c1392a57-9ef2-4ae4-b1ff-35b2f8212568/extractor/0.log" Jul 27 20:24:00.142171 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:00.142145 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8ngh2/perf-node-gather-daemonset-bklv8" Jul 27 20:24:02.299410 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:02.299382 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-fxvkp_0c9de81e-d59f-42a3-818e-ecc9903cd5e5/manager/0.log" Jul 27 20:24:02.323682 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:02.323657 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-787b9f94c8-fxvkp_0c9de81e-d59f-42a3-818e-ecc9903cd5e5/copy-manifests/0.log" Jul 27 20:24:03.644926 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:03.644895 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xds6v_65b6987a-698f-4b20-afa1-04dbe16296b8/discovery/0.log" Jul 27 20:24:03.792936 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:03.792907 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-p5r5v_a235a516-dcb9-47ad-943c-7439d976868b/payload-processing/0.log" Jul 27 20:24:03.852565 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:03.852537 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8cbf9cd8b-zkhvg_f0ded0b5-3132-4600-aa28-1988ccd1c2d5/manager/0.log" Jul 27 20:24:05.318372 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:05.318342 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-xds6v_65b6987a-698f-4b20-afa1-04dbe16296b8/discovery/0.log" Jul 27 20:24:05.476280 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:05.476255 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-p5r5v_a235a516-dcb9-47ad-943c-7439d976868b/payload-processing/0.log" Jul 27 20:24:08.665212 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:08.665178 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7mxv6_24836b7a-7e03-4740-8173-2ca6f0cfe25a/migrator/0.log" Jul 27 20:24:08.686322 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:08.686296 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-7mxv6_24836b7a-7e03-4740-8173-2ca6f0cfe25a/graceful-termination/0.log" Jul 27 20:24:10.397181 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.397158 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/kube-multus-additional-cni-plugins/0.log" Jul 27 20:24:10.418567 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.418538 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/egress-router-binary-copy/0.log" Jul 27 20:24:10.440450 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.440425 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/cni-plugins/0.log" Jul 27 20:24:10.462179 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.462163 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/bond-cni-plugin/0.log" Jul 27 20:24:10.483914 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.483895 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/routeoverride-cni/0.log" Jul 27 20:24:10.507072 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.507051 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/whereabouts-cni-bincopy/0.log" Jul 27 20:24:10.529462 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.529436 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vdgkx_03661298-acdd-469e-b8fc-830b18b39439/whereabouts-cni/0.log" Jul 27 20:24:10.571031 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.571006 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cmdr6_3ff3a55d-1bb0-45de-a8b7-730509df76ab/kube-multus/0.log" Jul 27 20:24:10.650243 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.650183 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c9sj9_3a0328b5-c52a-438e-a301-6c23bbac4a90/network-metrics-daemon/0.log" Jul 27 20:24:10.673847 ip-10-0-136-113 kubenswrapper[2584]: I0727 20:24:10.673826 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-c9sj9_3a0328b5-c52a-438e-a301-6c23bbac4a90/kube-rbac-proxy/0.log"