Jul 29 18:32:07.219298 ip-10-0-141-242 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 18:32:07.219309 ip-10-0-141-242 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 18:32:07.219317 ip-10-0-141-242 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 18:32:07.219536 ip-10-0-141-242 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 18:32:17.314839 ip-10-0-141-242 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 18:32:17.314854 ip-10-0-141-242 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6d195f0cdc96480b9a8691cd4f321ee1 -- Jul 29 18:34:13.205593 ip-10-0-141-242 systemd[1]: Starting Kubernetes Kubelet... Jul 29 18:34:13.642681 ip-10-0-141-242 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:13.642681 ip-10-0-141-242 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 18:34:13.642681 ip-10-0-141-242 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:13.642681 ip-10-0-141-242 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 18:34:13.642681 ip-10-0-141-242 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 18:34:13.644993 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.644883 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 18:34:13.649360 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649336 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:13.649360 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649357 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:13.649360 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649363 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649382 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649388 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649392 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649396 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649400 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649409 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649415 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649420 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649424 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649429 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649434 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649438 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649442 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649446 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649450 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649454 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649459 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649463 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649468 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:13.649596 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649472 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649476 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649480 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649485 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649489 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649497 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649504 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649512 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649517 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649523 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649527 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649532 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649537 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649541 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649546 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649551 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649557 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649563 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649568 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649573 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:13.650495 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649577 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649582 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649587 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649591 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649595 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649602 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649606 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649610 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649615 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649620 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649625 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649630 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649634 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649639 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649646 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649653 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649659 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649663 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649670 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649675 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:13.651422 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649680 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649684 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649689 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649693 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649698 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649703 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649708 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649712 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649717 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649723 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649728 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649733 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649737 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649741 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649746 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649750 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649755 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649759 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649764 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649769 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:13.652320 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649773 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649778 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649783 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649787 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649793 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649797 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649802 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649807 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649811 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649817 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649823 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649827 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649832 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649837 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649841 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649846 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.649850 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651149 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651159 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651164 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:13.653288 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651170 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651174 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651180 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651185 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651192 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651199 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651207 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651213 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651218 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651223 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651228 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651233 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651237 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651242 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651247 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651252 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651256 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651261 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651265 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:13.654228 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651270 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651275 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651282 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651287 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651292 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651296 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651301 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651306 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651310 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651314 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651318 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651323 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651328 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651333 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651337 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651341 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651347 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651351 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651355 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651360 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:13.654860 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651364 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651391 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651396 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651401 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651406 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651410 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651415 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651419 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651423 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651427 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651431 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651435 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651440 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651444 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651450 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651457 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651463 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651469 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651474 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:13.655426 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651479 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651483 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651487 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651492 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651497 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651501 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651506 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651511 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651515 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651520 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651526 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651530 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651535 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651539 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651544 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651548 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651553 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651557 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651562 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651566 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:13.655966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651570 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651575 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651581 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651585 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651590 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651594 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651599 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651604 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651613 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651618 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651622 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651627 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651633 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651637 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651641 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651646 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651650 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.651655 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652325 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652333 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:13.656544 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652338 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652342 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652348 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652353 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652358 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652362 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652385 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652391 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652395 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652401 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652406 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652411 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652416 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652420 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652425 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652429 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652433 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652438 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652443 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652448 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:13.657119 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652455 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652460 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652464 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652469 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652474 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652478 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652483 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652487 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652492 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652496 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652501 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652506 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652510 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652516 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652520 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652525 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652539 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652544 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652550 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652555 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:13.657773 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652559 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652564 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652568 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652573 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652577 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652582 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652586 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652591 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652595 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652601 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652606 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652610 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652617 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652621 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652627 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652631 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652636 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652641 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652645 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:13.658383 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652650 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652654 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652659 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652664 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652668 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652675 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652681 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652688 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652693 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652698 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652703 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652707 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652711 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652716 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652723 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652730 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652735 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652740 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652746 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:13.658966 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652751 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652756 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652760 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652764 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652771 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652776 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652782 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652787 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652791 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652798 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652804 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652810 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652815 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652820 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652825 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652829 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652834 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652839 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.652843 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.652960 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 18:34:13.659512 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.652978 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.652989 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653000 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653008 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653014 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653021 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653029 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653035 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653041 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653047 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653053 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653058 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653063 2573 flags.go:64] FLAG: --cgroup-root="" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653068 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653075 2573 flags.go:64] FLAG: --client-ca-file="" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653081 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653086 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653094 2573 flags.go:64] FLAG: --cluster-domain="" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653101 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653107 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653112 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653118 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653125 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 18:34:13.660046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653130 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653136 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653141 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653147 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653152 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653157 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653163 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653169 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653175 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653181 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653186 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653191 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653197 2573 flags.go:64] FLAG: --enable-server="true" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653202 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653210 2573 flags.go:64] FLAG: --event-burst="100" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653216 2573 flags.go:64] FLAG: --event-qps="50" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653221 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653226 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653232 2573 flags.go:64] FLAG: --eviction-hard="" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653238 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653243 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653249 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653254 2573 flags.go:64] FLAG: --eviction-soft="" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653260 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653265 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 18:34:13.660690 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653270 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653276 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653283 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653288 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653293 2573 flags.go:64] FLAG: --feature-gates="" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653299 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653304 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653309 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653315 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653320 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653326 2573 flags.go:64] FLAG: --help="false" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653331 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-242.ec2.internal" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653337 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653342 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653349 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653355 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653361 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653383 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653389 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653394 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653399 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653406 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653411 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653417 2573 flags.go:64] FLAG: --kube-reserved="" Jul 29 18:34:13.661416 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653422 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653427 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653432 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653438 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653444 2573 flags.go:64] FLAG: --lock-file="" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653449 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653454 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653460 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653469 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653474 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653480 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653485 2573 flags.go:64] FLAG: --logging-format="text" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653490 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653496 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653501 2573 flags.go:64] FLAG: --manifest-url="" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653507 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653514 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653519 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653527 2573 flags.go:64] FLAG: --max-pods="110" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653532 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653539 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653544 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653551 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653556 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653562 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 18:34:13.662070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653567 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653588 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653593 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653598 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653603 2573 flags.go:64] FLAG: --pod-cidr="" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653610 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653620 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653626 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653631 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653643 2573 flags.go:64] FLAG: --port="10250" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653649 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653654 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0225d8908e4abd105" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653660 2573 flags.go:64] FLAG: --qos-reserved="" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653665 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653670 2573 flags.go:64] FLAG: --register-node="true" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653676 2573 flags.go:64] FLAG: --register-with-taints="" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653689 2573 flags.go:64] FLAG: --registry-burst="10" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653694 2573 flags.go:64] FLAG: --registry-qps="5" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653699 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653705 2573 flags.go:64] FLAG: --reserved-memory="" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653711 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653717 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653723 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653728 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653733 2573 flags.go:64] FLAG: --runonce="false" Jul 29 18:34:13.662780 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653739 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653744 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653749 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653755 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653762 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653768 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653773 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653779 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653784 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653789 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653794 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653800 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653805 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653812 2573 flags.go:64] FLAG: --system-cgroups="" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653817 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653827 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653833 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653838 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653845 2573 flags.go:64] FLAG: --tls-min-version="" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653850 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653855 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653860 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653866 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653871 2573 flags.go:64] FLAG: --v="2" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653878 2573 flags.go:64] FLAG: --version="false" Jul 29 18:34:13.663509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653885 2573 flags.go:64] FLAG: --vmodule="" Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653891 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.653897 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654092 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654098 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654104 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654108 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654113 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654118 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654122 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654127 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654133 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654138 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654142 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654147 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654152 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654157 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654161 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654166 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654171 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:13.664157 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654175 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654180 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654185 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654190 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654195 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654202 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654208 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654213 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654218 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654222 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654226 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654231 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654235 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654240 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654244 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654248 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654253 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654257 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654262 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:13.664777 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654267 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654272 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654277 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654282 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654290 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654294 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654299 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654303 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654308 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654312 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654317 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654321 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654326 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654330 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654335 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654371 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654377 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654384 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654390 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654394 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:13.665307 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654400 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654404 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654409 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654413 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654418 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654423 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654428 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654432 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654437 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654463 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654483 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654488 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654493 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654497 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654500 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654503 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654507 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654510 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654513 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:13.665901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654518 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654522 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654526 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654529 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654533 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654536 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654539 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654542 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654545 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654550 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654555 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654558 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654561 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654564 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654567 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654570 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654573 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654576 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654579 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:13.666425 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654582 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654585 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654588 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654591 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.654600 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.655136 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.663334 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.663351 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.664264 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.664277 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664353 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664360 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664363 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664366 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664372 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:13.666936 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664377 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664381 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664385 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664389 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664397 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664401 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664404 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664407 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664410 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664413 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664417 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664420 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664423 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664426 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664430 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664433 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664435 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664438 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664441 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664444 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:13.667349 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664447 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664450 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664453 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664455 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664459 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664463 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664466 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664468 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664471 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664474 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664478 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664481 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664483 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664486 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664489 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664492 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664494 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664497 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664500 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664503 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:13.667889 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664505 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664508 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664511 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664514 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664517 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664520 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664523 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664525 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664528 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664531 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664534 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664538 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664542 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664545 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664548 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664551 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664554 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664557 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664560 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:13.668504 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664562 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664565 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664568 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664571 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664574 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664576 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664579 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664583 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664587 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664591 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664594 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664597 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664600 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664603 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664606 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664609 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664612 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664615 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664618 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:13.668996 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664621 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664624 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664627 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664629 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664632 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664634 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664637 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664641 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664645 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664648 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664651 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664654 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664658 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664661 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664664 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:13.669545 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664667 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.664673 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664805 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664813 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664817 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664820 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664823 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664826 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664829 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664832 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664835 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664837 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664840 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664843 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 18:34:13.669947 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664846 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664848 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664852 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664855 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664857 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664860 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664863 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664866 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664868 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664871 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664874 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664877 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664879 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664882 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664885 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664888 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664891 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664894 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664897 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664899 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 18:34:13.670334 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664902 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664905 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664907 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664911 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664913 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664916 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664918 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664921 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664924 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664926 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664929 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664934 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664938 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664941 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664944 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664947 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664949 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664952 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664955 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664957 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 18:34:13.670882 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664960 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664963 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664965 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664968 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664971 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664974 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664977 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664980 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664983 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664985 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664988 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664991 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664994 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664996 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.664999 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665002 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665004 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665007 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665009 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665012 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 18:34:13.671430 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665015 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665018 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665020 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665023 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665026 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665028 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665031 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665034 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665037 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665039 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665043 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665045 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665048 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665051 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665053 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665056 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665059 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665062 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665065 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665067 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 18:34:13.671958 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665070 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665072 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665075 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665078 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665080 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665085 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:13.665088 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.665093 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.665214 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.669165 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.670503 2573 server.go:1019] "Starting client certificate rotation" Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.670614 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 18:34:13.672525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.670648 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 18:34:13.674663 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.674490 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 18:34:13.676240 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.676221 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 18:34:13.683452 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.683427 2573 log.go:25] "Validated CRI v1 runtime API" Jul 29 18:34:13.685433 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.685416 2573 log.go:25] "Validated CRI v1 image API" Jul 29 18:34:13.686939 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.686924 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 18:34:13.691704 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.691684 2573 fs.go:135] Filesystem UUIDs: map[0cdf403f-e196-46c3-9a50-0dca771a4742:/dev/nvme0n1p3 3fe50104-2194-488e-a26d-5709efce36e3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 29 18:34:13.691772 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.691704 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 18:34:13.697346 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.697230 2573 manager.go:216] Machine: {Timestamp:2026-07-29 18:34:13.695776231 +0000 UTC m=+0.362993425 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101456 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24262a50e125fd4ff9f40cbcb05d49 SystemUUID:ec24262a-50e1-25fd-4ff9-f40cbcb05d49 BootID:6d195f0c-dc96-480b-9a86-91cd4f321ee1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:55:f3:aa:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:55:f3:aa:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:22:bc:61:48:fa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 18:34:13.697346 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.697339 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 18:34:13.697485 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.697449 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 18:34:13.699700 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.699674 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 18:34:13.699851 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.699705 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-242.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 18:34:13.700481 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.700470 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 18:34:13.700520 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.700483 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 18:34:13.700520 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.700492 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 18:34:13.701925 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.701913 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 18:34:13.703320 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.703309 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 18:34:13.704196 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.704181 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 18:34:13.706689 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706676 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 29 18:34:13.706834 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706823 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 18:34:13.706874 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706856 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 29 18:34:13.706874 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706867 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 18:34:13.706933 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706885 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 18:34:13.706933 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706897 2573 kubelet.go:398] "Adding apiserver pod source" Jul 29 18:34:13.706933 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.706906 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 18:34:13.707288 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.707275 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 18:34:13.707361 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.707293 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 18:34:13.714979 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.714957 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 18:34:13.716813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.716796 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 18:34:13.716881 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.716829 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 18:34:13.718434 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718420 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 18:34:13.718477 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718444 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 18:34:13.718477 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718456 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 18:34:13.718477 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718466 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718483 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718493 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718505 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718515 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718527 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718536 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718550 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.718559 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 18:34:13.718593 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.718579 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 18:34:13.718859 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.718657 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 18:34:13.719565 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.719554 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 18:34:13.719597 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.719566 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 18:34:13.723200 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.723185 2573 server.go:1268] "Started kubelet" Jul 29 18:34:13.723344 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.723282 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 18:34:13.723446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.723318 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 18:34:13.723446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.723398 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 18:34:13.724287 ip-10-0-141-242 systemd[1]: Started Kubernetes Kubelet. Jul 29 18:34:13.725025 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.725008 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 18:34:13.725660 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.725643 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 29 18:34:13.729701 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.729684 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 18:34:13.732419 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.732401 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 18:34:13.732513 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.732468 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 18:34:13.732584 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.732518 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:13.733006 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.732988 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 18:34:13.733092 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733081 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 18:34:13.733150 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733096 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 18:34:13.733272 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733260 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 29 18:34:13.733348 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733273 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 29 18:34:13.733656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733630 2573 factory.go:55] Registering systemd factory Jul 29 18:34:13.733656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733648 2573 factory.go:223] Registration of the systemd container factory successfully Jul 29 18:34:13.733960 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.733941 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-242.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 18:34:13.734167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734133 2573 factory.go:153] Registering CRI-O factory Jul 29 18:34:13.734167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734153 2573 factory.go:223] Registration of the crio container factory successfully Jul 29 18:34:13.734331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734176 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qgnx2" Jul 29 18:34:13.734331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734204 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 18:34:13.734331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734224 2573 factory.go:103] Registering Raw factory Jul 29 18:34:13.734331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734240 2573 manager.go:1196] Started watching for new ooms in manager Jul 29 18:34:13.734930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.734911 2573 manager.go:349] Starting recovery of all containers Jul 29 18:34:13.735159 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.733961 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-242.ec2.internal.18c6d66a27e4991d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-242.ec2.internal,UID:ip-10-0-141-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-242.ec2.internal,},FirstTimestamp:2026-07-29 18:34:13.723150621 +0000 UTC m=+0.390367815,LastTimestamp:2026-07-29 18:34:13.723150621 +0000 UTC m=+0.390367815,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-242.ec2.internal,}" Jul 29 18:34:13.735680 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.735659 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-242.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 18:34:13.735812 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.735792 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 18:34:13.744735 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.744704 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qgnx2" Jul 29 18:34:13.749123 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.748130 2573 manager.go:354] Recovery completed Jul 29 18:34:13.753832 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.753817 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:13.755931 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.755906 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:13.756008 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.755950 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:13.756008 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.755969 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:13.756595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.756580 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 18:34:13.756595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.756594 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 18:34:13.756728 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.756609 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:13.756728 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.756613 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 29 18:34:13.757361 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.757333 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:13.757361 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.757361 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:13.757458 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.757408 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:13.758241 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.758165 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-242.ec2.internal.18c6d66a29d8beea default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-242.ec2.internal,UID:ip-10-0-141-242.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-242.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-242.ec2.internal,},FirstTimestamp:2026-07-29 18:34:13.755928298 +0000 UTC m=+0.423145496,LastTimestamp:2026-07-29 18:34:13.755928298 +0000 UTC m=+0.423145496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-242.ec2.internal,}" Jul 29 18:34:13.759234 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.759222 2573 policy_none.go:49] "None policy: Start" Jul 29 18:34:13.759296 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.759244 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 18:34:13.759296 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.759255 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 18:34:13.761398 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.761386 2573 policy_none.go:47] "Start" Jul 29 18:34:13.797693 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.797675 2573 manager.go:337] "Starting Device Plugin manager" Jul 29 18:34:13.797805 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.797711 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 18:34:13.797805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.797722 2573 server.go:87] "Starting device plugin registration server" Jul 29 18:34:13.798011 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.797998 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 18:34:13.798068 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.798018 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 18:34:13.798144 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.798119 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 18:34:13.798261 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.798220 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 18:34:13.798261 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.798234 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 18:34:13.798699 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.798679 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 18:34:13.798776 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.798738 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:13.901152 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.901074 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:13.903529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.902102 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:13.903529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.902132 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:13.903529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.902142 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:13.903529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.902169 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-242.ec2.internal" Jul 29 18:34:13.911685 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.911664 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-242.ec2.internal" Jul 29 18:34:13.911792 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.911697 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-242.ec2.internal\": node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:13.928274 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.928247 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:13.950003 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.949969 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 18:34:13.951195 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.951177 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 18:34:13.951322 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.951219 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 18:34:13.951322 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.951242 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 18:34:13.951322 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:13.951281 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 18:34:13.953744 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:13.953718 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:14.030499 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.030457 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.052510 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.052480 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal"] Jul 29 18:34:14.052607 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.052559 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:14.053585 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.053566 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:14.053673 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.053598 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:14.053673 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.053610 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:14.056064 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056048 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:14.056185 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.056230 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056200 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:14.056807 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056791 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:14.056889 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056818 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:14.056889 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056831 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:14.056889 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056792 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:14.056889 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056890 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:14.057041 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.056902 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:14.059243 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.059225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.059294 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.059263 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 18:34:14.059996 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.059972 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientMemory" Jul 29 18:34:14.060097 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.060008 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 18:34:14.060097 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.060019 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeHasSufficientPID" Jul 29 18:34:14.082058 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.082038 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-242.ec2.internal\" not found" node="ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.086687 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.086670 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-242.ec2.internal\" not found" node="ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.130664 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.130636 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.135394 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.135378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31b38f294896cd956b89e12c4f24f06c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal\" (UID: \"31b38f294896cd956b89e12c4f24f06c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.135453 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.135403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31b38f294896cd956b89e12c4f24f06c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal\" (UID: \"31b38f294896cd956b89e12c4f24f06c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.135453 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.135424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ec71785db9a4db774a1e97c3d7af1b6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-242.ec2.internal\" (UID: \"2ec71785db9a4db774a1e97c3d7af1b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.231482 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.231400 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.236111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.236093 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31b38f294896cd956b89e12c4f24f06c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal\" (UID: \"31b38f294896cd956b89e12c4f24f06c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.236175 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.236122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31b38f294896cd956b89e12c4f24f06c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal\" (UID: \"31b38f294896cd956b89e12c4f24f06c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.236175 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.236140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ec71785db9a4db774a1e97c3d7af1b6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-242.ec2.internal\" (UID: \"2ec71785db9a4db774a1e97c3d7af1b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.236254 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.236188 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31b38f294896cd956b89e12c4f24f06c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal\" (UID: \"31b38f294896cd956b89e12c4f24f06c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.236254 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.236197 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/31b38f294896cd956b89e12c4f24f06c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal\" (UID: \"31b38f294896cd956b89e12c4f24f06c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.236254 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.236234 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2ec71785db9a4db774a1e97c3d7af1b6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-242.ec2.internal\" (UID: \"2ec71785db9a4db774a1e97c3d7af1b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.334475 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.334428 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.385156 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.385130 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.390194 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.390134 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" Jul 29 18:34:14.435148 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.435110 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.540434 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.540333 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.640923 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.640881 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.670939 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.670908 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 18:34:14.671561 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.671090 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 18:34:14.741984 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.741952 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.751894 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.751859 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 18:29:14 +0000 UTC" deadline="2028-02-21 12:37:43.962222263 +0000 UTC" Jul 29 18:34:14.751894 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.751892 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13722h3m29.210334174s" Jul 29 18:34:14.842389 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.842303 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:14.869787 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:14.869755 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:14.942529 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:14.942499 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:15.043469 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.043433 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:15.068618 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:15.068565 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b38f294896cd956b89e12c4f24f06c.slice/crio-9cfcefe633faf6c3e57ab7619a9cacc03c435f1a3ad4ba9066fc0f7ca7903bdf WatchSource:0}: Error finding container 9cfcefe633faf6c3e57ab7619a9cacc03c435f1a3ad4ba9066fc0f7ca7903bdf: Status 404 returned error can't find the container with id 9cfcefe633faf6c3e57ab7619a9cacc03c435f1a3ad4ba9066fc0f7ca7903bdf Jul 29 18:34:15.069048 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:15.069021 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec71785db9a4db774a1e97c3d7af1b6.slice/crio-73d0069e82eb45bb4add09aaecb7981d291e72fcacbda1dc763cd99f1501d23c WatchSource:0}: Error finding container 73d0069e82eb45bb4add09aaecb7981d291e72fcacbda1dc763cd99f1501d23c: Status 404 returned error can't find the container with id 73d0069e82eb45bb4add09aaecb7981d291e72fcacbda1dc763cd99f1501d23c Jul 29 18:34:15.074417 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.074363 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:34:15.080934 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.080912 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:15.143695 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.143662 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-242.ec2.internal\" not found" Jul 29 18:34:15.144721 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.144703 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:15.233889 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.233860 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" Jul 29 18:34:15.246327 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.246287 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 18:34:15.247560 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.247546 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" Jul 29 18:34:15.256860 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.256842 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 18:34:15.709240 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.709202 2573 apiserver.go:52] "Watching apiserver" Jul 29 18:34:15.721727 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.720720 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 18:34:15.721727 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.721285 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw","openshift-cluster-node-tuning-operator/tuned-tv8qt","openshift-image-registry/node-ca-f5rvc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal","openshift-network-diagnostics/network-check-target-8fwzd","openshift-network-operator/iptables-alerter-2cv44","kube-system/global-pull-secret-syncer-dg5zm","kube-system/konnectivity-agent-ktcr6","openshift-dns/node-resolver-nrk9h","openshift-multus/multus-5tblx","openshift-multus/multus-additional-cni-plugins-qxr9f","openshift-multus/network-metrics-daemon-x6szn","openshift-ovn-kubernetes/ovnkube-node-krwk9"] Jul 29 18:34:15.733383 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.732950 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.735475 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.734697 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 18:34:15.740387 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.736854 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.740387 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.737112 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.740387 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.737282 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 18:34:15.740387 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.737559 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vzfjv\"" Jul 29 18:34:15.740387 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.740063 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.743397 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.743182 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 18:34:15.744396 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.743737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h4kjn\"" Jul 29 18:34:15.744396 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.743940 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 18:34:15.744396 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.744178 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.744696 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745259 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745693 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-iptables-alerter-script\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqv87\" (UniqueName: \"kubernetes.io/projected/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-kube-api-access-vqv87\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-os-release\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-netns\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-kubelet\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-system-cni-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66003789-6ffd-45cf-b5bc-3a89c7e36f56-cni-binary-copy\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745899 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-cni-multus\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745926 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-conf-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-etc-kubernetes\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.745990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-host-slash\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-cnibin\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746049 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-k8s-cni-cncf-io\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-hostroot\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746103 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-daemon-config\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.748785 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-multus-certs\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.749950 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-cni-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.749950 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-socket-dir-parent\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.749950 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-cni-bin\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.749950 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.746228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7fn2\" (UniqueName: \"kubernetes.io/projected/66003789-6ffd-45cf-b5bc-3a89c7e36f56-kube-api-access-j7fn2\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.751252 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.750738 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.751252 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.750785 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qkxfm\"" Jul 29 18:34:15.751252 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.750999 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 18:34:15.751252 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.751067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.752839 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.752506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.754712 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.754687 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.755432 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.755415 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.755610 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.755593 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9q5zb\"" Jul 29 18:34:15.755734 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.755716 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 18:34:15.755911 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.755815 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.758892 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.757428 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.758892 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.757806 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 18:34:15.758892 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.758075 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 18:34:15.758892 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.758473 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.758892 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.758732 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 18:34:15.760054 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.759418 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:15.760054 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.759479 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:15.760371 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.760104 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 18:34:15.760371 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.760336 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tzz9g\"" Jul 29 18:34:15.762028 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.762007 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.765148 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.764717 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 18:34:15.765148 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.764830 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:15.765148 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.764895 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:15.765148 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.764932 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 18:34:15.765445 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.765167 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7976d\"" Jul 29 18:34:15.767626 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.767458 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.770070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.770044 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.770727 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.770708 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.772789 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.772302 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7zlkp\"" Jul 29 18:34:15.772789 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.772428 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 18:34:15.772789 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.772433 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.776289 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.775999 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lnsqz\"" Jul 29 18:34:15.776411 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.776352 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 18:34:15.776525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.776506 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.776659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.776639 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 18:34:15.777330 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.777312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.777447 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.777395 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:15.781022 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.781002 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 18:34:15.784082 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.784063 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5lz88" Jul 29 18:34:15.784181 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.784126 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m5s47\"" Jul 29 18:34:15.784547 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.784528 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 18:34:15.809058 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.809034 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5lz88" Jul 29 18:34:15.835145 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.835119 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 18:34:15.846954 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.846920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4jtm\" (UniqueName: \"kubernetes.io/projected/ab8983ec-0b07-47a9-a532-9b40d67012d7-kube-api-access-d4jtm\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.847107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.846966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-kubelet\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.846991 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-cni-bin\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847012 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1d0114-c267-4858-843e-af59fea83565-tmp-dir\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.847107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847041 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-os-release\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-kubelet\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-var-lib-kubelet\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f718b183-f469-4358-ac39-57cec88134b6-host\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63429306-cfe7-4a9f-8d2d-ac253dd01537-agent-certs\") pod \"konnectivity-agent-ktcr6\" (UID: \"63429306-cfe7-4a9f-8d2d-ac253dd01537\") " pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847218 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-registration-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-cni-multus\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847277 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-modprobe-d\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847302 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847329 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sskk\" (UniqueName: \"kubernetes.io/projected/51e194f0-e997-490a-b028-1cf62de7c601-kube-api-access-8sskk\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847373 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw56d\" (UniqueName: \"kubernetes.io/projected/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-kube-api-access-tw56d\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.847448 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-host-slash\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847455 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-run-netns\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-ovn\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847528 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-ovnkube-script-lib\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-cni-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-cni-bin\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847660 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-lib-modules\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsj4t\" (UniqueName: \"kubernetes.io/projected/be1d0114-c267-4858-843e-af59fea83565-kube-api-access-qsj4t\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-run\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-host\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847763 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51e194f0-e997-490a-b028-1cf62de7c601-ovn-node-metrics-cert\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847791 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-system-cni-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847825 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66003789-6ffd-45cf-b5bc-3a89c7e36f56-cni-binary-copy\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-conf-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.847988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-etc-kubernetes\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847911 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62plg\" (UniqueName: \"kubernetes.io/projected/c2af70ba-db52-4c87-a95d-bc790ee6946d-kube-api-access-62plg\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847937 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-run-ovn-kubernetes\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847965 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-sys-fs\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.847991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-cnibin\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-k8s-cni-cncf-io\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848043 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-hostroot\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848068 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-daemon-config\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-multus-certs\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-os-release\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-kubernetes\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848174 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-systemd\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysconfig\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848389 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-cni-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848451 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-host-slash\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848485 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-os-release\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848512 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-cni-multus\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.848805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848541 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-kubelet\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848551 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-etc-kubernetes\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848589 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-hostroot\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848625 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-conf-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848867 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-var-lib-cni-bin\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848891 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2af70ba-db52-4c87-a95d-bc790ee6946d-tmp\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848904 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-k8s-cni-cncf-io\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-systemd\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848939 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-cnibin\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848955 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-multus-certs\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.848955 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-system-cni-dir\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-ovnkube-config\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63429306-cfe7-4a9f-8d2d-ac253dd01537-konnectivity-ca\") pod \"konnectivity-agent-ktcr6\" (UID: \"63429306-cfe7-4a9f-8d2d-ac253dd01537\") " pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-socket-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-device-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849164 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66003789-6ffd-45cf-b5bc-3a89c7e36f56-cni-binary-copy\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.849769 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849189 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-iptables-alerter-script\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqv87\" (UniqueName: \"kubernetes.io/projected/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-kube-api-access-vqv87\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysctl-d\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849387 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-daemon-config\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-sys\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849472 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-tuned\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849558 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-cnibin\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m6vh\" (UniqueName: \"kubernetes.io/projected/f718b183-f469-4358-ac39-57cec88134b6-kube-api-access-4m6vh\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849713 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-iptables-alerter-script\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849720 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-slash\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp6cm\" (UniqueName: \"kubernetes.io/projected/224a45b3-ef7f-4a80-877f-8c41a61be9a2-kube-api-access-lp6cm\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-netns\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysctl-conf\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849857 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-etc-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849882 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-env-overrides\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.850656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849896 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-host-run-netns\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849904 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.849977 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9618fed2-7fe7-451f-bf88-b9df3edac5ea-kubelet-config\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850010 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9618fed2-7fe7-451f-bf88-b9df3edac5ea-dbus\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850035 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f718b183-f469-4358-ac39-57cec88134b6-serviceca\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850059 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-systemd-units\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850082 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-cni-netd\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be1d0114-c267-4858-843e-af59fea83565-hosts-file\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-system-cni-dir\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-var-lib-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-node-log\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-log-socket\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-socket-dir-parent\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7fn2\" (UniqueName: \"kubernetes.io/projected/66003789-6ffd-45cf-b5bc-3a89c7e36f56-kube-api-access-j7fn2\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.851599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.850352 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/66003789-6ffd-45cf-b5bc-3a89c7e36f56-multus-socket-dir-parent\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.864789 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.864421 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 18:34:15.869107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.868982 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqv87\" (UniqueName: \"kubernetes.io/projected/871ed1e1-d27f-4ab5-accd-d01be9f73ffc-kube-api-access-vqv87\") pod \"iptables-alerter-2cv44\" (UID: \"871ed1e1-d27f-4ab5-accd-d01be9f73ffc\") " pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:15.869107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.869058 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7fn2\" (UniqueName: \"kubernetes.io/projected/66003789-6ffd-45cf-b5bc-3a89c7e36f56-kube-api-access-j7fn2\") pod \"multus-5tblx\" (UID: \"66003789-6ffd-45cf-b5bc-3a89c7e36f56\") " pod="openshift-multus/multus-5tblx" Jul 29 18:34:15.950798 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62plg\" (UniqueName: \"kubernetes.io/projected/c2af70ba-db52-4c87-a95d-bc790ee6946d-kube-api-access-62plg\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-run-ovn-kubernetes\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-sys-fs\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-os-release\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-kubernetes\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950915 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-systemd\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysconfig\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950962 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2af70ba-db52-4c87-a95d-bc790ee6946d-tmp\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.950998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.950985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-systemd\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951062 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-os-release\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-ovnkube-config\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63429306-cfe7-4a9f-8d2d-ac253dd01537-konnectivity-ca\") pod \"konnectivity-agent-ktcr6\" (UID: \"63429306-cfe7-4a9f-8d2d-ac253dd01537\") " pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951130 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-socket-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951146 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-device-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysctl-d\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951184 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-sys\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951200 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-tuned\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951259 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-cnibin\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m6vh\" (UniqueName: \"kubernetes.io/projected/f718b183-f469-4358-ac39-57cec88134b6-kube-api-access-4m6vh\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-slash\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp6cm\" (UniqueName: \"kubernetes.io/projected/224a45b3-ef7f-4a80-877f-8c41a61be9a2-kube-api-access-lp6cm\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysctl-conf\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.951446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-etc-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-env-overrides\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951467 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951529 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-run-ovn-kubernetes\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951574 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-sys\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951587 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-systemd\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951598 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-systemd\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.951695 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951740 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-ovnkube-config\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.951787 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:34:16.45174271 +0000 UTC m=+3.118959912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951845 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.951845 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-cnibin\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952084 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-etc-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952095 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-socket-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952149 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-slash\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.952196 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:15.952316 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.952249 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:16.452232542 +0000 UTC m=+3.119449747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952298 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysctl-d\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952347 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952379 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63429306-cfe7-4a9f-8d2d-ac253dd01537-konnectivity-ca\") pod \"konnectivity-agent-ktcr6\" (UID: \"63429306-cfe7-4a9f-8d2d-ac253dd01537\") " pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952417 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysconfig\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952460 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-sys-fs\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952612 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-sysctl-conf\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952691 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-device-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952758 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-kubernetes\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9618fed2-7fe7-451f-bf88-b9df3edac5ea-kubelet-config\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9618fed2-7fe7-451f-bf88-b9df3edac5ea-dbus\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f718b183-f469-4358-ac39-57cec88134b6-serviceca\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952854 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-env-overrides\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952884 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-systemd-units\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-cni-netd\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.952978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be1d0114-c267-4858-843e-af59fea83565-hosts-file\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-system-cni-dir\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.953204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953019 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9618fed2-7fe7-451f-bf88-b9df3edac5ea-dbus\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-var-lib-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953056 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-systemd-units\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953074 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-node-log\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953087 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be1d0114-c267-4858-843e-af59fea83565-hosts-file\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953104 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-log-socket\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953135 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-cni-netd\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4jtm\" (UniqueName: \"kubernetes.io/projected/ab8983ec-0b07-47a9-a532-9b40d67012d7-kube-api-access-d4jtm\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953187 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-var-lib-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953207 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-kubelet\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-cni-bin\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953196 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9618fed2-7fe7-451f-bf88-b9df3edac5ea-kubelet-config\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953265 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1d0114-c267-4858-843e-af59fea83565-tmp-dir\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953325 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-var-lib-kubelet\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953352 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f718b183-f469-4358-ac39-57cec88134b6-host\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953380 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-cni-bin\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954094 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63429306-cfe7-4a9f-8d2d-ac253dd01537-agent-certs\") pod \"konnectivity-agent-ktcr6\" (UID: \"63429306-cfe7-4a9f-8d2d-ac253dd01537\") " pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953457 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-kubelet\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953472 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-registration-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953523 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-modprobe-d\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953539 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-log-socket\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953550 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-var-lib-kubelet\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953235 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-system-cni-dir\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953569 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f718b183-f469-4358-ac39-57cec88134b6-serviceca\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953592 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f718b183-f469-4358-ac39-57cec88134b6-host\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sskk\" (UniqueName: \"kubernetes.io/projected/51e194f0-e997-490a-b028-1cf62de7c601-kube-api-access-8sskk\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953621 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-registration-dir\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953671 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-node-log\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953690 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw56d\" (UniqueName: \"kubernetes.io/projected/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-kube-api-access-tw56d\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-run-netns\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.954975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-ovn\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-ovnkube-script-lib\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-lib-modules\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.953970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsj4t\" (UniqueName: \"kubernetes.io/projected/be1d0114-c267-4858-843e-af59fea83565-kube-api-access-qsj4t\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.954015 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-run\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.954114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-host\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.954170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51e194f0-e997-490a-b028-1cf62de7c601-ovn-node-metrics-cert\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.954654 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-lib-modules\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.954899 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51e194f0-e997-490a-b028-1cf62de7c601-ovnkube-script-lib\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955012 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-etc-selinux\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955192 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-cni-binary-copy\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955253 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-ovn\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955288 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-host-run-netns\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955313 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1d0114-c267-4858-843e-af59fea83565-tmp-dir\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955459 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-modprobe-d\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.955836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955469 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab8983ec-0b07-47a9-a532-9b40d67012d7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.956679 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955510 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51e194f0-e997-490a-b028-1cf62de7c601-run-openvswitch\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.956679 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955568 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-run\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.956679 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955966 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2af70ba-db52-4c87-a95d-bc790ee6946d-tmp\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.956679 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.955964 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.956679 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.956033 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2af70ba-db52-4c87-a95d-bc790ee6946d-host\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.956679 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.956529 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab8983ec-0b07-47a9-a532-9b40d67012d7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.959218 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.959189 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c2af70ba-db52-4c87-a95d-bc790ee6946d-etc-tuned\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.959996 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.959936 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:15.959996 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.959976 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:15.960137 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.959991 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:15.960137 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:15.960091 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:16.460054144 +0000 UTC m=+3.127271337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:15.960895 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.960819 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" event={"ID":"31b38f294896cd956b89e12c4f24f06c","Type":"ContainerStarted","Data":"9cfcefe633faf6c3e57ab7619a9cacc03c435f1a3ad4ba9066fc0f7ca7903bdf"} Jul 29 18:34:15.962156 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.961865 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51e194f0-e997-490a-b028-1cf62de7c601-ovn-node-metrics-cert\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.963295 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.963246 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63429306-cfe7-4a9f-8d2d-ac253dd01537-agent-certs\") pod \"konnectivity-agent-ktcr6\" (UID: \"63429306-cfe7-4a9f-8d2d-ac253dd01537\") " pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:15.964873 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.964849 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m6vh\" (UniqueName: \"kubernetes.io/projected/f718b183-f469-4358-ac39-57cec88134b6-kube-api-access-4m6vh\") pod \"node-ca-f5rvc\" (UID: \"f718b183-f469-4358-ac39-57cec88134b6\") " pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:15.966096 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.966067 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4jtm\" (UniqueName: \"kubernetes.io/projected/ab8983ec-0b07-47a9-a532-9b40d67012d7-kube-api-access-d4jtm\") pod \"multus-additional-cni-plugins-qxr9f\" (UID: \"ab8983ec-0b07-47a9-a532-9b40d67012d7\") " pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:15.966592 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.966545 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" event={"ID":"2ec71785db9a4db774a1e97c3d7af1b6","Type":"ContainerStarted","Data":"73d0069e82eb45bb4add09aaecb7981d291e72fcacbda1dc763cd99f1501d23c"} Jul 29 18:34:15.968200 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.968171 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw56d\" (UniqueName: \"kubernetes.io/projected/3ec6c7f6-047e-491f-bf07-82ebd7d63ed2-kube-api-access-tw56d\") pod \"aws-ebs-csi-driver-node-j7vlw\" (UID: \"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:15.968458 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.968436 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62plg\" (UniqueName: \"kubernetes.io/projected/c2af70ba-db52-4c87-a95d-bc790ee6946d-kube-api-access-62plg\") pod \"tuned-tv8qt\" (UID: \"c2af70ba-db52-4c87-a95d-bc790ee6946d\") " pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:15.969478 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.969455 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsj4t\" (UniqueName: \"kubernetes.io/projected/be1d0114-c267-4858-843e-af59fea83565-kube-api-access-qsj4t\") pod \"node-resolver-nrk9h\" (UID: \"be1d0114-c267-4858-843e-af59fea83565\") " pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:15.969943 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.969904 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sskk\" (UniqueName: \"kubernetes.io/projected/51e194f0-e997-490a-b028-1cf62de7c601-kube-api-access-8sskk\") pod \"ovnkube-node-krwk9\" (UID: \"51e194f0-e997-490a-b028-1cf62de7c601\") " pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:15.970626 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:15.970599 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp6cm\" (UniqueName: \"kubernetes.io/projected/224a45b3-ef7f-4a80-877f-8c41a61be9a2-kube-api-access-lp6cm\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:16.056830 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.056789 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2cv44" Jul 29 18:34:16.065623 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.065596 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5tblx" Jul 29 18:34:16.081583 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.081554 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" Jul 29 18:34:16.082620 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.082584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f5rvc" Jul 29 18:34:16.092140 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.092120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:16.097098 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.097073 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 18:34:16.100580 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.100558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:16.110598 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.110573 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" Jul 29 18:34:16.118470 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.118449 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nrk9h" Jul 29 18:34:16.126172 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.126152 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" Jul 29 18:34:16.458209 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.458163 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:16.458439 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.458237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:16.458439 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.458369 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:16.458439 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.458398 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:16.458609 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.458446 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:34:17.458425754 +0000 UTC m=+4.125642934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:16.458609 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.458469 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:17.458459474 +0000 UTC m=+4.125676658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:16.558611 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.558567 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:16.558807 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.558774 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:16.558807 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.558802 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:16.558916 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.558816 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:16.558916 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.558878 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:17.558860548 +0000 UTC m=+4.226077728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:16.812430 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.812324 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:29:16 +0000 UTC" deadline="2028-01-08 07:45:14.257375693 +0000 UTC" Jul 29 18:34:16.812430 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.812364 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12661h10m57.445015423s" Jul 29 18:34:16.951567 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.951525 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:16.951728 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.951530 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:16.951728 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.951683 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:16.951856 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:16.951525 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:16.951856 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.951745 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:16.951957 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:16.951857 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:17.076891 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:17.076850 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod871ed1e1_d27f_4ab5_accd_d01be9f73ffc.slice/crio-5c491acaf2ad291d8b37fff0c74c05ca35d35fe541c5bf0e73cd94991eb461ce WatchSource:0}: Error finding container 5c491acaf2ad291d8b37fff0c74c05ca35d35fe541c5bf0e73cd94991eb461ce: Status 404 returned error can't find the container with id 5c491acaf2ad291d8b37fff0c74c05ca35d35fe541c5bf0e73cd94991eb461ce Jul 29 18:34:17.082246 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:17.082217 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2af70ba_db52_4c87_a95d_bc790ee6946d.slice/crio-374170e088f29b0d2d20b6017e52803e312ecd904f7049280b4ca9a8de1f7e3e WatchSource:0}: Error finding container 374170e088f29b0d2d20b6017e52803e312ecd904f7049280b4ca9a8de1f7e3e: Status 404 returned error can't find the container with id 374170e088f29b0d2d20b6017e52803e312ecd904f7049280b4ca9a8de1f7e3e Jul 29 18:34:17.083688 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:17.083665 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e194f0_e997_490a_b028_1cf62de7c601.slice/crio-ee1575d660a9d7c608dbb1586bdca957b008fa4c1f33617ebb58e398c15b0163 WatchSource:0}: Error finding container ee1575d660a9d7c608dbb1586bdca957b008fa4c1f33617ebb58e398c15b0163: Status 404 returned error can't find the container with id ee1575d660a9d7c608dbb1586bdca957b008fa4c1f33617ebb58e398c15b0163 Jul 29 18:34:17.084255 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:17.084234 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec6c7f6_047e_491f_bf07_82ebd7d63ed2.slice/crio-d77dff798d6a7865310b548cd50a26cab4d994da67548d1cc07ad455f11e876a WatchSource:0}: Error finding container d77dff798d6a7865310b548cd50a26cab4d994da67548d1cc07ad455f11e876a: Status 404 returned error can't find the container with id d77dff798d6a7865310b548cd50a26cab4d994da67548d1cc07ad455f11e876a Jul 29 18:34:17.466493 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.466193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:17.466695 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.466470 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:17.466695 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.466580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:17.466695 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.466648 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:19.466630194 +0000 UTC m=+6.133847385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:17.466865 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.466704 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:17.466865 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.466777 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:34:19.466758704 +0000 UTC m=+6.133975899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:17.568025 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.567956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:17.568233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.568143 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:17.568233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.568165 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:17.568233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.568177 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:17.568490 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:17.568239 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:19.568220092 +0000 UTC m=+6.235437285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:17.812959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.812917 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 18:29:16 +0000 UTC" deadline="2028-02-03 00:10:48.839266452 +0000 UTC" Jul 29 18:34:17.812959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.812959 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13277h36m31.026314067s" Jul 29 18:34:17.976640 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.976498 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" event={"ID":"c2af70ba-db52-4c87-a95d-bc790ee6946d","Type":"ContainerStarted","Data":"374170e088f29b0d2d20b6017e52803e312ecd904f7049280b4ca9a8de1f7e3e"} Jul 29 18:34:17.978901 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.978864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2cv44" event={"ID":"871ed1e1-d27f-4ab5-accd-d01be9f73ffc","Type":"ContainerStarted","Data":"5c491acaf2ad291d8b37fff0c74c05ca35d35fe541c5bf0e73cd94991eb461ce"} Jul 29 18:34:17.983959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.983672 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" event={"ID":"2ec71785db9a4db774a1e97c3d7af1b6","Type":"ContainerStarted","Data":"3fbd5c54eed4910ad64ec1f9e077fc083e7731d479941a17b4a19ed35b06adf0"} Jul 29 18:34:17.985916 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.985806 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"ee1575d660a9d7c608dbb1586bdca957b008fa4c1f33617ebb58e398c15b0163"} Jul 29 18:34:17.987661 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.987631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5tblx" event={"ID":"66003789-6ffd-45cf-b5bc-3a89c7e36f56","Type":"ContainerStarted","Data":"9aef7f9cd608929db8704dbf0ed82a24b14e01def5956642e11cdc8625fb5c1a"} Jul 29 18:34:17.991750 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.991705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerStarted","Data":"821e45d1d50d7da9f12817553c811d898c07b87b1b4eb39dd876ed39af2392c6"} Jul 29 18:34:17.993446 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.993421 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" event={"ID":"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2","Type":"ContainerStarted","Data":"d77dff798d6a7865310b548cd50a26cab4d994da67548d1cc07ad455f11e876a"} Jul 29 18:34:17.996633 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.996604 2573 generic.go:356] "Generic (PLEG): container finished" podID="31b38f294896cd956b89e12c4f24f06c" containerID="fe2860b4b2b942917b8c56c996ae4c25728305a22abdca42446a83bf8c1cf516" exitCode=0 Jul 29 18:34:17.996742 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:17.996687 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" event={"ID":"31b38f294896cd956b89e12c4f24f06c","Type":"ContainerDied","Data":"fe2860b4b2b942917b8c56c996ae4c25728305a22abdca42446a83bf8c1cf516"} Jul 29 18:34:18.005619 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.005590 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nrk9h" event={"ID":"be1d0114-c267-4858-843e-af59fea83565","Type":"ContainerStarted","Data":"8a161deb30fe757ad2fe1811094e2675c8689790c618e920de919f80d8244e13"} Jul 29 18:34:18.016187 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.016149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f5rvc" event={"ID":"f718b183-f469-4358-ac39-57cec88134b6","Type":"ContainerStarted","Data":"aff86e8af2da49a4440b607dc4391f1349f3e1416c18a5c64b55075cacec6490"} Jul 29 18:34:18.017887 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.017821 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-242.ec2.internal" podStartSLOduration=3.017801436 podStartE2EDuration="3.017801436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:18.001234477 +0000 UTC m=+4.668451696" watchObservedRunningTime="2026-07-29 18:34:18.017801436 +0000 UTC m=+4.685018640" Jul 29 18:34:18.023764 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.023735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktcr6" event={"ID":"63429306-cfe7-4a9f-8d2d-ac253dd01537","Type":"ContainerStarted","Data":"d0c383cdfd5b0183ac8d0330e4121693ecf68328622c051e27c106ccd399fd95"} Jul 29 18:34:18.952264 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.952228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:18.952857 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:18.952393 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:18.952857 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.952823 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:18.952985 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:18.952915 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:18.952985 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:18.952981 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:18.953087 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:18.953069 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:19.038711 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:19.038552 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" event={"ID":"31b38f294896cd956b89e12c4f24f06c","Type":"ContainerStarted","Data":"2aa2b968f2f2d71b30b94f7e0fd5db0bdda51c67ae7c6007f5271cbc4744d02d"} Jul 29 18:34:19.485657 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:19.485616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:19.485868 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:19.485686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:19.485868 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.485856 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:19.486000 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.485920 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:23.485902302 +0000 UTC m=+10.153119484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:19.486627 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.486488 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:19.486627 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.486561 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:34:23.486542752 +0000 UTC m=+10.153759937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:19.586960 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:19.586920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:19.587245 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.587223 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:19.587336 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.587254 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:19.587336 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.587267 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:19.587336 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:19.587329 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:23.587308494 +0000 UTC m=+10.254525677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:20.952643 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:20.952131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:20.952643 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:20.952274 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:20.952643 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:20.952385 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:20.952643 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:20.952487 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:20.952643 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:20.952536 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:20.952643 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:20.952605 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:22.951544 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:22.951473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:22.951544 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:22.951504 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:22.952119 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:22.951623 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:22.952119 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:22.951719 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:22.952119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:22.951772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:22.952119 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:22.951901 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:23.520407 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:23.520357 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:23.520582 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:23.520429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:23.520582 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.520551 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:23.520698 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.520616 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:31.520596153 +0000 UTC m=+18.187813331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:23.520871 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.520848 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:23.520989 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.520909 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:34:31.520893525 +0000 UTC m=+18.188110713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:23.621870 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:23.621692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:23.622051 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.621911 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:23.622051 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.621942 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:23.622051 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.621953 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:23.622051 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:23.622016 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:31.621998865 +0000 UTC m=+18.289216045 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:24.952470 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:24.952435 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:24.952981 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:24.952473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:24.952981 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:24.952579 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:24.952981 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:24.952668 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:24.952981 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:24.952714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:24.952981 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:24.952791 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:26.952047 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:26.952006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:26.952508 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:26.952006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:26.952508 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:26.952125 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:26.952508 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:26.952245 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:26.952508 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:26.952006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:26.952508 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:26.952376 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:28.952378 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:28.952342 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:28.952378 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:28.952375 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:28.952832 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:28.952352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:28.952832 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:28.952472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:28.952832 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:28.952528 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:28.952832 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:28.952624 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:30.951933 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:30.951892 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:30.951933 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:30.951933 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:30.952539 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:30.951942 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:30.952539 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:30.952015 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:30.952539 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:30.952100 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:30.952539 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:30.952205 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:31.582753 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:31.582720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:31.582952 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:31.582768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:31.582952 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.582852 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:31.582952 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.582885 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:31.582952 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.582909 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:34:47.582893867 +0000 UTC m=+34.250111045 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:31.582952 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.582931 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:47.582915577 +0000 UTC m=+34.250132760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:31.683728 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:31.683697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:31.683902 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.683877 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:31.683902 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.683894 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:31.683902 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.683902 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:31.684039 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:31.683960 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:47.68393945 +0000 UTC m=+34.351156631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:32.952227 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:32.952182 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:32.952709 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:32.952228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:32.952709 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:32.952239 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:32.952709 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:32.952328 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:32.952709 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:32.952460 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:32.952709 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:32.952522 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:34.952081 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:34.951759 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:34.952081 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:34.951797 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:34.952081 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:34.951767 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:34.952081 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:34.951888 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:34.952081 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:34.951948 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:34.952081 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:34.952036 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:36.076805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.076471 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5tblx" event={"ID":"66003789-6ffd-45cf-b5bc-3a89c7e36f56","Type":"ContainerStarted","Data":"22b9730fdb53c4697988f1c9f3e9660e9e2434a1629af65204a4cd2bfe4654e9"} Jul 29 18:34:36.078097 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.078073 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab8983ec-0b07-47a9-a532-9b40d67012d7" containerID="d60b19555144c1c2e2df5217953baa19c499acb0a66f50282d9c04cd2aa68df9" exitCode=0 Jul 29 18:34:36.078185 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.078156 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerDied","Data":"d60b19555144c1c2e2df5217953baa19c499acb0a66f50282d9c04cd2aa68df9"} Jul 29 18:34:36.079850 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.079814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" event={"ID":"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2","Type":"ContainerStarted","Data":"4910c72876bcdd46c2835182bb4376892170077045c004f8d77155b5d711a424"} Jul 29 18:34:36.081326 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.081263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nrk9h" event={"ID":"be1d0114-c267-4858-843e-af59fea83565","Type":"ContainerStarted","Data":"31fc182c516743b8e2314a03eddb047e66dad87699c105c081c220412c897af8"} Jul 29 18:34:36.082788 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.082767 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f5rvc" event={"ID":"f718b183-f469-4358-ac39-57cec88134b6","Type":"ContainerStarted","Data":"047457a98aca9d022da5d4594e22ce5af774be7aecaf3684a8c9a053b8579636"} Jul 29 18:34:36.087595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.087560 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ktcr6" event={"ID":"63429306-cfe7-4a9f-8d2d-ac253dd01537","Type":"ContainerStarted","Data":"cf33cc683290a2f97d979e20ec6655ed442eaa5a6c18b033302a7e4751c28bb0"} Jul 29 18:34:36.088922 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.088902 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" event={"ID":"c2af70ba-db52-4c87-a95d-bc790ee6946d","Type":"ContainerStarted","Data":"99c50ecfc0cd994c210d35d4d0ebf95feb3a3cfd73e5245ef13f953afc21f340"} Jul 29 18:34:36.090703 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.090683 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"b71d418a6646b44aa6944ebdbb1b2206f844c49aeb28668e4d036f6e77ceca5c"} Jul 29 18:34:36.090786 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.090741 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"eebd3133d31941bceb1c61834ff16ed65d8efd8d59f5efd8430c239c79e55b7a"} Jul 29 18:34:36.104658 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.104617 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-242.ec2.internal" podStartSLOduration=21.104603204 podStartE2EDuration="21.104603204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:19.056649445 +0000 UTC m=+5.723866651" watchObservedRunningTime="2026-07-29 18:34:36.104603204 +0000 UTC m=+22.771820403" Jul 29 18:34:36.123354 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.123287 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f5rvc" podStartSLOduration=11.523059521 podStartE2EDuration="22.123266982s" totalImagesPullingTime="10.600207461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:36.12243944 +0000 UTC m=+22.789656639" watchObservedRunningTime="2026-07-29 18:34:36.123266982 +0000 UTC m=+22.790484184" Jul 29 18:34:36.137898 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.137855 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ktcr6" podStartSLOduration=3.470044899 podStartE2EDuration="22.137842112s" totalImagesPullingTime="18.667797213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:36.137373067 +0000 UTC m=+22.804590267" watchObservedRunningTime="2026-07-29 18:34:36.137842112 +0000 UTC m=+22.805059311" Jul 29 18:34:36.155026 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.154982 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nrk9h" podStartSLOduration=3.492882983 podStartE2EDuration="22.154973099s" totalImagesPullingTime="18.662090116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:36.154618384 +0000 UTC m=+22.821835584" watchObservedRunningTime="2026-07-29 18:34:36.154973099 +0000 UTC m=+22.822190300" Jul 29 18:34:36.178207 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.178168 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5tblx" podStartSLOduration=3.508857445 podStartE2EDuration="22.178148247s" totalImagesPullingTime="18.669290802s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:36.178085059 +0000 UTC m=+22.845302259" watchObservedRunningTime="2026-07-29 18:34:36.178148247 +0000 UTC m=+22.845365425" Jul 29 18:34:36.195795 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.195754 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tv8qt" podStartSLOduration=3.519505375 podStartE2EDuration="22.195736693s" totalImagesPullingTime="18.676231318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:36.195535037 +0000 UTC m=+22.862752236" watchObservedRunningTime="2026-07-29 18:34:36.195736693 +0000 UTC m=+22.862953893" Jul 29 18:34:36.951984 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.951951 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:36.952167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.951997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:36.952167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:36.951997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:36.952167 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:36.952080 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:36.952326 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:36.952170 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:36.952326 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:36.952239 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:37.096190 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.096156 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"bcbb5fd36466bd2e2ab2245310888f049dc6907a21c1a7e412e8a9e1b347bb77"} Jul 29 18:34:37.096508 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.096248 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"3132dee72c11459a966a245569599b7a282405ef87951166f87917d9783a3f28"} Jul 29 18:34:37.096508 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.096316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"d1ac2cd0b622894c09cc1a017dc6e85eb4e6c9b4d11270f2add49ea0bd98bdf4"} Jul 29 18:34:37.096508 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.096367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"a152b236f79e3a21580310dddc51a5130e55bc765654791361c7ab00cd245f5f"} Jul 29 18:34:37.220097 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.220071 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 18:34:37.815137 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.814985 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T18:34:37.220092057Z","UUID":"c9867a03-808e-4a4d-ae57-38669da9a082","Handler":null,"Name":"","Endpoint":""} Jul 29 18:34:37.816749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.816724 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 18:34:37.816879 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:37.816763 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 18:34:38.100058 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.099973 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2cv44" event={"ID":"871ed1e1-d27f-4ab5-accd-d01be9f73ffc","Type":"ContainerStarted","Data":"692fc53689ff06d4b736b3f5433d1f7d58cec00f7a2eeb21a532e844beae4dd1"} Jul 29 18:34:38.101887 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.101864 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" event={"ID":"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2","Type":"ContainerStarted","Data":"c9c3518b635c49f6bf3d9326ed09194936b8a6dd8320e5fc6922f9b3b17475cd"} Jul 29 18:34:38.137282 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.137247 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:38.137863 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.137841 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:38.153324 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.153271 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2cv44" podStartSLOduration=5.476782008 podStartE2EDuration="24.153255681s" totalImagesPullingTime="18.676473673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:38.114933992 +0000 UTC m=+24.782151192" watchObservedRunningTime="2026-07-29 18:34:38.153255681 +0000 UTC m=+24.820472883" Jul 29 18:34:38.952248 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.952212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:38.952248 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.952251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:38.952507 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:38.952251 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:38.952507 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:38.952341 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:38.952507 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:38.952438 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:38.952507 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:38.952500 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:39.104954 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:39.104918 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:39.105423 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:39.105401 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ktcr6" Jul 29 18:34:40.952529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:40.952343 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:40.953185 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:40.952357 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:40.953185 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:40.952621 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:40.953185 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:40.952389 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:40.953185 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:40.952668 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:40.953185 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:40.952751 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:41.112148 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:41.112122 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"79c748fe5ab544828c7658fd96effa793f3a590f5cd41f8fc3fc4a63dae8fc26"} Jul 29 18:34:41.113708 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:41.113680 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab8983ec-0b07-47a9-a532-9b40d67012d7" containerID="2ab64d6485d3ab6235e53f379311eb7d0af39247d4e690cee760482be0785614" exitCode=0 Jul 29 18:34:41.113812 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:41.113749 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerDied","Data":"2ab64d6485d3ab6235e53f379311eb7d0af39247d4e690cee760482be0785614"} Jul 29 18:34:41.115817 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:41.115783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" event={"ID":"3ec6c7f6-047e-491f-bf07-82ebd7d63ed2","Type":"ContainerStarted","Data":"18d243b0c92d364048a1949a079b8752c042bf901072133a5439a2ccce686e9c"} Jul 29 18:34:41.154674 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:41.154632 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j7vlw" podStartSLOduration=3.589702106 podStartE2EDuration="27.154618477s" totalImagesPullingTime="23.564916371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:41.154280098 +0000 UTC m=+27.821497299" watchObservedRunningTime="2026-07-29 18:34:41.154618477 +0000 UTC m=+27.821835707" Jul 29 18:34:42.120580 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:42.120529 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerStarted","Data":"23366ea1f29401a55b73fd56c77c5d0a19f66b32de9d262a8eab843ec4cdb86d"} Jul 29 18:34:42.952067 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:42.951888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:42.952235 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:42.951888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:42.952235 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:42.952139 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:42.952235 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:42.952221 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:42.952362 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:42.951887 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:42.952362 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:42.952327 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:43.126365 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.126325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" event={"ID":"51e194f0-e997-490a-b028-1cf62de7c601","Type":"ContainerStarted","Data":"e162a9fa9d14258e8ac4a6f79018f619843808ac396fce1ee0211023392e4553"} Jul 29 18:34:43.126930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.126628 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:43.130177 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.127067 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:43.130601 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.130570 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab8983ec-0b07-47a9-a532-9b40d67012d7" containerID="23366ea1f29401a55b73fd56c77c5d0a19f66b32de9d262a8eab843ec4cdb86d" exitCode=0 Jul 29 18:34:43.130783 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.130639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerDied","Data":"23366ea1f29401a55b73fd56c77c5d0a19f66b32de9d262a8eab843ec4cdb86d"} Jul 29 18:34:43.143845 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.143825 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:43.161852 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:43.161808 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" podStartSLOduration=10.434911866 podStartE2EDuration="29.161794275s" totalImagesPullingTime="18.726882409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:43.160069868 +0000 UTC m=+29.827287069" watchObservedRunningTime="2026-07-29 18:34:43.161794275 +0000 UTC m=+29.829011495" Jul 29 18:34:44.135269 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.135236 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab8983ec-0b07-47a9-a532-9b40d67012d7" containerID="49aecd198f7c0f46a9a07fda3500697bb6705914404778f4b8e3b9c5eb4640f3" exitCode=0 Jul 29 18:34:44.135628 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.135344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerDied","Data":"49aecd198f7c0f46a9a07fda3500697bb6705914404778f4b8e3b9c5eb4640f3"} Jul 29 18:34:44.135779 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.135755 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:44.151858 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.151809 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:34:44.318880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.318848 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dg5zm"] Jul 29 18:34:44.319046 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.319023 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:44.319175 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:44.319137 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:44.324450 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.323921 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fwzd"] Jul 29 18:34:44.324450 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.324064 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:44.324450 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:44.324174 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:44.324687 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.324528 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x6szn"] Jul 29 18:34:44.324687 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:44.324649 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:44.324787 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:44.324745 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:45.952533 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:45.952502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:45.952533 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:45.952520 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:45.953124 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:45.952634 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:45.953124 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:45.952634 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:45.953124 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:45.952749 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:45.953124 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:45.952850 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:47.602257 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:47.602215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:47.602794 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:47.602319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:47.602794 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.602419 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:47.602794 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.602494 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:19.602477365 +0000 UTC m=+66.269694548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 18:34:47.602794 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.602419 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:47.602794 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.602577 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret podName:9618fed2-7fe7-451f-bf88-b9df3edac5ea nodeName:}" failed. No retries permitted until 2026-07-29 18:35:19.602562553 +0000 UTC m=+66.269779730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret") pod "global-pull-secret-syncer-dg5zm" (UID: "9618fed2-7fe7-451f-bf88-b9df3edac5ea") : object "kube-system"/"original-pull-secret" not registered Jul 29 18:34:47.703695 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:47.703658 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:47.703845 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.703811 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 18:34:47.703845 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.703830 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 18:34:47.703845 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.703839 2573 projected.go:196] Error preparing data for projected volume kube-api-access-mg6mj for pod openshift-network-diagnostics/network-check-target-8fwzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:47.703964 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.703901 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj podName:82e8437d-4a96-4187-9ec3-25ab1fd8b597 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:19.703883827 +0000 UTC m=+66.371101023 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mg6mj" (UniqueName: "kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj") pod "network-check-target-8fwzd" (UID: "82e8437d-4a96-4187-9ec3-25ab1fd8b597") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 18:34:47.952553 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:47.952518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:47.952742 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:47.952565 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:47.952742 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:47.952516 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:47.952742 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.952658 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8fwzd" podUID="82e8437d-4a96-4187-9ec3-25ab1fd8b597" Jul 29 18:34:47.952887 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.952746 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:34:47.952887 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:47.952826 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dg5zm" podUID="9618fed2-7fe7-451f-bf88-b9df3edac5ea" Jul 29 18:34:48.147731 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.147701 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerStarted","Data":"bcff9b0f94619db2968f648a3ff3431930082a68bdb484bf1cb89143217fb582"} Jul 29 18:34:48.663999 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.663971 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-242.ec2.internal" event="NodeReady" Jul 29 18:34:48.664627 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.664123 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 18:34:48.716659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.716625 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2tpsg"] Jul 29 18:34:48.719144 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.719127 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j5clh"] Jul 29 18:34:48.719264 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.719244 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.721911 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.721886 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 18:34:48.722014 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.721956 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:48.722082 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.722047 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zfgsf\"" Jul 29 18:34:48.722447 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.722428 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 18:34:48.724607 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.724588 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 18:34:48.724714 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.724631 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 18:34:48.724820 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.724796 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jmxd5\"" Jul 29 18:34:48.724982 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.724964 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 18:34:48.729691 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.729671 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j5clh"] Jul 29 18:34:48.733658 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.733637 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2tpsg"] Jul 29 18:34:48.811341 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.811317 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-tmp-dir\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.811496 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.811364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-config-volume\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.811496 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.811427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.811496 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.811451 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gppw\" (UniqueName: \"kubernetes.io/projected/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-kube-api-access-4gppw\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.811496 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.811474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee7d3668-cbc8-494a-8663-568d792ee2c0-cert\") pod \"ingress-canary-j5clh\" (UID: \"ee7d3668-cbc8-494a-8663-568d792ee2c0\") " pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:48.811653 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.811502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtzsv\" (UniqueName: \"kubernetes.io/projected/ee7d3668-cbc8-494a-8663-568d792ee2c0-kube-api-access-gtzsv\") pod \"ingress-canary-j5clh\" (UID: \"ee7d3668-cbc8-494a-8663-568d792ee2c0\") " pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:48.912775 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.912745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee7d3668-cbc8-494a-8663-568d792ee2c0-cert\") pod \"ingress-canary-j5clh\" (UID: \"ee7d3668-cbc8-494a-8663-568d792ee2c0\") " pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:48.912935 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.912792 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtzsv\" (UniqueName: \"kubernetes.io/projected/ee7d3668-cbc8-494a-8663-568d792ee2c0-kube-api-access-gtzsv\") pod \"ingress-canary-j5clh\" (UID: \"ee7d3668-cbc8-494a-8663-568d792ee2c0\") " pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:48.912935 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.912811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-tmp-dir\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.912935 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.912853 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-config-volume\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.912935 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.912898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.912935 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.912929 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gppw\" (UniqueName: \"kubernetes.io/projected/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-kube-api-access-4gppw\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.913229 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:48.913021 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:48.913229 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:48.913090 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:49.413067958 +0000 UTC m=+36.080285153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:34:48.913229 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.913208 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-tmp-dir\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.913453 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.913437 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-config-volume\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.917084 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.917031 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee7d3668-cbc8-494a-8663-568d792ee2c0-cert\") pod \"ingress-canary-j5clh\" (UID: \"ee7d3668-cbc8-494a-8663-568d792ee2c0\") " pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:48.921813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.921791 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gppw\" (UniqueName: \"kubernetes.io/projected/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-kube-api-access-4gppw\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:48.921911 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:48.921882 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtzsv\" (UniqueName: \"kubernetes.io/projected/ee7d3668-cbc8-494a-8663-568d792ee2c0-kube-api-access-gtzsv\") pod \"ingress-canary-j5clh\" (UID: \"ee7d3668-cbc8-494a-8663-568d792ee2c0\") " pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:49.035310 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.035262 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j5clh" Jul 29 18:34:49.153179 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.152991 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab8983ec-0b07-47a9-a532-9b40d67012d7" containerID="bcff9b0f94619db2968f648a3ff3431930082a68bdb484bf1cb89143217fb582" exitCode=0 Jul 29 18:34:49.153179 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.153065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerDied","Data":"bcff9b0f94619db2968f648a3ff3431930082a68bdb484bf1cb89143217fb582"} Jul 29 18:34:49.169289 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.169215 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j5clh"] Jul 29 18:34:49.172205 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:34:49.172183 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7d3668_cbc8_494a_8663_568d792ee2c0.slice/crio-825f76c6d3c375852aac2c0b8b366702cb83bbc841eda2a528a433e1a2fecbd9 WatchSource:0}: Error finding container 825f76c6d3c375852aac2c0b8b366702cb83bbc841eda2a528a433e1a2fecbd9: Status 404 returned error can't find the container with id 825f76c6d3c375852aac2c0b8b366702cb83bbc841eda2a528a433e1a2fecbd9 Jul 29 18:34:49.417907 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.417842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:49.418061 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:49.417989 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:49.418061 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:49.418049 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:50.418034826 +0000 UTC m=+37.085252004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:34:49.952316 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.952272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:34:49.952885 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.952273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:34:49.952885 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.952272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:34:49.956634 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.956613 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 18:34:49.956634 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.956623 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 18:34:49.956808 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.956670 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 18:34:49.956808 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.956677 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2rc9\"" Jul 29 18:34:49.956808 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.956621 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 18:34:49.956808 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:49.956617 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-595vq\"" Jul 29 18:34:50.157466 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:50.157428 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j5clh" event={"ID":"ee7d3668-cbc8-494a-8663-568d792ee2c0","Type":"ContainerStarted","Data":"825f76c6d3c375852aac2c0b8b366702cb83bbc841eda2a528a433e1a2fecbd9"} Jul 29 18:34:50.160973 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:50.160942 2573 generic.go:356] "Generic (PLEG): container finished" podID="ab8983ec-0b07-47a9-a532-9b40d67012d7" containerID="32b01d62935c14d33c505312e38efcf0bead92b4547335ea15c2fce602d59c2c" exitCode=0 Jul 29 18:34:50.161101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:50.160970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerDied","Data":"32b01d62935c14d33c505312e38efcf0bead92b4547335ea15c2fce602d59c2c"} Jul 29 18:34:50.426191 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:50.426159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:50.426371 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:50.426329 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:50.426447 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:50.426402 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:52.426384734 +0000 UTC m=+39.093601919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:34:51.168027 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:51.167993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" event={"ID":"ab8983ec-0b07-47a9-a532-9b40d67012d7","Type":"ContainerStarted","Data":"6e4284861e96fbf1fe264cb7da8a5d19cd513b0367f8b880db87e0bd33a0c772"} Jul 29 18:34:51.193429 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:51.193370 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qxr9f" podStartSLOduration=8.633026198 podStartE2EDuration="37.193345637s" totalImagesPullingTime="28.560319439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:51.19158124 +0000 UTC m=+37.858798438" watchObservedRunningTime="2026-07-29 18:34:51.193345637 +0000 UTC m=+37.860562870" Jul 29 18:34:52.171790 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:52.171547 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j5clh" event={"ID":"ee7d3668-cbc8-494a-8663-568d792ee2c0","Type":"ContainerStarted","Data":"bb912f19cd06aa1e8dc035f6b550441f30c73606e655c5cad00ac00f14e4d28f"} Jul 29 18:34:52.189977 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:52.189933 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j5clh" podStartSLOduration=1.956511256 podStartE2EDuration="4.189918687s" totalImagesPullingTime="2.233407431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:52.188273774 +0000 UTC m=+38.855490976" watchObservedRunningTime="2026-07-29 18:34:52.189918687 +0000 UTC m=+38.857135865" Jul 29 18:34:52.442080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:52.441991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:52.442291 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:52.442124 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:52.442291 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:52.442176 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:34:56.442162993 +0000 UTC m=+43.109380172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:34:56.471529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:34:56.471487 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:34:56.471994 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:56.471620 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:34:56.471994 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:34:56.471674 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:04.471660504 +0000 UTC m=+51.138877682 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:35:04.522430 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:04.522392 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:35:04.522839 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:04.522542 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:04.522839 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:04.522610 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:20.522594909 +0000 UTC m=+67.189812090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:35:16.150554 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:16.150525 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krwk9" Jul 29 18:35:19.627282 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.627236 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:35:19.627282 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.627311 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:35:19.630566 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.630546 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 18:35:19.630637 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.630552 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 18:35:19.638123 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:19.638103 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 18:35:19.638197 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:19.638162 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:36:23.638146677 +0000 UTC m=+130.305363854 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : secret "metrics-daemon-secret" not found Jul 29 18:35:19.641851 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.641826 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9618fed2-7fe7-451f-bf88-b9df3edac5ea-original-pull-secret\") pod \"global-pull-secret-syncer-dg5zm\" (UID: \"9618fed2-7fe7-451f-bf88-b9df3edac5ea\") " pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:35:19.676328 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.676278 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dg5zm" Jul 29 18:35:19.728487 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.728450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:35:19.731768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.731745 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 18:35:19.742179 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.742119 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 18:35:19.752090 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.752059 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg6mj\" (UniqueName: \"kubernetes.io/projected/82e8437d-4a96-4187-9ec3-25ab1fd8b597-kube-api-access-mg6mj\") pod \"network-check-target-8fwzd\" (UID: \"82e8437d-4a96-4187-9ec3-25ab1fd8b597\") " pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:35:19.808638 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.808542 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dg5zm"] Jul 29 18:35:19.811144 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:35:19.811119 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9618fed2_7fe7_451f_bf88_b9df3edac5ea.slice/crio-687411e86c60a6feda182adeb71ac6c8945d2521e4c39a2b58a73b2a676a3aec WatchSource:0}: Error finding container 687411e86c60a6feda182adeb71ac6c8945d2521e4c39a2b58a73b2a676a3aec: Status 404 returned error can't find the container with id 687411e86c60a6feda182adeb71ac6c8945d2521e4c39a2b58a73b2a676a3aec Jul 29 18:35:19.974317 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.974263 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-595vq\"" Jul 29 18:35:19.981953 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:19.981933 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:35:20.103379 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:20.103342 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8fwzd"] Jul 29 18:35:20.105832 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:35:20.105810 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e8437d_4a96_4187_9ec3_25ab1fd8b597.slice/crio-3db888d9c930acc1f0a0ca0b6eef3303b57be717562d6120d54caba73f690cf5 WatchSource:0}: Error finding container 3db888d9c930acc1f0a0ca0b6eef3303b57be717562d6120d54caba73f690cf5: Status 404 returned error can't find the container with id 3db888d9c930acc1f0a0ca0b6eef3303b57be717562d6120d54caba73f690cf5 Jul 29 18:35:20.241107 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:20.241018 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fwzd" event={"ID":"82e8437d-4a96-4187-9ec3-25ab1fd8b597","Type":"ContainerStarted","Data":"3db888d9c930acc1f0a0ca0b6eef3303b57be717562d6120d54caba73f690cf5"} Jul 29 18:35:20.242118 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:20.242094 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dg5zm" event={"ID":"9618fed2-7fe7-451f-bf88-b9df3edac5ea","Type":"ContainerStarted","Data":"687411e86c60a6feda182adeb71ac6c8945d2521e4c39a2b58a73b2a676a3aec"} Jul 29 18:35:20.532570 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:20.532490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:35:20.532726 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:20.532652 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:20.532726 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:20.532713 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:35:52.532698576 +0000 UTC m=+99.199915754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:35:25.256988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:25.256947 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dg5zm" event={"ID":"9618fed2-7fe7-451f-bf88-b9df3edac5ea","Type":"ContainerStarted","Data":"2433259f80b2c41bc1d25b9218b136cbbb3df144130441ab12d719daacc8fd27"} Jul 29 18:35:25.258382 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:25.258358 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8fwzd" event={"ID":"82e8437d-4a96-4187-9ec3-25ab1fd8b597","Type":"ContainerStarted","Data":"6dbd5633726820bd5d8733d685428fe9618e4d498c80fe3273fdd932ea1f3068"} Jul 29 18:35:25.258494 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:25.258478 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:35:25.274478 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:25.274436 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dg5zm" podStartSLOduration=66.558596649 podStartE2EDuration="1m11.274422426s" totalImagesPullingTime="4.715825777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:25.273707641 +0000 UTC m=+71.940924842" watchObservedRunningTime="2026-07-29 18:35:25.274422426 +0000 UTC m=+71.941639604" Jul 29 18:35:25.292231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:25.292189 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8fwzd" podStartSLOduration=66.874742192 podStartE2EDuration="1m11.292176742s" totalImagesPullingTime="4.41743455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:25.2914623 +0000 UTC m=+71.958679501" watchObservedRunningTime="2026-07-29 18:35:25.292176742 +0000 UTC m=+71.959393942" Jul 29 18:35:52.551553 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:52.551425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:35:52.552054 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:52.551566 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:35:52.552054 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:35:52.551637 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:36:56.55162108 +0000 UTC m=+163.218838257 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:35:56.264248 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:35:56.264219 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8fwzd" Jul 29 18:36:23.660659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:23.660600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:36:23.661159 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:36:23.660720 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 18:36:23.661159 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:36:23.660783 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:25.660767745 +0000 UTC m=+252.327984922 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : secret "metrics-daemon-secret" not found Jul 29 18:36:41.404586 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.404550 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m"] Jul 29 18:36:41.406371 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.406328 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.410419 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.410398 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 18:36:41.410552 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.410400 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-66msd\"" Jul 29 18:36:41.410552 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.410399 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 18:36:41.410552 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.410499 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 18:36:41.410552 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.410399 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 18:36:41.419984 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.419959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m"] Jul 29 18:36:41.479621 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.479593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-794695848-pm98m\" (UID: \"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.479772 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.479632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whzf7\" (UniqueName: \"kubernetes.io/projected/91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8-kube-api-access-whzf7\") pod \"managed-serviceaccount-addon-agent-794695848-pm98m\" (UID: \"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.580231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.580185 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-794695848-pm98m\" (UID: \"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.580231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.580243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whzf7\" (UniqueName: \"kubernetes.io/projected/91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8-kube-api-access-whzf7\") pod \"managed-serviceaccount-addon-agent-794695848-pm98m\" (UID: \"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.582717 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.582686 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-794695848-pm98m\" (UID: \"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.588877 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.588851 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whzf7\" (UniqueName: \"kubernetes.io/projected/91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8-kube-api-access-whzf7\") pod \"managed-serviceaccount-addon-agent-794695848-pm98m\" (UID: \"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.722531 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.722450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" Jul 29 18:36:41.842896 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:41.842863 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m"] Jul 29 18:36:41.845916 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:36:41.845894 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91476e10_2e7d_40fe_acc8_d5ce7b9fa3f8.slice/crio-07d57db46d998a4b10da40eed6498cf1bd5d56e0f738bd32edbdbe9288e46e98 WatchSource:0}: Error finding container 07d57db46d998a4b10da40eed6498cf1bd5d56e0f738bd32edbdbe9288e46e98: Status 404 returned error can't find the container with id 07d57db46d998a4b10da40eed6498cf1bd5d56e0f738bd32edbdbe9288e46e98 Jul 29 18:36:42.440860 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:42.440827 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" event={"ID":"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8","Type":"ContainerStarted","Data":"07d57db46d998a4b10da40eed6498cf1bd5d56e0f738bd32edbdbe9288e46e98"} Jul 29 18:36:47.453158 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:47.453122 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" event={"ID":"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8","Type":"ContainerStarted","Data":"e24beb30ef5faf75f7ec389ef4064c34dfec7e522eebd94be73046e2dfec4dd0"} Jul 29 18:36:47.469959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:47.469899 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" podStartSLOduration=1.214056773 podStartE2EDuration="6.469883256s" totalImagesPullingTime="5.255826483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:36:47.469433883 +0000 UTC m=+154.136651082" watchObservedRunningTime="2026-07-29 18:36:47.469883256 +0000 UTC m=+154.137100456" Jul 29 18:36:51.730228 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:36:51.730186 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2tpsg" podUID="96f1c45a-418c-47c9-9dc4-c1a63c6f1927" Jul 29 18:36:52.464631 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:52.464602 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2tpsg" Jul 29 18:36:52.964139 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:36:52.964084 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:36:56.582924 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:36:56.582873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:36:56.583337 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:36:56.583032 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 18:36:56.583337 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:36:56.583106 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls podName:96f1c45a-418c-47c9-9dc4-c1a63c6f1927 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:58.583089225 +0000 UTC m=+285.250306403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls") pod "dns-default-2tpsg" (UID: "96f1c45a-418c-47c9-9dc4-c1a63c6f1927") : secret "dns-default-metrics-tls" not found Jul 29 18:37:05.951865 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:37:05.951779 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:38:25.686930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:25.686896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:38:25.687428 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:25.687030 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 18:38:25.687428 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:25.687102 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs podName:224a45b3-ef7f-4a80-877f-8c41a61be9a2 nodeName:}" failed. No retries permitted until 2026-07-29 18:40:27.687084736 +0000 UTC m=+374.354301922 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs") pod "network-metrics-daemon-x6szn" (UID: "224a45b3-ef7f-4a80-877f-8c41a61be9a2") : secret "metrics-daemon-secret" not found Jul 29 18:38:37.925516 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.925432 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9fr66"] Jul 29 18:38:37.928064 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.928047 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:37.931594 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.931569 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 18:38:37.931732 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.931622 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 18:38:37.931732 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.931640 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xx6r7\"" Jul 29 18:38:37.932939 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.932912 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 18:38:37.933016 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.932947 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 18:38:37.938906 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.938888 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 18:38:37.961368 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:37.961346 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9fr66"] Jul 29 18:38:38.024539 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.024502 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr"] Jul 29 18:38:38.027687 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.027665 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-x88fj"] Jul 29 18:38:38.027824 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.027806 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.030215 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.030198 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85d486cb67-p5rkk"] Jul 29 18:38:38.030341 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.030325 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.030892 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.030858 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 18:38:38.030999 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.030910 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 18:38:38.030999 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.030974 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 18:38:38.031087 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.031017 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:38:38.031249 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.031232 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gxf2n\"" Jul 29 18:38:38.032644 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.032627 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-784768f84-cv8d6"] Jul 29 18:38:38.032744 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.032727 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.035493 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.035408 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 18:38:38.037886 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.035993 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 18:38:38.037886 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.036096 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 18:38:38.037886 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.036863 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 18:38:38.037886 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.037529 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 18:38:38.038602 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.038584 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 18:38:38.038691 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.038612 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h9mzr\"" Jul 29 18:38:38.038761 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.038702 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m966n\"" Jul 29 18:38:38.038825 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.038772 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 18:38:38.038825 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.038618 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 18:38:38.040039 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.040005 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 18:38:38.040039 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.040016 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 18:38:38.041819 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.041797 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-x88fj"] Jul 29 18:38:38.041914 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.041890 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.043270 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.043248 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 18:38:38.044510 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.044491 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr"] Jul 29 18:38:38.044623 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.044606 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x4hx2\"" Jul 29 18:38:38.044877 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.044854 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 18:38:38.045009 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.044912 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 18:38:38.045459 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.045120 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 18:38:38.046110 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.045655 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d486cb67-p5rkk"] Jul 29 18:38:38.048047 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.048029 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784768f84-cv8d6"] Jul 29 18:38:38.050647 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.050628 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 18:38:38.064258 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.064234 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaac7f5f-9511-42aa-a6c6-2182484fa94a-tmp\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.064386 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.064265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtcd\" (UniqueName: \"kubernetes.io/projected/aaac7f5f-9511-42aa-a6c6-2182484fa94a-kube-api-access-sdtcd\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.064386 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.064287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/aaac7f5f-9511-42aa-a6c6-2182484fa94a-snapshots\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.064386 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.064326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaac7f5f-9511-42aa-a6c6-2182484fa94a-serving-cert\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.064386 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.064356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaac7f5f-9511-42aa-a6c6-2182484fa94a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.064514 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.064391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaac7f5f-9511-42aa-a6c6-2182484fa94a-service-ca-bundle\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.165596 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaac7f5f-9511-42aa-a6c6-2182484fa94a-tmp\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.165596 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33e2697f-bbe0-4b27-b682-bda01034cc8b-ca-trust-extracted\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/aaac7f5f-9511-42aa-a6c6-2182484fa94a-snapshots\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-trusted-ca\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-stats-auth\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-certificates\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.165813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165800 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165844 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaac7f5f-9511-42aa-a6c6-2182484fa94a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165862 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lthhz\" (UniqueName: \"kubernetes.io/projected/a7a106b6-c6a8-41d3-bddc-81ef5957d347-kube-api-access-lthhz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165879 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c522834-ecea-4bb7-9fda-02b5ed021bf9-config\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcss9\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-kube-api-access-kcss9\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaac7f5f-9511-42aa-a6c6-2182484fa94a-service-ca-bundle\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165979 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaac7f5f-9511-42aa-a6c6-2182484fa94a-tmp\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.165980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c522834-ecea-4bb7-9fda-02b5ed021bf9-trusted-ca\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166044 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtcd\" (UniqueName: \"kubernetes.io/projected/aaac7f5f-9511-42aa-a6c6-2182484fa94a-kube-api-access-sdtcd\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.166111 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-image-registry-private-configuration\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqbjz\" (UniqueName: \"kubernetes.io/projected/6c522834-ecea-4bb7-9fda-02b5ed021bf9-kube-api-access-nqbjz\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166172 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-installation-pull-secrets\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166202 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaac7f5f-9511-42aa-a6c6-2182484fa94a-serving-cert\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a106b6-c6a8-41d3-bddc-81ef5957d347-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166231 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/aaac7f5f-9511-42aa-a6c6-2182484fa94a-snapshots\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lcd4\" (UniqueName: \"kubernetes.io/projected/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-kube-api-access-2lcd4\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-bound-sa-token\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-default-certificate\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a106b6-c6a8-41d3-bddc-81ef5957d347-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c522834-ecea-4bb7-9fda-02b5ed021bf9-serving-cert\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.166573 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166499 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaac7f5f-9511-42aa-a6c6-2182484fa94a-service-ca-bundle\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.167057 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.166650 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaac7f5f-9511-42aa-a6c6-2182484fa94a-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.168375 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.168357 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aaac7f5f-9511-42aa-a6c6-2182484fa94a-serving-cert\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.174269 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.174247 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtcd\" (UniqueName: \"kubernetes.io/projected/aaac7f5f-9511-42aa-a6c6-2182484fa94a-kube-api-access-sdtcd\") pod \"insights-operator-5885fdb759-9fr66\" (UID: \"aaac7f5f-9511-42aa-a6c6-2182484fa94a\") " pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.236516 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.236433 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-9fr66" Jul 29 18:38:38.267156 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267127 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-default-certificate\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a106b6-c6a8-41d3-bddc-81ef5957d347-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c522834-ecea-4bb7-9fda-02b5ed021bf9-serving-cert\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33e2697f-bbe0-4b27-b682-bda01034cc8b-ca-trust-extracted\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-trusted-ca\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267315 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-stats-auth\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.267345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-certificates\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.267371 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:38.767348069 +0000 UTC m=+265.434565247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : configmap references non-existent config key: service-ca.crt Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267420 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267456 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267490 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lthhz\" (UniqueName: \"kubernetes.io/projected/a7a106b6-c6a8-41d3-bddc-81ef5957d347-kube-api-access-lthhz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c522834-ecea-4bb7-9fda-02b5ed021bf9-config\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcss9\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-kube-api-access-kcss9\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c522834-ecea-4bb7-9fda-02b5ed021bf9-trusted-ca\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-image-registry-private-configuration\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267665 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqbjz\" (UniqueName: \"kubernetes.io/projected/6c522834-ecea-4bb7-9fda-02b5ed021bf9-kube-api-access-nqbjz\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267673 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33e2697f-bbe0-4b27-b682-bda01034cc8b-ca-trust-extracted\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-installation-pull-secrets\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.267768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a106b6-c6a8-41d3-bddc-81ef5957d347-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267788 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lcd4\" (UniqueName: \"kubernetes.io/projected/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-kube-api-access-2lcd4\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267790 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a106b6-c6a8-41d3-bddc-81ef5957d347-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.267816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-bound-sa-token\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.268157 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.268220 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:38.768202133 +0000 UTC m=+265.435419315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : secret "router-metrics-certs-default" not found Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.268316 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.268329 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784768f84-cv8d6: secret "image-registry-tls" not found Jul 29 18:38:38.268469 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.268365 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls podName:33e2697f-bbe0-4b27-b682-bda01034cc8b nodeName:}" failed. No retries permitted until 2026-07-29 18:38:38.768352817 +0000 UTC m=+265.435570015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls") pod "image-registry-784768f84-cv8d6" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b") : secret "image-registry-tls" not found Jul 29 18:38:38.268890 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.268502 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-certificates\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.268890 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.268858 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-trusted-ca\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.269992 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.269940 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c522834-ecea-4bb7-9fda-02b5ed021bf9-config\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.270222 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.270197 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c522834-ecea-4bb7-9fda-02b5ed021bf9-trusted-ca\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.270645 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.270598 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a106b6-c6a8-41d3-bddc-81ef5957d347-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.270739 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.270686 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-stats-auth\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.270911 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.270890 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c522834-ecea-4bb7-9fda-02b5ed021bf9-serving-cert\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.271256 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.271238 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-default-certificate\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.271469 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.271454 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-installation-pull-secrets\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.271952 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.271930 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-image-registry-private-configuration\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.279923 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.279859 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-bound-sa-token\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.280034 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.280005 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lcd4\" (UniqueName: \"kubernetes.io/projected/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-kube-api-access-2lcd4\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.280099 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.280082 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcss9\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-kube-api-access-kcss9\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.281711 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.281688 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqbjz\" (UniqueName: \"kubernetes.io/projected/6c522834-ecea-4bb7-9fda-02b5ed021bf9-kube-api-access-nqbjz\") pod \"console-operator-584dcb6b54-x88fj\" (UID: \"6c522834-ecea-4bb7-9fda-02b5ed021bf9\") " pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.281870 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.281847 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lthhz\" (UniqueName: \"kubernetes.io/projected/a7a106b6-c6a8-41d3-bddc-81ef5957d347-kube-api-access-lthhz\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr\" (UID: \"a7a106b6-c6a8-41d3-bddc-81ef5957d347\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.339595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.339560 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" Jul 29 18:38:38.350040 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.350013 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:38.362728 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.362695 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-9fr66"] Jul 29 18:38:38.366527 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:38.366500 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaac7f5f_9511_42aa_a6c6_2182484fa94a.slice/crio-d59d23d6b63599b8098f4690439f00685014b6c9ec0618e467922e023813be81 WatchSource:0}: Error finding container d59d23d6b63599b8098f4690439f00685014b6c9ec0618e467922e023813be81: Status 404 returned error can't find the container with id d59d23d6b63599b8098f4690439f00685014b6c9ec0618e467922e023813be81 Jul 29 18:38:38.470207 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.470113 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr"] Jul 29 18:38:38.472708 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:38.472669 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a106b6_c6a8_41d3_bddc_81ef5957d347.slice/crio-3d077926aac278f0f75e34b74a349dc65041fceedc03936937af8cfedc984322 WatchSource:0}: Error finding container 3d077926aac278f0f75e34b74a349dc65041fceedc03936937af8cfedc984322: Status 404 returned error can't find the container with id 3d077926aac278f0f75e34b74a349dc65041fceedc03936937af8cfedc984322 Jul 29 18:38:38.489182 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.489114 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-x88fj"] Jul 29 18:38:38.492233 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:38.492208 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c522834_ecea_4bb7_9fda_02b5ed021bf9.slice/crio-3c644f3bba5e0402b8eb0b26915427c5b76f5131c32a407db012ebcc036db2b8 WatchSource:0}: Error finding container 3c644f3bba5e0402b8eb0b26915427c5b76f5131c32a407db012ebcc036db2b8: Status 404 returned error can't find the container with id 3c644f3bba5e0402b8eb0b26915427c5b76f5131c32a407db012ebcc036db2b8 Jul 29 18:38:38.711765 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.711727 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" event={"ID":"6c522834-ecea-4bb7-9fda-02b5ed021bf9","Type":"ContainerStarted","Data":"3c644f3bba5e0402b8eb0b26915427c5b76f5131c32a407db012ebcc036db2b8"} Jul 29 18:38:38.712879 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.712854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" event={"ID":"a7a106b6-c6a8-41d3-bddc-81ef5957d347","Type":"ContainerStarted","Data":"3d077926aac278f0f75e34b74a349dc65041fceedc03936937af8cfedc984322"} Jul 29 18:38:38.713806 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.713787 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9fr66" event={"ID":"aaac7f5f-9511-42aa-a6c6-2182484fa94a","Type":"ContainerStarted","Data":"d59d23d6b63599b8098f4690439f00685014b6c9ec0618e467922e023813be81"} Jul 29 18:38:38.771068 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.770984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.771068 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.771035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:38.771068 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:38.771062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:38.771324 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.771141 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 18:38:38.771324 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.771154 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:39.771135751 +0000 UTC m=+266.438352929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : configmap references non-existent config key: service-ca.crt Jul 29 18:38:38.771324 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.771168 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:38:38.771324 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.771182 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784768f84-cv8d6: secret "image-registry-tls" not found Jul 29 18:38:38.771324 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.771189 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:39.771177348 +0000 UTC m=+266.438394527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : secret "router-metrics-certs-default" not found Jul 29 18:38:38.771324 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:38.771226 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls podName:33e2697f-bbe0-4b27-b682-bda01034cc8b nodeName:}" failed. No retries permitted until 2026-07-29 18:38:39.771212244 +0000 UTC m=+266.438429422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls") pod "image-registry-784768f84-cv8d6" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b") : secret "image-registry-tls" not found Jul 29 18:38:39.781740 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:39.781698 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:39.781758 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:39.781787 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:39.781919 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:39.781935 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784768f84-cv8d6: secret "image-registry-tls" not found Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:39.781996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls podName:33e2697f-bbe0-4b27-b682-bda01034cc8b nodeName:}" failed. No retries permitted until 2026-07-29 18:38:41.781974633 +0000 UTC m=+268.449191811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls") pod "image-registry-784768f84-cv8d6" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b") : secret "image-registry-tls" not found Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:39.782076 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:41.782065732 +0000 UTC m=+268.449282910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : configmap references non-existent config key: service-ca.crt Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:39.782137 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 18:38:39.782233 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:39.782166 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:41.782157111 +0000 UTC m=+268.449374289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : secret "router-metrics-certs-default" not found Jul 29 18:38:41.800503 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:41.800477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:41.800522 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:41.800539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:41.800658 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:41.800672 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784768f84-cv8d6: secret "image-registry-tls" not found Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:41.800653 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:41.800697 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:45.800672029 +0000 UTC m=+272.467889230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : configmap references non-existent config key: service-ca.crt Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:41.800734 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls podName:33e2697f-bbe0-4b27-b682-bda01034cc8b nodeName:}" failed. No retries permitted until 2026-07-29 18:38:45.800720813 +0000 UTC m=+272.467937991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls") pod "image-registry-784768f84-cv8d6" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b") : secret "image-registry-tls" not found Jul 29 18:38:41.800774 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:41.800748 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:45.800740634 +0000 UTC m=+272.467957814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : secret "router-metrics-certs-default" not found Jul 29 18:38:42.727337 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.727279 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/0.log" Jul 29 18:38:42.727530 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.727353 2573 generic.go:356] "Generic (PLEG): container finished" podID="6c522834-ecea-4bb7-9fda-02b5ed021bf9" containerID="7dd0e102b7f4340accf75808b899cdb0f5c7c475c133c95f440d262bc324273c" exitCode=255 Jul 29 18:38:42.727530 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.727431 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" event={"ID":"6c522834-ecea-4bb7-9fda-02b5ed021bf9","Type":"ContainerDied","Data":"7dd0e102b7f4340accf75808b899cdb0f5c7c475c133c95f440d262bc324273c"} Jul 29 18:38:42.727706 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.727691 2573 scope.go:117] "RemoveContainer" containerID="7dd0e102b7f4340accf75808b899cdb0f5c7c475c133c95f440d262bc324273c" Jul 29 18:38:42.728983 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.728954 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" event={"ID":"a7a106b6-c6a8-41d3-bddc-81ef5957d347","Type":"ContainerStarted","Data":"1ad23fc2bbc401db8c7b7067000e07c82aa7d4075b5442c5f96e3cb3486f0293"} Jul 29 18:38:42.730393 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.730370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9fr66" event={"ID":"aaac7f5f-9511-42aa-a6c6-2182484fa94a","Type":"ContainerStarted","Data":"e4789a5c39ad09463c6c7815449fdc448bee8a2389277b6423c71c528f62a4a0"} Jul 29 18:38:42.751247 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.751218 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj"] Jul 29 18:38:42.755749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.755722 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" Jul 29 18:38:42.758568 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.758540 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 18:38:42.758802 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.758719 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 18:38:42.759245 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.759227 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jwxmk\"" Jul 29 18:38:42.764971 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.764949 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj"] Jul 29 18:38:42.775348 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.775270 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-9fr66" podStartSLOduration=2.381496266 podStartE2EDuration="5.775248621s" totalImagesPullingTime="3.393752355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:42.773435584 +0000 UTC m=+269.440652785" watchObservedRunningTime="2026-07-29 18:38:42.775248621 +0000 UTC m=+269.442465822" Jul 29 18:38:42.811348 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.811264 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" podStartSLOduration=1.525939634 podStartE2EDuration="4.811240218s" totalImagesPullingTime="3.285300584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:42.794817568 +0000 UTC m=+269.462034769" watchObservedRunningTime="2026-07-29 18:38:42.811240218 +0000 UTC m=+269.478457421" Jul 29 18:38:42.910664 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:42.910623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnp9l\" (UniqueName: \"kubernetes.io/projected/98d6cdcb-041b-4f75-9466-00ccf7db044b-kube-api-access-vnp9l\") pod \"migrator-6865c9967-rqlxj\" (UID: \"98d6cdcb-041b-4f75-9466-00ccf7db044b\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" Jul 29 18:38:43.011463 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.011364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnp9l\" (UniqueName: \"kubernetes.io/projected/98d6cdcb-041b-4f75-9466-00ccf7db044b-kube-api-access-vnp9l\") pod \"migrator-6865c9967-rqlxj\" (UID: \"98d6cdcb-041b-4f75-9466-00ccf7db044b\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" Jul 29 18:38:43.022536 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.022505 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnp9l\" (UniqueName: \"kubernetes.io/projected/98d6cdcb-041b-4f75-9466-00ccf7db044b-kube-api-access-vnp9l\") pod \"migrator-6865c9967-rqlxj\" (UID: \"98d6cdcb-041b-4f75-9466-00ccf7db044b\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" Jul 29 18:38:43.085185 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.085154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" Jul 29 18:38:43.139412 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.139309 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w265z"] Jul 29 18:38:43.145947 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.145912 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.154140 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.153660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 18:38:43.154140 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.154025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 18:38:43.155427 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.155019 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w265z"] Jul 29 18:38:43.157263 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.157088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwk2w\"" Jul 29 18:38:43.239180 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.239150 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj"] Jul 29 18:38:43.242055 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:43.242029 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d6cdcb_041b_4f75_9466_00ccf7db044b.slice/crio-9a807fb287e804f253bfe63c014dee6728dc8edf44f10a5f336677e7c50d5281 WatchSource:0}: Error finding container 9a807fb287e804f253bfe63c014dee6728dc8edf44f10a5f336677e7c50d5281: Status 404 returned error can't find the container with id 9a807fb287e804f253bfe63c014dee6728dc8edf44f10a5f336677e7c50d5281 Jul 29 18:38:43.314119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.314025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.314119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.314085 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqvmk\" (UniqueName: \"kubernetes.io/projected/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-api-access-dqvmk\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.314326 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.314155 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.314326 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.314234 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/597c4525-685a-44e0-82e4-c5b5f3ece064-data-volume\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.314326 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.314267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/597c4525-685a-44e0-82e4-c5b5f3ece064-crio-socket\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415409 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/597c4525-685a-44e0-82e4-c5b5f3ece064-data-volume\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415576 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/597c4525-685a-44e0-82e4-c5b5f3ece064-crio-socket\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415576 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415495 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415576 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqvmk\" (UniqueName: \"kubernetes.io/projected/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-api-access-dqvmk\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415705 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415705 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415576 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/597c4525-685a-44e0-82e4-c5b5f3ece064-crio-socket\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.415705 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.415654 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:43.415705 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.415670 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.415835 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.415710 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:43.915695185 +0000 UTC m=+270.582912363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : configmap "kube-rbac-proxy" not found Jul 29 18:38:43.415835 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.415724 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:43.915717613 +0000 UTC m=+270.582934791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.415835 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.415791 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/597c4525-685a-44e0-82e4-c5b5f3ece064-data-volume\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.425767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.425739 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqvmk\" (UniqueName: \"kubernetes.io/projected/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-api-access-dqvmk\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.736822 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.736785 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" event={"ID":"98d6cdcb-041b-4f75-9466-00ccf7db044b","Type":"ContainerStarted","Data":"9a807fb287e804f253bfe63c014dee6728dc8edf44f10a5f336677e7c50d5281"} Jul 29 18:38:43.738187 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.738164 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:38:43.738624 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.738609 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/0.log" Jul 29 18:38:43.738685 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.738646 2573 generic.go:356] "Generic (PLEG): container finished" podID="6c522834-ecea-4bb7-9fda-02b5ed021bf9" containerID="dc4407b3e20d1a2a92a96dae35885c95036a79dafed0e3c75a8f40c27002962c" exitCode=255 Jul 29 18:38:43.738739 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.738723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" event={"ID":"6c522834-ecea-4bb7-9fda-02b5ed021bf9","Type":"ContainerDied","Data":"dc4407b3e20d1a2a92a96dae35885c95036a79dafed0e3c75a8f40c27002962c"} Jul 29 18:38:43.738784 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.738772 2573 scope.go:117] "RemoveContainer" containerID="7dd0e102b7f4340accf75808b899cdb0f5c7c475c133c95f440d262bc324273c" Jul 29 18:38:43.738990 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.738967 2573 scope.go:117] "RemoveContainer" containerID="dc4407b3e20d1a2a92a96dae35885c95036a79dafed0e3c75a8f40c27002962c" Jul 29 18:38:43.739171 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.739153 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-x88fj_openshift-console-operator(6c522834-ecea-4bb7-9fda-02b5ed021bf9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" podUID="6c522834-ecea-4bb7-9fda-02b5ed021bf9" Jul 29 18:38:43.920487 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.920452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.920867 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:43.920513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:43.920867 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.920580 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:43.920867 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.920593 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:43.920867 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.920632 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:44.920618766 +0000 UTC m=+271.587835944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : configmap "kube-rbac-proxy" not found Jul 29 18:38:43.920867 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:43.920655 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:44.920639592 +0000 UTC m=+271.587856769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:44.743108 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.743074 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" event={"ID":"98d6cdcb-041b-4f75-9466-00ccf7db044b","Type":"ContainerStarted","Data":"c9c8f4ea68c65ccd8287de0880b4f29ab9187d05d9ffbf16063dbe38278517d3"} Jul 29 18:38:44.743314 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.743171 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" event={"ID":"98d6cdcb-041b-4f75-9466-00ccf7db044b","Type":"ContainerStarted","Data":"7ca336a2fff95467d29ec7c1e04330518287d12323df4c8733a2ed6ae706671e"} Jul 29 18:38:44.744459 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.744439 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:38:44.744734 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.744717 2573 scope.go:117] "RemoveContainer" containerID="dc4407b3e20d1a2a92a96dae35885c95036a79dafed0e3c75a8f40c27002962c" Jul 29 18:38:44.744901 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:44.744881 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-x88fj_openshift-console-operator(6c522834-ecea-4bb7-9fda-02b5ed021bf9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" podUID="6c522834-ecea-4bb7-9fda-02b5ed021bf9" Jul 29 18:38:44.772053 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.772004 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-rqlxj" podStartSLOduration=1.410064051 podStartE2EDuration="2.771989604s" totalImagesPullingTime="1.361925553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:44.770701362 +0000 UTC m=+271.437918562" watchObservedRunningTime="2026-07-29 18:38:44.771989604 +0000 UTC m=+271.439206826" Jul 29 18:38:44.929131 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.929080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:44.929595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:44.929174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:44.929595 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:44.929236 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:44.929595 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:44.929290 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:44.929595 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:44.929318 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:46.929286542 +0000 UTC m=+273.596503726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:44.929595 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:44.929370 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:46.929357012 +0000 UTC m=+273.596574190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : configmap "kube-rbac-proxy" not found Jul 29 18:38:45.836910 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:45.836873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:45.837067 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:45.836945 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:45.837067 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:45.836974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:45.837067 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:45.837010 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.836990195 +0000 UTC m=+280.504207379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : configmap references non-existent config key: service-ca.crt Jul 29 18:38:45.837067 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:45.837058 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 18:38:45.837067 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:45.837070 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-784768f84-cv8d6: secret "image-registry-tls" not found Jul 29 18:38:45.837267 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:45.837085 2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 18:38:45.837267 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:45.837108 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls podName:33e2697f-bbe0-4b27-b682-bda01034cc8b nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.837096629 +0000 UTC m=+280.504313807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls") pod "image-registry-784768f84-cv8d6" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b") : secret "image-registry-tls" not found Jul 29 18:38:45.837267 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:45.837140 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs podName:3b98f5b4-73f3-4bc8-b30e-b5791fe996da nodeName:}" failed. No retries permitted until 2026-07-29 18:38:53.837124144 +0000 UTC m=+280.504341389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs") pod "router-default-85d486cb67-p5rkk" (UID: "3b98f5b4-73f3-4bc8-b30e-b5791fe996da") : secret "router-metrics-certs-default" not found Jul 29 18:38:45.972090 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:45.972065 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nrk9h_be1d0114-c267-4858-843e-af59fea83565/dns-node-resolver/0.log" Jul 29 18:38:46.947156 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:46.947123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:46.947365 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:46.947239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:46.947365 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:46.947249 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:46.947365 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:46.947341 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:50.947319953 +0000 UTC m=+277.614537151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : configmap "kube-rbac-proxy" not found Jul 29 18:38:46.947514 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:46.947402 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:46.947514 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:46.947452 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:50.947439189 +0000 UTC m=+277.614656384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:46.974908 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:46.974880 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5rvc_f718b183-f469-4358-ac39-57cec88134b6/node-ca/0.log" Jul 29 18:38:47.754566 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:47.754533 2573 generic.go:356] "Generic (PLEG): container finished" podID="91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8" containerID="e24beb30ef5faf75f7ec389ef4064c34dfec7e522eebd94be73046e2dfec4dd0" exitCode=255 Jul 29 18:38:47.754741 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:47.754589 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" event={"ID":"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8","Type":"ContainerDied","Data":"e24beb30ef5faf75f7ec389ef4064c34dfec7e522eebd94be73046e2dfec4dd0"} Jul 29 18:38:47.760676 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:47.760655 2573 scope.go:117] "RemoveContainer" containerID="e24beb30ef5faf75f7ec389ef4064c34dfec7e522eebd94be73046e2dfec4dd0" Jul 29 18:38:47.773204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:47.773181 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j5clh_ee7d3668-cbc8-494a-8663-568d792ee2c0/serve-healthcheck-canary/0.log" Jul 29 18:38:48.173781 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.173699 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-rqlxj_98d6cdcb-041b-4f75-9466-00ccf7db044b/migrator/0.log" Jul 29 18:38:48.350588 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.350554 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:48.350765 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.350603 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:38:48.350957 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.350945 2573 scope.go:117] "RemoveContainer" containerID="dc4407b3e20d1a2a92a96dae35885c95036a79dafed0e3c75a8f40c27002962c" Jul 29 18:38:48.351111 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:48.351094 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-x88fj_openshift-console-operator(6c522834-ecea-4bb7-9fda-02b5ed021bf9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" podUID="6c522834-ecea-4bb7-9fda-02b5ed021bf9" Jul 29 18:38:48.375376 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.375347 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-rqlxj_98d6cdcb-041b-4f75-9466-00ccf7db044b/graceful-termination/0.log" Jul 29 18:38:48.575465 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.575384 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr_a7a106b6-c6a8-41d3-bddc-81ef5957d347/kube-storage-version-migrator-operator/0.log" Jul 29 18:38:48.758994 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:48.758960 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-794695848-pm98m" event={"ID":"91476e10-2e7d-40fe-acc8-d5ce7b9fa3f8","Type":"ContainerStarted","Data":"a264b4ce059e98b545504c8f1e8c72e5bc3f4666b23cc92c67560066245b1846"} Jul 29 18:38:50.981873 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:50.981836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:50.982285 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:50.981896 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:50.982285 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:50.981962 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 18:38:50.982285 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:50.981994 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 18:38:50.982285 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:50.982014 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:58.981999775 +0000 UTC m=+285.649216954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : configmap "kube-rbac-proxy" not found Jul 29 18:38:50.982285 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:50.982051 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls podName:597c4525-685a-44e0-82e4-c5b5f3ece064 nodeName:}" failed. No retries permitted until 2026-07-29 18:38:58.982037403 +0000 UTC m=+285.649254582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w265z" (UID: "597c4525-685a-44e0-82e4-c5b5f3ece064") : secret "insights-runtime-extractor-tls" not found Jul 29 18:38:53.904818 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.904770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:53.904818 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.904832 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:53.905249 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.904851 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:53.905431 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.905407 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-service-ca-bundle\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:53.907223 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.907201 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b98f5b4-73f3-4bc8-b30e-b5791fe996da-metrics-certs\") pod \"router-default-85d486cb67-p5rkk\" (UID: \"3b98f5b4-73f3-4bc8-b30e-b5791fe996da\") " pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:53.907350 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.907253 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"image-registry-784768f84-cv8d6\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:53.956893 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.956867 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:53.960873 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:53.960840 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:54.099181 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.099105 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-784768f84-cv8d6"] Jul 29 18:38:54.103008 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:54.102980 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e2697f_bbe0_4b27_b682_bda01034cc8b.slice/crio-021e032aca343d2a2480dad96b787454183f61eddb3e2947fd195941564eb3a8 WatchSource:0}: Error finding container 021e032aca343d2a2480dad96b787454183f61eddb3e2947fd195941564eb3a8: Status 404 returned error can't find the container with id 021e032aca343d2a2480dad96b787454183f61eddb3e2947fd195941564eb3a8 Jul 29 18:38:54.112669 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.112644 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d486cb67-p5rkk"] Jul 29 18:38:54.115697 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:54.115674 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b98f5b4_73f3_4bc8_b30e_b5791fe996da.slice/crio-e687c4ddc56fd6cbad460202dfdf2a79293090fc40e751bb3bcf74ec7e2f30e7 WatchSource:0}: Error finding container e687c4ddc56fd6cbad460202dfdf2a79293090fc40e751bb3bcf74ec7e2f30e7: Status 404 returned error can't find the container with id e687c4ddc56fd6cbad460202dfdf2a79293090fc40e751bb3bcf74ec7e2f30e7 Jul 29 18:38:54.777639 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.777599 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784768f84-cv8d6" event={"ID":"33e2697f-bbe0-4b27-b682-bda01034cc8b","Type":"ContainerStarted","Data":"94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742"} Jul 29 18:38:54.777843 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.777656 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784768f84-cv8d6" event={"ID":"33e2697f-bbe0-4b27-b682-bda01034cc8b","Type":"ContainerStarted","Data":"021e032aca343d2a2480dad96b787454183f61eddb3e2947fd195941564eb3a8"} Jul 29 18:38:54.777843 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.777682 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:38:54.779070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.779046 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d486cb67-p5rkk" event={"ID":"3b98f5b4-73f3-4bc8-b30e-b5791fe996da","Type":"ContainerStarted","Data":"6535fdec4d1abd2e0be46f47f8cfd265beeeacb7e912a84c2364c915662a6678"} Jul 29 18:38:54.779167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.779083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d486cb67-p5rkk" event={"ID":"3b98f5b4-73f3-4bc8-b30e-b5791fe996da","Type":"ContainerStarted","Data":"e687c4ddc56fd6cbad460202dfdf2a79293090fc40e751bb3bcf74ec7e2f30e7"} Jul 29 18:38:54.799464 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.799410 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-784768f84-cv8d6" podStartSLOduration=16.799394249 podStartE2EDuration="16.799394249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:54.797853869 +0000 UTC m=+281.465071071" watchObservedRunningTime="2026-07-29 18:38:54.799394249 +0000 UTC m=+281.466611484" Jul 29 18:38:54.816764 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.816718 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85d486cb67-p5rkk" podStartSLOduration=16.816703134 podStartE2EDuration="16.816703134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:38:54.815712686 +0000 UTC m=+281.482929887" watchObservedRunningTime="2026-07-29 18:38:54.816703134 +0000 UTC m=+281.483920333" Jul 29 18:38:54.958039 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.958004 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:54.961988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:54.961961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:55.465234 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:38:55.465196 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2tpsg" podUID="96f1c45a-418c-47c9-9dc4-c1a63c6f1927" Jul 29 18:38:55.782109 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:55.782020 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2tpsg" Jul 29 18:38:55.782463 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:55.782407 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:55.783406 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:55.783388 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85d486cb67-p5rkk" Jul 29 18:38:58.641811 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:58.641766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:38:58.644140 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:58.644115 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96f1c45a-418c-47c9-9dc4-c1a63c6f1927-metrics-tls\") pod \"dns-default-2tpsg\" (UID: \"96f1c45a-418c-47c9-9dc4-c1a63c6f1927\") " pod="openshift-dns/dns-default-2tpsg" Jul 29 18:38:58.786637 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:58.786604 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zfgsf\"" Jul 29 18:38:58.794065 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:58.794039 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2tpsg" Jul 29 18:38:58.938758 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:58.938738 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2tpsg"] Jul 29 18:38:58.941182 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:58.941157 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f1c45a_418c_47c9_9dc4_c1a63c6f1927.slice/crio-249f12ccf0881d2a1120859ad922a870d2bfa4960c1f18a384caf5aa7e745846 WatchSource:0}: Error finding container 249f12ccf0881d2a1120859ad922a870d2bfa4960c1f18a384caf5aa7e745846: Status 404 returned error can't find the container with id 249f12ccf0881d2a1120859ad922a870d2bfa4960c1f18a384caf5aa7e745846 Jul 29 18:38:59.045177 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.045140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:59.045354 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.045187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:59.045678 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.045653 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/597c4525-685a-44e0-82e4-c5b5f3ece064-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:59.047435 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.047419 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/597c4525-685a-44e0-82e4-c5b5f3ece064-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w265z\" (UID: \"597c4525-685a-44e0-82e4-c5b5f3ece064\") " pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:59.065563 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.065537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w265z" Jul 29 18:38:59.194381 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.194306 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w265z"] Jul 29 18:38:59.197172 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:38:59.197149 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597c4525_685a_44e0_82e4_c5b5f3ece064.slice/crio-8e63bf5e5fa5acfb640e1340fa433d2a5266d7de9f81b2a69934122484ece70d WatchSource:0}: Error finding container 8e63bf5e5fa5acfb640e1340fa433d2a5266d7de9f81b2a69934122484ece70d: Status 404 returned error can't find the container with id 8e63bf5e5fa5acfb640e1340fa433d2a5266d7de9f81b2a69934122484ece70d Jul 29 18:38:59.798063 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.798025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2tpsg" event={"ID":"96f1c45a-418c-47c9-9dc4-c1a63c6f1927","Type":"ContainerStarted","Data":"249f12ccf0881d2a1120859ad922a870d2bfa4960c1f18a384caf5aa7e745846"} Jul 29 18:38:59.799735 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:38:59.799707 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w265z" event={"ID":"597c4525-685a-44e0-82e4-c5b5f3ece064","Type":"ContainerStarted","Data":"8e63bf5e5fa5acfb640e1340fa433d2a5266d7de9f81b2a69934122484ece70d"} Jul 29 18:39:00.806026 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:00.806002 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2tpsg" event={"ID":"96f1c45a-418c-47c9-9dc4-c1a63c6f1927","Type":"ContainerStarted","Data":"0e8273c356fb41b30b054caa4907be1b433e75a9e61132ba5925e8c037421a67"} Jul 29 18:39:01.812010 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:01.811972 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2tpsg" event={"ID":"96f1c45a-418c-47c9-9dc4-c1a63c6f1927","Type":"ContainerStarted","Data":"cb3720b3a2fc6644d5ec89c1d952a39e97c57154ef0769758e718f165bd53e48"} Jul 29 18:39:01.812473 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:01.812082 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2tpsg" Jul 29 18:39:01.833802 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:01.833742 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2tpsg" podStartSLOduration=252.142226162 podStartE2EDuration="4m13.833722811s" totalImagesPullingTime="1.691496649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:01.833229614 +0000 UTC m=+288.500446815" watchObservedRunningTime="2026-07-29 18:39:01.833722811 +0000 UTC m=+288.500940010" Jul 29 18:39:01.956891 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:01.956864 2573 scope.go:117] "RemoveContainer" containerID="dc4407b3e20d1a2a92a96dae35885c95036a79dafed0e3c75a8f40c27002962c" Jul 29 18:39:04.825569 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:04.825532 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w265z" event={"ID":"597c4525-685a-44e0-82e4-c5b5f3ece064","Type":"ContainerStarted","Data":"60735ba4ac8acf7fd22dab1b4ffff3bacb34aa90f6ff2ff8ae3f9021024962c5"} Jul 29 18:39:04.827142 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:04.827122 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:39:04.827249 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:04.827166 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" event={"ID":"6c522834-ecea-4bb7-9fda-02b5ed021bf9","Type":"ContainerStarted","Data":"9ed916253457f1e01c2c437e7303c68127f66c76aeed2258aee01fbd9f62f8b1"} Jul 29 18:39:04.827467 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:04.827448 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:39:04.846108 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:04.846050 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" podStartSLOduration=23.575157819 podStartE2EDuration="26.84603342s" totalImagesPullingTime="3.270875601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:04.84558817 +0000 UTC m=+291.512805408" watchObservedRunningTime="2026-07-29 18:39:04.84603342 +0000 UTC m=+291.513250622" Jul 29 18:39:05.107135 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:05.107034 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-x88fj" Jul 29 18:39:05.880078 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:05.880045 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-784768f84-cv8d6"] Jul 29 18:39:08.843837 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:08.843799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w265z" event={"ID":"597c4525-685a-44e0-82e4-c5b5f3ece064","Type":"ContainerStarted","Data":"42c816e633f9178395e4daf4ebb3260edbef3684dd5fcd75378042397ba8152a"} Jul 29 18:39:08.952499 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:08.952447 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-x6szn" podUID="224a45b3-ef7f-4a80-877f-8c41a61be9a2" Jul 29 18:39:11.818275 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:11.818247 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2tpsg" Jul 29 18:39:11.856332 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:11.856278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w265z" event={"ID":"597c4525-685a-44e0-82e4-c5b5f3ece064","Type":"ContainerStarted","Data":"7e8e17c3360833da401686ff06ba653a882214eaa6a3d617582b4152c9a28066"} Jul 29 18:39:11.877197 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:11.877143 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w265z" podStartSLOduration=16.467447056 podStartE2EDuration="28.877126503s" totalImagesPullingTime="12.409679447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:38:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:11.87552003 +0000 UTC m=+298.542737232" watchObservedRunningTime="2026-07-29 18:39:11.877126503 +0000 UTC m=+298.544343727" Jul 29 18:39:13.610189 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.610157 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b5fddc6cc-kfdc2"] Jul 29 18:39:13.613119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.613101 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.615986 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.615955 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 18:39:13.615986 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.615987 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 18:39:13.617362 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.617344 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 18:39:13.617522 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.617505 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gbs6\"" Jul 29 18:39:13.617605 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.617589 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 18:39:13.617672 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.617613 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 18:39:13.617777 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.617709 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 18:39:13.617867 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.617850 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 18:39:13.622920 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.622900 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5fddc6cc-kfdc2"] Jul 29 18:39:13.674207 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.674175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-console-config\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.674390 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.674217 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-serving-cert\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.674390 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.674239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-service-ca\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.674390 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.674265 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-oauth-config\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.674390 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.674325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg7x\" (UniqueName: \"kubernetes.io/projected/8ed3f4f7-2685-4753-9733-f52d453149a4-kube-api-access-6pg7x\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.674390 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.674385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-oauth-serving-cert\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.748236 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.748212 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:39:13.748236 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.748224 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:39:13.760041 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.760017 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 18:39:13.775656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.775620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg7x\" (UniqueName: \"kubernetes.io/projected/8ed3f4f7-2685-4753-9733-f52d453149a4-kube-api-access-6pg7x\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.775836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.775667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-oauth-serving-cert\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.775836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.775701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-console-config\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.775836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.775731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-serving-cert\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.775836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.775751 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-service-ca\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.775836 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.775768 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-oauth-config\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.778735 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.778712 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 18:39:13.778852 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.778712 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 18:39:13.778961 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.778945 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 18:39:13.779022 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.778959 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 18:39:13.779022 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.778977 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 18:39:13.785696 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.785681 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 18:39:13.787374 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.787348 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-console-config\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.787480 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.787380 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-service-ca\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.787480 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.787354 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-oauth-serving-cert\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.789033 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.789013 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-serving-cert\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.789118 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.789073 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-oauth-config\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.797374 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.797357 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 18:39:13.805954 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.805928 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg7x\" (UniqueName: \"kubernetes.io/projected/8ed3f4f7-2685-4753-9733-f52d453149a4-kube-api-access-6pg7x\") pod \"console-5b5fddc6cc-kfdc2\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:13.933923 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.933775 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4gbs6\"" Jul 29 18:39:13.943733 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:13.943372 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:14.073855 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:14.073814 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b5fddc6cc-kfdc2"] Jul 29 18:39:14.076526 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:39:14.076500 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed3f4f7_2685_4753_9733_f52d453149a4.slice/crio-c475c0c6c2110ef1ace7be84ebfe935c63d669dfeaae49337998f6096cc4b40b WatchSource:0}: Error finding container c475c0c6c2110ef1ace7be84ebfe935c63d669dfeaae49337998f6096cc4b40b: Status 404 returned error can't find the container with id c475c0c6c2110ef1ace7be84ebfe935c63d669dfeaae49337998f6096cc4b40b Jul 29 18:39:14.869015 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:14.868979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5fddc6cc-kfdc2" event={"ID":"8ed3f4f7-2685-4753-9733-f52d453149a4","Type":"ContainerStarted","Data":"c475c0c6c2110ef1ace7be84ebfe935c63d669dfeaae49337998f6096cc4b40b"} Jul 29 18:39:15.886132 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:15.886108 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:39:17.271909 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.271874 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99"] Jul 29 18:39:17.284065 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.284043 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mr2bh"] Jul 29 18:39:17.284196 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.284179 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.288418 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.288221 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 18:39:17.288418 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.288270 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 18:39:17.288645 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.288619 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 18:39:17.289663 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.289644 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 18:39:17.290430 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.289958 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-t4skz\"" Jul 29 18:39:17.290521 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.289983 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 18:39:17.290521 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.290028 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 18:39:17.298595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.298572 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.298758 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.298658 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99"] Jul 29 18:39:17.301420 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.301399 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 18:39:17.301864 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.301844 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 18:39:17.302123 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.302107 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l79db\"" Jul 29 18:39:17.302208 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.302135 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 18:39:17.407971 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.407931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.407971 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.407970 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408168 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.408168 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408047 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eabad1e-8c0a-4794-86ae-450b7a75633e-metrics-client-ca\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408168 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7bph\" (UniqueName: \"kubernetes.io/projected/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-api-access-k7bph\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.408168 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408106 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-sys\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408168 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-wtmp\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408168 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-textfile\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408372 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408228 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.408372 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.408372 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw4mn\" (UniqueName: \"kubernetes.io/projected/7eabad1e-8c0a-4794-86ae-450b7a75633e-kube-api-access-vw4mn\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408372 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-tls\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408372 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-root\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408546 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408385 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.408546 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.408449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.509751 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509721 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7bph\" (UniqueName: \"kubernetes.io/projected/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-api-access-k7bph\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.509887 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-sys\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.509887 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509773 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-wtmp\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.509887 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509839 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-sys\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.509887 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509874 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-textfile\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509901 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw4mn\" (UniqueName: \"kubernetes.io/projected/7eabad1e-8c0a-4794-86ae-450b7a75633e-kube-api-access-vw4mn\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509961 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-wtmp\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.509987 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-tls\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-root\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510086 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510087 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7eabad1e-8c0a-4794-86ae-450b7a75633e-root\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:17.510169 2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:17.510225 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-tls podName:053e37d2-070c-49e3-a5cb-1ca6296cf1d6 nodeName:}" failed. No retries permitted until 2026-07-29 18:39:18.010206651 +0000 UTC m=+304.677423834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-xmn99" (UID: "053e37d2-070c-49e3-a5cb-1ca6296cf1d6") : secret "kube-state-metrics-tls" not found Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510341 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eabad1e-8c0a-4794-86ae-450b7a75633e-metrics-client-ca\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510342 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-textfile\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.510454 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510353 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.510958 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.510859 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.511051 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.511026 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7eabad1e-8c0a-4794-86ae-450b7a75633e-metrics-client-ca\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.511099 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.511049 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.511099 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.511080 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.512467 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.512441 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-tls\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.513160 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.513139 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7eabad1e-8c0a-4794-86ae-450b7a75633e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.513237 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.513164 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.523050 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.523020 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7bph\" (UniqueName: \"kubernetes.io/projected/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-api-access-k7bph\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:17.523235 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.523215 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw4mn\" (UniqueName: \"kubernetes.io/projected/7eabad1e-8c0a-4794-86ae-450b7a75633e-kube-api-access-vw4mn\") pod \"node-exporter-mr2bh\" (UID: \"7eabad1e-8c0a-4794-86ae-450b7a75633e\") " pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.609122 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.609082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mr2bh" Jul 29 18:39:17.657500 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:39:17.657464 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eabad1e_8c0a_4794_86ae_450b7a75633e.slice/crio-61d8d539a5932b0c2f0fda77eb70eecba1ba47f843dce54a0bce756c9d71f343 WatchSource:0}: Error finding container 61d8d539a5932b0c2f0fda77eb70eecba1ba47f843dce54a0bce756c9d71f343: Status 404 returned error can't find the container with id 61d8d539a5932b0c2f0fda77eb70eecba1ba47f843dce54a0bce756c9d71f343 Jul 29 18:39:17.659286 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.659268 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:39:17.880490 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.880406 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5fddc6cc-kfdc2" event={"ID":"8ed3f4f7-2685-4753-9733-f52d453149a4","Type":"ContainerStarted","Data":"b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735"} Jul 29 18:39:17.883426 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.883390 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2bh" event={"ID":"7eabad1e-8c0a-4794-86ae-450b7a75633e","Type":"ContainerStarted","Data":"61d8d539a5932b0c2f0fda77eb70eecba1ba47f843dce54a0bce756c9d71f343"} Jul 29 18:39:17.900394 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:17.900350 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b5fddc6cc-kfdc2" podStartSLOduration=1.5461385829999998 podStartE2EDuration="4.900331984s" totalImagesPullingTime="3.354193401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:17.899669938 +0000 UTC m=+304.566887138" watchObservedRunningTime="2026-07-29 18:39:17.900331984 +0000 UTC m=+304.567549183" Jul 29 18:39:18.014568 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.014515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:18.016975 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.016951 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/053e37d2-070c-49e3-a5cb-1ca6296cf1d6-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-xmn99\" (UID: \"053e37d2-070c-49e3-a5cb-1ca6296cf1d6\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:18.196041 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.196005 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" Jul 29 18:39:18.313999 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.313966 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:39:18.346963 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.346933 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:39:18.347158 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.347124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.350506 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.350407 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 18:39:18.350645 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.350536 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 18:39:18.350968 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.350948 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 18:39:18.351245 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.350979 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 18:39:18.351245 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.350997 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 18:39:18.351245 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.351005 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 18:39:18.351245 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.351173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 18:39:18.351245 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.351205 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 18:39:18.351564 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.351479 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vngct\"" Jul 29 18:39:18.351699 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.351680 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 18:39:18.370762 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.370663 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99"] Jul 29 18:39:18.373510 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:39:18.373486 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053e37d2_070c_49e3_a5cb_1ca6296cf1d6.slice/crio-b9c4d8d8e0471b1c4627102a233bbc7670e26fdee29854057637754b52ba042d WatchSource:0}: Error finding container b9c4d8d8e0471b1c4627102a233bbc7670e26fdee29854057637754b52ba042d: Status 404 returned error can't find the container with id b9c4d8d8e0471b1c4627102a233bbc7670e26fdee29854057637754b52ba042d Jul 29 18:39:18.416698 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.416854 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.416854 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.416854 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.416959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416890 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-web-config\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.416959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416924 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.416959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416950 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.417080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.416979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.417080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.417000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.417080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.417015 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.417080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.417029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xsw5\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-kube-api-access-8xsw5\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.417080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.417055 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-out\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.417080 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.417076 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.517871 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.517781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.517871 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.517815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.517871 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.517850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-web-config\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518121 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518121 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518039 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518121 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518072 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518121 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518121 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518400 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:18.518134 2573 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 18:39:18.518400 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:18.518203 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls podName:b65a29d1-8dd0-4cee-a377-ee247c81d0f7 nodeName:}" failed. No retries permitted until 2026-07-29 18:39:19.018181803 +0000 UTC m=+305.685398998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7") : secret "alertmanager-main-tls" not found Jul 29 18:39:18.518400 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518139 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xsw5\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-kube-api-access-8xsw5\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518400 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-out\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518400 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518405 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.518656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.518438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.519265 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.519189 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.519757 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.519477 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.519757 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.519728 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.521098 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.521076 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.521331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.521309 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-out\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.521412 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.521337 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-web-config\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.521472 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.521442 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-volume\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.522006 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.521981 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.522098 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.522079 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.522098 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.522084 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.522846 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.522832 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.537692 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.537668 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xsw5\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-kube-api-access-8xsw5\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:18.887978 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:18.887947 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" event={"ID":"053e37d2-070c-49e3-a5cb-1ca6296cf1d6","Type":"ContainerStarted","Data":"b9c4d8d8e0471b1c4627102a233bbc7670e26fdee29854057637754b52ba042d"} Jul 29 18:39:19.022413 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.022378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:19.024737 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.024714 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:19.259356 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.259286 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:39:19.436717 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.435388 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:39:19.439782 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:39:19.439754 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65a29d1_8dd0_4cee_a377_ee247c81d0f7.slice/crio-a02daf37ba779d98dd78ba806f2f9f9189a952bd21c75c6eba6091353409831f WatchSource:0}: Error finding container a02daf37ba779d98dd78ba806f2f9f9189a952bd21c75c6eba6091353409831f: Status 404 returned error can't find the container with id a02daf37ba779d98dd78ba806f2f9f9189a952bd21c75c6eba6091353409831f Jul 29 18:39:19.892756 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.892717 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"a02daf37ba779d98dd78ba806f2f9f9189a952bd21c75c6eba6091353409831f"} Jul 29 18:39:19.894677 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.894650 2573 generic.go:356] "Generic (PLEG): container finished" podID="7eabad1e-8c0a-4794-86ae-450b7a75633e" containerID="ed809dd96e8da8c8776cb78f4bab0696e5b8a0b77cc3739ac66c69e104078760" exitCode=0 Jul 29 18:39:19.894822 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:19.894716 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2bh" event={"ID":"7eabad1e-8c0a-4794-86ae-450b7a75633e","Type":"ContainerDied","Data":"ed809dd96e8da8c8776cb78f4bab0696e5b8a0b77cc3739ac66c69e104078760"} Jul 29 18:39:20.900533 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.900499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2bh" event={"ID":"7eabad1e-8c0a-4794-86ae-450b7a75633e","Type":"ContainerStarted","Data":"62e2018e72c032e894643918902aebe8d0d07b22bcd91323d16004225fee3754"} Jul 29 18:39:20.901002 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.900561 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2bh" event={"ID":"7eabad1e-8c0a-4794-86ae-450b7a75633e","Type":"ContainerStarted","Data":"2b5196c922f6bff5ad16c93613cb2e6d2a129f070dfd89ad3465ff0fc548179d"} Jul 29 18:39:20.902669 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.902637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" event={"ID":"053e37d2-070c-49e3-a5cb-1ca6296cf1d6","Type":"ContainerStarted","Data":"ca413862f5c7189e672e7098a1274e8fb4c218514bef47129018c1d5894b6167"} Jul 29 18:39:20.902784 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.902685 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" event={"ID":"053e37d2-070c-49e3-a5cb-1ca6296cf1d6","Type":"ContainerStarted","Data":"badfa394c0d7f44f504a6853ea9ea712c77017e6c6e1afd2eaab02a10e38df16"} Jul 29 18:39:20.902784 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.902708 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" event={"ID":"053e37d2-070c-49e3-a5cb-1ca6296cf1d6","Type":"ContainerStarted","Data":"7f7d8314a49d229b43136330acd35307424bbb917767c582368f6743cdd978ee"} Jul 29 18:39:20.949029 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.948965 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mr2bh" podStartSLOduration=2.355714527 podStartE2EDuration="3.94894754s" totalImagesPullingTime="1.480753331s" totalInitContainerRuntime="112.479682ms" isStatefulPod=true podCreationTimestamp="2026-07-29 18:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:20.948413547 +0000 UTC m=+307.615630751" watchObservedRunningTime="2026-07-29 18:39:20.94894754 +0000 UTC m=+307.616164741" Jul 29 18:39:20.951954 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.951930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:39:20.982589 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:20.982535 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-xmn99" podStartSLOduration=1.87642279 podStartE2EDuration="3.982519021s" totalImagesPullingTime="2.106096231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:20.981219824 +0000 UTC m=+307.648437025" watchObservedRunningTime="2026-07-29 18:39:20.982519021 +0000 UTC m=+307.649736222" Jul 29 18:39:21.908330 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:21.908270 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd" exitCode=0 Jul 29 18:39:21.908787 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:21.908348 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd"} Jul 29 18:39:21.984459 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:21.984431 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5fddc6cc-kfdc2"] Jul 29 18:39:23.920400 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:23.920365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364"} Jul 29 18:39:23.920759 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:23.920458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad"} Jul 29 18:39:23.920759 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:23.920488 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387"} Jul 29 18:39:23.920759 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:23.920511 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955"} Jul 29 18:39:23.920759 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:23.920534 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258"} Jul 29 18:39:23.944432 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:23.944404 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:24.928187 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:24.928109 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerStarted","Data":"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623"} Jul 29 18:39:24.970654 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:24.970600 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.396084458 podStartE2EDuration="6.970567161s" totalImagesPullingTime="4.559706358s" totalInitContainerRuntime="14.776345ms" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:24.969912402 +0000 UTC m=+311.637129605" watchObservedRunningTime="2026-07-29 18:39:24.970567161 +0000 UTC m=+311.637784342" Jul 29 18:39:30.906230 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:30.906174 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-784768f84-cv8d6" podUID="33e2697f-bbe0-4b27-b682-bda01034cc8b" containerName="registry" containerID="cri-o://94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742" gracePeriod=30 Jul 29 18:39:31.151311 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.151265 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:39:31.233040 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.232963 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-certificates\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233040 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233000 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233040 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233022 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-trusted-ca\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233358 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233061 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcss9\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-kube-api-access-kcss9\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233358 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233081 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-image-registry-private-configuration\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233358 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233098 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-installation-pull-secrets\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233358 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233121 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-bound-sa-token\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233358 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233149 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33e2697f-bbe0-4b27-b682-bda01034cc8b-ca-trust-extracted\") pod \"33e2697f-bbe0-4b27-b682-bda01034cc8b\" (UID: \"33e2697f-bbe0-4b27-b682-bda01034cc8b\") " Jul 29 18:39:31.233619 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233439 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:31.233619 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.233453 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:31.235673 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.235629 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:31.235800 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.235751 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-kube-api-access-kcss9" (OuterVolumeSpecName: "kube-api-access-kcss9") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "kube-api-access-kcss9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:31.235800 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.235756 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:31.235913 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.235855 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:31.235913 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.235896 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:31.242380 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.242355 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33e2697f-bbe0-4b27-b682-bda01034cc8b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "33e2697f-bbe0-4b27-b682-bda01034cc8b" (UID: "33e2697f-bbe0-4b27-b682-bda01034cc8b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:39:31.334003 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.333966 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcss9\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-kube-api-access-kcss9\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334003 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.333995 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-image-registry-private-configuration\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334003 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.334006 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/33e2697f-bbe0-4b27-b682-bda01034cc8b-installation-pull-secrets\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334003 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.334015 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-bound-sa-token\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334267 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.334024 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/33e2697f-bbe0-4b27-b682-bda01034cc8b-ca-trust-extracted\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334267 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.334034 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-certificates\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334267 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.334042 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/33e2697f-bbe0-4b27-b682-bda01034cc8b-registry-tls\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.334267 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.334050 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/33e2697f-bbe0-4b27-b682-bda01034cc8b-trusted-ca\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:31.956716 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.956682 2573 generic.go:356] "Generic (PLEG): container finished" podID="33e2697f-bbe0-4b27-b682-bda01034cc8b" containerID="94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742" exitCode=0 Jul 29 18:39:31.957115 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.956762 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-784768f84-cv8d6" Jul 29 18:39:31.957335 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.957288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784768f84-cv8d6" event={"ID":"33e2697f-bbe0-4b27-b682-bda01034cc8b","Type":"ContainerDied","Data":"94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742"} Jul 29 18:39:31.957404 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.957351 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-784768f84-cv8d6" event={"ID":"33e2697f-bbe0-4b27-b682-bda01034cc8b","Type":"ContainerDied","Data":"021e032aca343d2a2480dad96b787454183f61eddb3e2947fd195941564eb3a8"} Jul 29 18:39:31.957404 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.957371 2573 scope.go:117] "RemoveContainer" containerID="94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742" Jul 29 18:39:31.966816 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.966799 2573 scope.go:117] "RemoveContainer" containerID="94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742" Jul 29 18:39:31.967108 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:31.967087 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742\": container with ID starting with 94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742 not found: ID does not exist" containerID="94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742" Jul 29 18:39:31.967162 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.967116 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742"} err="failed to get container status \"94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742\": rpc error: code = NotFound desc = could not find container \"94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742\": container with ID starting with 94b2f9101d4d57f5228a2592150487b1b4508cd6ce7ca4a0495d1a3c9ea4a742 not found: ID does not exist" Jul 29 18:39:31.981050 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.980973 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-784768f84-cv8d6"] Jul 29 18:39:31.984735 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:31.984714 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-784768f84-cv8d6"] Jul 29 18:39:33.956942 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:33.956910 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33e2697f-bbe0-4b27-b682-bda01034cc8b" path="/var/lib/kubelet/pods/33e2697f-bbe0-4b27-b682-bda01034cc8b/volumes" Jul 29 18:39:37.754063 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.754026 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f79d6f56-677gw"] Jul 29 18:39:37.754557 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.754466 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33e2697f-bbe0-4b27-b682-bda01034cc8b" containerName="registry" Jul 29 18:39:37.754557 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.754487 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="33e2697f-bbe0-4b27-b682-bda01034cc8b" containerName="registry" Jul 29 18:39:37.754557 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.754556 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="33e2697f-bbe0-4b27-b682-bda01034cc8b" containerName="registry" Jul 29 18:39:37.757537 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.757518 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.767163 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.767134 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 18:39:37.769978 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.769956 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f79d6f56-677gw"] Jul 29 18:39:37.884943 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.884895 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-config\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.885135 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.884958 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hd7l\" (UniqueName: \"kubernetes.io/projected/5c34decd-e74c-47ff-9dbc-b5e537da8436-kube-api-access-4hd7l\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.885135 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.885024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-oauth-serving-cert\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.885135 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.885062 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-service-ca\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.885135 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.885105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-trusted-ca-bundle\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.885272 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.885211 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-serving-cert\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.885272 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.885240 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-oauth-config\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986609 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-config\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986774 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hd7l\" (UniqueName: \"kubernetes.io/projected/5c34decd-e74c-47ff-9dbc-b5e537da8436-kube-api-access-4hd7l\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986774 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-oauth-serving-cert\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986888 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986775 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-service-ca\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986888 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-trusted-ca-bundle\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986991 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-serving-cert\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.986991 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.986965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-oauth-config\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.987355 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.987332 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-config\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.987465 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.987411 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-oauth-serving-cert\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.987465 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.987455 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-service-ca\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.987656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.987639 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-trusted-ca-bundle\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.989414 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.989392 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-serving-cert\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.989487 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.989465 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-oauth-config\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:37.995682 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:37.995661 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hd7l\" (UniqueName: \"kubernetes.io/projected/5c34decd-e74c-47ff-9dbc-b5e537da8436-kube-api-access-4hd7l\") pod \"console-54f79d6f56-677gw\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:38.067979 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:38.067900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:38.193947 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:38.193914 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f79d6f56-677gw"] Jul 29 18:39:38.197271 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:39:38.197245 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c34decd_e74c_47ff_9dbc_b5e537da8436.slice/crio-a4b43fed2f28cf6642dcfc11db7b52ae63e4b8d3b3b734b75dd82a469716ffcf WatchSource:0}: Error finding container a4b43fed2f28cf6642dcfc11db7b52ae63e4b8d3b3b734b75dd82a469716ffcf: Status 404 returned error can't find the container with id a4b43fed2f28cf6642dcfc11db7b52ae63e4b8d3b3b734b75dd82a469716ffcf Jul 29 18:39:38.984933 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:38.984899 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f79d6f56-677gw" event={"ID":"5c34decd-e74c-47ff-9dbc-b5e537da8436","Type":"ContainerStarted","Data":"daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a"} Jul 29 18:39:38.985382 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:38.984944 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f79d6f56-677gw" event={"ID":"5c34decd-e74c-47ff-9dbc-b5e537da8436","Type":"ContainerStarted","Data":"a4b43fed2f28cf6642dcfc11db7b52ae63e4b8d3b3b734b75dd82a469716ffcf"} Jul 29 18:39:39.004201 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:39.004143 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f79d6f56-677gw" podStartSLOduration=2.004124633 podStartE2EDuration="2.004124633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:39:39.0024771 +0000 UTC m=+325.669694304" watchObservedRunningTime="2026-07-29 18:39:39.004124633 +0000 UTC m=+325.671341832" Jul 29 18:39:47.003867 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.003811 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b5fddc6cc-kfdc2" podUID="8ed3f4f7-2685-4753-9733-f52d453149a4" containerName="console" containerID="cri-o://b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735" gracePeriod=15 Jul 29 18:39:47.255083 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.255029 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:47.263928 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.263909 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-serving-cert\") pod \"8ed3f4f7-2685-4753-9733-f52d453149a4\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " Jul 29 18:39:47.264012 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.263949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pg7x\" (UniqueName: \"kubernetes.io/projected/8ed3f4f7-2685-4753-9733-f52d453149a4-kube-api-access-6pg7x\") pod \"8ed3f4f7-2685-4753-9733-f52d453149a4\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " Jul 29 18:39:47.264012 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.263993 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-console-config\") pod \"8ed3f4f7-2685-4753-9733-f52d453149a4\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " Jul 29 18:39:47.264106 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264089 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-oauth-config\") pod \"8ed3f4f7-2685-4753-9733-f52d453149a4\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " Jul 29 18:39:47.264140 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264123 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-service-ca\") pod \"8ed3f4f7-2685-4753-9733-f52d453149a4\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " Jul 29 18:39:47.264196 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264166 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-oauth-serving-cert\") pod \"8ed3f4f7-2685-4753-9733-f52d453149a4\" (UID: \"8ed3f4f7-2685-4753-9733-f52d453149a4\") " Jul 29 18:39:47.264366 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264342 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-console-config" (OuterVolumeSpecName: "console-config") pod "8ed3f4f7-2685-4753-9733-f52d453149a4" (UID: "8ed3f4f7-2685-4753-9733-f52d453149a4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:47.264550 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264528 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ed3f4f7-2685-4753-9733-f52d453149a4" (UID: "8ed3f4f7-2685-4753-9733-f52d453149a4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:47.264636 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264538 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-console-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:47.264636 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.264553 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ed3f4f7-2685-4753-9733-f52d453149a4" (UID: "8ed3f4f7-2685-4753-9733-f52d453149a4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:39:47.266196 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.266172 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ed3f4f7-2685-4753-9733-f52d453149a4" (UID: "8ed3f4f7-2685-4753-9733-f52d453149a4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:47.266196 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.266192 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ed3f4f7-2685-4753-9733-f52d453149a4" (UID: "8ed3f4f7-2685-4753-9733-f52d453149a4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:39:47.266424 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.266232 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed3f4f7-2685-4753-9733-f52d453149a4-kube-api-access-6pg7x" (OuterVolumeSpecName: "kube-api-access-6pg7x") pod "8ed3f4f7-2685-4753-9733-f52d453149a4" (UID: "8ed3f4f7-2685-4753-9733-f52d453149a4"). InnerVolumeSpecName "kube-api-access-6pg7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:39:47.365712 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.365680 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-oauth-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:47.365712 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.365708 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-service-ca\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:47.365712 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.365718 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ed3f4f7-2685-4753-9733-f52d453149a4-oauth-serving-cert\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:47.365955 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.365726 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ed3f4f7-2685-4753-9733-f52d453149a4-console-serving-cert\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:47.365955 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:47.365735 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pg7x\" (UniqueName: \"kubernetes.io/projected/8ed3f4f7-2685-4753-9733-f52d453149a4-kube-api-access-6pg7x\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:39:48.019669 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.019638 2573 generic.go:356] "Generic (PLEG): container finished" podID="8ed3f4f7-2685-4753-9733-f52d453149a4" containerID="b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735" exitCode=0 Jul 29 18:39:48.020032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.019681 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b5fddc6cc-kfdc2" Jul 29 18:39:48.020032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.019689 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5fddc6cc-kfdc2" event={"ID":"8ed3f4f7-2685-4753-9733-f52d453149a4","Type":"ContainerDied","Data":"b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735"} Jul 29 18:39:48.020032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.019733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b5fddc6cc-kfdc2" event={"ID":"8ed3f4f7-2685-4753-9733-f52d453149a4","Type":"ContainerDied","Data":"c475c0c6c2110ef1ace7be84ebfe935c63d669dfeaae49337998f6096cc4b40b"} Jul 29 18:39:48.020032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.019753 2573 scope.go:117] "RemoveContainer" containerID="b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735" Jul 29 18:39:48.029345 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.029324 2573 scope.go:117] "RemoveContainer" containerID="b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735" Jul 29 18:39:48.029737 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:39:48.029712 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735\": container with ID starting with b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735 not found: ID does not exist" containerID="b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735" Jul 29 18:39:48.029844 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.029744 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735"} err="failed to get container status \"b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735\": rpc error: code = NotFound desc = could not find container \"b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735\": container with ID starting with b7ea0968f6528877e64e5e8181a06a87e92f500caef7774fe272872061804735 not found: ID does not exist" Jul 29 18:39:48.036829 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.036808 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b5fddc6cc-kfdc2"] Jul 29 18:39:48.041119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.041095 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b5fddc6cc-kfdc2"] Jul 29 18:39:48.068040 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.068021 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:48.068091 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.068067 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:48.072502 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:48.072485 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:49.027874 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:49.027845 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:39:49.956727 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:49.956688 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed3f4f7-2685-4753-9733-f52d453149a4" path="/var/lib/kubelet/pods/8ed3f4f7-2685-4753-9733-f52d453149a4/volumes" Jul 29 18:39:53.039757 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:53.039726 2573 generic.go:356] "Generic (PLEG): container finished" podID="a7a106b6-c6a8-41d3-bddc-81ef5957d347" containerID="1ad23fc2bbc401db8c7b7067000e07c82aa7d4075b5442c5f96e3cb3486f0293" exitCode=0 Jul 29 18:39:53.040187 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:53.039783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" event={"ID":"a7a106b6-c6a8-41d3-bddc-81ef5957d347","Type":"ContainerDied","Data":"1ad23fc2bbc401db8c7b7067000e07c82aa7d4075b5442c5f96e3cb3486f0293"} Jul 29 18:39:53.040187 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:53.040066 2573 scope.go:117] "RemoveContainer" containerID="1ad23fc2bbc401db8c7b7067000e07c82aa7d4075b5442c5f96e3cb3486f0293" Jul 29 18:39:54.045922 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:54.045887 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr" event={"ID":"a7a106b6-c6a8-41d3-bddc-81ef5957d347","Type":"ContainerStarted","Data":"c1400cb43e5a291af7fba19f38969e8be5f01c9d8a76a6fb9e48bd78e98f3d5d"} Jul 29 18:39:58.061798 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:58.061761 2573 generic.go:356] "Generic (PLEG): container finished" podID="aaac7f5f-9511-42aa-a6c6-2182484fa94a" containerID="e4789a5c39ad09463c6c7815449fdc448bee8a2389277b6423c71c528f62a4a0" exitCode=0 Jul 29 18:39:58.062184 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:58.061818 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9fr66" event={"ID":"aaac7f5f-9511-42aa-a6c6-2182484fa94a","Type":"ContainerDied","Data":"e4789a5c39ad09463c6c7815449fdc448bee8a2389277b6423c71c528f62a4a0"} Jul 29 18:39:58.062184 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:58.062148 2573 scope.go:117] "RemoveContainer" containerID="e4789a5c39ad09463c6c7815449fdc448bee8a2389277b6423c71c528f62a4a0" Jul 29 18:39:59.067819 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:39:59.067783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-9fr66" event={"ID":"aaac7f5f-9511-42aa-a6c6-2182484fa94a","Type":"ContainerStarted","Data":"e1954cdd67efb32c44c77ef308f6876dd18fe57575ad102bd3475b76507bc283"} Jul 29 18:40:27.714209 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:27.714166 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:40:27.716673 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:27.716646 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/224a45b3-ef7f-4a80-877f-8c41a61be9a2-metrics-certs\") pod \"network-metrics-daemon-x6szn\" (UID: \"224a45b3-ef7f-4a80-877f-8c41a61be9a2\") " pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:40:27.855879 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:27.855845 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c2rc9\"" Jul 29 18:40:27.863266 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:27.863245 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x6szn" Jul 29 18:40:27.990882 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:27.990808 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x6szn"] Jul 29 18:40:27.993709 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:40:27.993679 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224a45b3_ef7f_4a80_877f_8c41a61be9a2.slice/crio-1544fbdaca21da9970dbb9f0ab5f959c4136f60be2b2886b89892447ff8231d0 WatchSource:0}: Error finding container 1544fbdaca21da9970dbb9f0ab5f959c4136f60be2b2886b89892447ff8231d0: Status 404 returned error can't find the container with id 1544fbdaca21da9970dbb9f0ab5f959c4136f60be2b2886b89892447ff8231d0 Jul 29 18:40:28.179772 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:28.179735 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x6szn" event={"ID":"224a45b3-ef7f-4a80-877f-8c41a61be9a2","Type":"ContainerStarted","Data":"1544fbdaca21da9970dbb9f0ab5f959c4136f60be2b2886b89892447ff8231d0"} Jul 29 18:40:29.184815 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:29.184779 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x6szn" event={"ID":"224a45b3-ef7f-4a80-877f-8c41a61be9a2","Type":"ContainerStarted","Data":"a098cd58c39ce90fb655e4d9b0f8fc67c48751378dd41d41476e1f10fc1e692a"} Jul 29 18:40:29.185203 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:29.184833 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x6szn" event={"ID":"224a45b3-ef7f-4a80-877f-8c41a61be9a2","Type":"ContainerStarted","Data":"d2f3f402a6f8969ea397f26958afe8f0770399f37e16733cf742f9fed0e3c9c3"} Jul 29 18:40:29.205125 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:29.205077 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x6szn" podStartSLOduration=374.238448483 podStartE2EDuration="6m15.205060711s" totalImagesPullingTime="966.612228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:29.203201094 +0000 UTC m=+375.870418285" watchObservedRunningTime="2026-07-29 18:40:29.205060711 +0000 UTC m=+375.872277910" Jul 29 18:40:37.607783 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.607750 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:40:37.608314 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.608037 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="alertmanager" containerID="cri-o://8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258" gracePeriod=120 Jul 29 18:40:37.608398 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.608105 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-metric" containerID="cri-o://a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364" gracePeriod=120 Jul 29 18:40:37.608734 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.608144 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="prom-label-proxy" containerID="cri-o://b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623" gracePeriod=120 Jul 29 18:40:37.608734 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.608162 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy" containerID="cri-o://a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad" gracePeriod=120 Jul 29 18:40:37.608734 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.608184 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="config-reloader" containerID="cri-o://3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955" gracePeriod=120 Jul 29 18:40:37.608734 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:37.608169 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-web" containerID="cri-o://a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387" gracePeriod=120 Jul 29 18:40:38.220226 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220189 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623" exitCode=0 Jul 29 18:40:38.220226 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220216 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad" exitCode=0 Jul 29 18:40:38.220226 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220225 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955" exitCode=0 Jul 29 18:40:38.220226 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220234 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258" exitCode=0 Jul 29 18:40:38.220511 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220259 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623"} Jul 29 18:40:38.220511 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220334 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad"} Jul 29 18:40:38.220511 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220361 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955"} Jul 29 18:40:38.220511 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.220385 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258"} Jul 29 18:40:38.855768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.855744 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:38.900656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900624 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-web-config\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.900656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900665 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-trusted-ca-bundle\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.900925 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900695 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-metrics-client-ca\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.900925 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900752 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-volume\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.900925 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900875 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901084 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900938 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-tls-assets\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901084 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.900971 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901084 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901005 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-main-db\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901084 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901046 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901084 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901082 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-cluster-tls-config\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901352 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901089 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:38.901352 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901109 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xsw5\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-kube-api-access-8xsw5\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901352 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901125 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:40:38.901352 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901147 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-web\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901352 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901188 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-out\") pod \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\" (UID: \"b65a29d1-8dd0-4cee-a377-ee247c81d0f7\") " Jul 29 18:40:38.901352 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901329 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:40:38.901670 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901442 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-main-db\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:38.901670 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901462 2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:38.901670 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.901478 2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-metrics-client-ca\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:38.905632 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.905576 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-volume" (OuterVolumeSpecName: "config-volume") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:38.906980 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.906922 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:38.907314 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.907235 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-out" (OuterVolumeSpecName: "config-out") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:40:38.907314 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.907249 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:40:38.907659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.907436 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:38.907659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.907592 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:38.908032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.908008 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:38.909066 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.909036 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-kube-api-access-8xsw5" (OuterVolumeSpecName: "kube-api-access-8xsw5") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "kube-api-access-8xsw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:40:38.909447 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.909423 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:38.917252 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:38.917198 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-web-config" (OuterVolumeSpecName: "web-config") pod "b65a29d1-8dd0-4cee-a377-ee247c81d0f7" (UID: "b65a29d1-8dd0-4cee-a377-ee247c81d0f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:40:39.002486 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002440 2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-tls-assets\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002486 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002480 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-main-tls\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002486 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002495 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002519 2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-cluster-tls-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002532 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xsw5\" (UniqueName: \"kubernetes.io/projected/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-kube-api-access-8xsw5\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002545 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002558 2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-out\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002569 2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-web-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002580 2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-config-volume\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.002767 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.002592 2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b65a29d1-8dd0-4cee-a377-ee247c81d0f7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:40:39.227091 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.226998 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364" exitCode=0 Jul 29 18:40:39.227091 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.227022 2573 generic.go:356] "Generic (PLEG): container finished" podID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerID="a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387" exitCode=0 Jul 29 18:40:39.227091 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.227063 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364"} Jul 29 18:40:39.227091 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.227075 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.227385 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.227136 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387"} Jul 29 18:40:39.227385 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.227178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b65a29d1-8dd0-4cee-a377-ee247c81d0f7","Type":"ContainerDied","Data":"a02daf37ba779d98dd78ba806f2f9f9189a952bd21c75c6eba6091353409831f"} Jul 29 18:40:39.227385 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.227206 2573 scope.go:117] "RemoveContainer" containerID="b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623" Jul 29 18:40:39.237042 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.236181 2573 scope.go:117] "RemoveContainer" containerID="a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364" Jul 29 18:40:39.245526 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.245507 2573 scope.go:117] "RemoveContainer" containerID="a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad" Jul 29 18:40:39.252677 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.252647 2573 scope.go:117] "RemoveContainer" containerID="a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387" Jul 29 18:40:39.256986 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.256965 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:40:39.260776 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.260747 2573 scope.go:117] "RemoveContainer" containerID="3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955" Jul 29 18:40:39.261894 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.261871 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:40:39.267790 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.267774 2573 scope.go:117] "RemoveContainer" containerID="8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258" Jul 29 18:40:39.274654 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.274631 2573 scope.go:117] "RemoveContainer" containerID="45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd" Jul 29 18:40:39.281842 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.281822 2573 scope.go:117] "RemoveContainer" containerID="b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623" Jul 29 18:40:39.282146 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.282129 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623\": container with ID starting with b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623 not found: ID does not exist" containerID="b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623" Jul 29 18:40:39.282186 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282154 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623"} err="failed to get container status \"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623\": rpc error: code = NotFound desc = could not find container \"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623\": container with ID starting with b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623 not found: ID does not exist" Jul 29 18:40:39.282186 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282173 2573 scope.go:117] "RemoveContainer" containerID="a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364" Jul 29 18:40:39.282414 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.282394 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364\": container with ID starting with a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364 not found: ID does not exist" containerID="a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364" Jul 29 18:40:39.282474 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282421 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364"} err="failed to get container status \"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364\": rpc error: code = NotFound desc = could not find container \"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364\": container with ID starting with a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364 not found: ID does not exist" Jul 29 18:40:39.282474 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282439 2573 scope.go:117] "RemoveContainer" containerID="a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad" Jul 29 18:40:39.282664 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.282648 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad\": container with ID starting with a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad not found: ID does not exist" containerID="a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad" Jul 29 18:40:39.282705 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282668 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad"} err="failed to get container status \"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad\": rpc error: code = NotFound desc = could not find container \"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad\": container with ID starting with a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad not found: ID does not exist" Jul 29 18:40:39.282705 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282681 2573 scope.go:117] "RemoveContainer" containerID="a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387" Jul 29 18:40:39.282889 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.282873 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387\": container with ID starting with a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387 not found: ID does not exist" containerID="a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387" Jul 29 18:40:39.282932 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282892 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387"} err="failed to get container status \"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387\": rpc error: code = NotFound desc = could not find container \"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387\": container with ID starting with a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387 not found: ID does not exist" Jul 29 18:40:39.282932 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.282906 2573 scope.go:117] "RemoveContainer" containerID="3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955" Jul 29 18:40:39.283094 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.283077 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955\": container with ID starting with 3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955 not found: ID does not exist" containerID="3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955" Jul 29 18:40:39.283133 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283098 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955"} err="failed to get container status \"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955\": rpc error: code = NotFound desc = could not find container \"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955\": container with ID starting with 3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955 not found: ID does not exist" Jul 29 18:40:39.283133 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283109 2573 scope.go:117] "RemoveContainer" containerID="8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258" Jul 29 18:40:39.283287 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.283272 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258\": container with ID starting with 8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258 not found: ID does not exist" containerID="8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258" Jul 29 18:40:39.283410 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283290 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258"} err="failed to get container status \"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258\": rpc error: code = NotFound desc = could not find container \"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258\": container with ID starting with 8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258 not found: ID does not exist" Jul 29 18:40:39.283451 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283414 2573 scope.go:117] "RemoveContainer" containerID="45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd" Jul 29 18:40:39.283612 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:40:39.283595 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd\": container with ID starting with 45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd not found: ID does not exist" containerID="45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd" Jul 29 18:40:39.283674 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283614 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd"} err="failed to get container status \"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd\": rpc error: code = NotFound desc = could not find container \"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd\": container with ID starting with 45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd not found: ID does not exist" Jul 29 18:40:39.283674 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283625 2573 scope.go:117] "RemoveContainer" containerID="b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623" Jul 29 18:40:39.283804 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283786 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623"} err="failed to get container status \"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623\": rpc error: code = NotFound desc = could not find container \"b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623\": container with ID starting with b9e963fc69527a05695d67c9aede53d449ecc176b452682590c9f341cf644623 not found: ID does not exist" Jul 29 18:40:39.283804 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.283802 2573 scope.go:117] "RemoveContainer" containerID="a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364" Jul 29 18:40:39.284019 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284000 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364"} err="failed to get container status \"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364\": rpc error: code = NotFound desc = could not find container \"a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364\": container with ID starting with a7286b0a32da2e5c2e116c66add0a4107a72edb69847eaeb23c384ee66871364 not found: ID does not exist" Jul 29 18:40:39.284065 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284021 2573 scope.go:117] "RemoveContainer" containerID="a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad" Jul 29 18:40:39.284225 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284208 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad"} err="failed to get container status \"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad\": rpc error: code = NotFound desc = could not find container \"a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad\": container with ID starting with a7f02dfa44e71cf04874f75c0d76ad383aac47fb1464225be48a96ca1ee74fad not found: ID does not exist" Jul 29 18:40:39.284278 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284225 2573 scope.go:117] "RemoveContainer" containerID="a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387" Jul 29 18:40:39.284455 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284439 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387"} err="failed to get container status \"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387\": rpc error: code = NotFound desc = could not find container \"a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387\": container with ID starting with a896e3aa4fb3d5410a16f3b2156bc94b12f985e1eab281d4eb5642d0714aa387 not found: ID does not exist" Jul 29 18:40:39.284498 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284455 2573 scope.go:117] "RemoveContainer" containerID="3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955" Jul 29 18:40:39.284639 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284624 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955"} err="failed to get container status \"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955\": rpc error: code = NotFound desc = could not find container \"3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955\": container with ID starting with 3e53d00b6921d73ef6b5ac3059017adb2e29eaf2b79e20b56fdf36debb58c955 not found: ID does not exist" Jul 29 18:40:39.284676 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284639 2573 scope.go:117] "RemoveContainer" containerID="8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258" Jul 29 18:40:39.284799 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284778 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258"} err="failed to get container status \"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258\": rpc error: code = NotFound desc = could not find container \"8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258\": container with ID starting with 8685085ddbfe46da5eab99ac7a4d0ddf1789f6c113e955f8f0a338940a3f4258 not found: ID does not exist" Jul 29 18:40:39.284799 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284798 2573 scope.go:117] "RemoveContainer" containerID="45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd" Jul 29 18:40:39.285002 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.284985 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd"} err="failed to get container status \"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd\": rpc error: code = NotFound desc = could not find container \"45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd\": container with ID starting with 45e802ef3e93b1e7a6a64022943f6f411b9708b4672f5558329d95444b2cd0cd not found: ID does not exist" Jul 29 18:40:39.287572 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287552 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:40:39.287839 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287828 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="init-config-reloader" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287841 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="init-config-reloader" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287851 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="alertmanager" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287857 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="alertmanager" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287865 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-metric" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287871 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-metric" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287878 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="prom-label-proxy" Jul 29 18:40:39.287880 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287883 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="prom-label-proxy" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287895 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed3f4f7-2685-4753-9733-f52d453149a4" containerName="console" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287900 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed3f4f7-2685-4753-9733-f52d453149a4" containerName="console" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287906 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-web" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287915 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-web" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287923 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="config-reloader" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287930 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="config-reloader" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287942 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287951 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.287994 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="config-reloader" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.288001 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.288006 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-metric" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.288010 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="prom-label-proxy" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.288017 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed3f4f7-2685-4753-9733-f52d453149a4" containerName="console" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.288022 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="alertmanager" Jul 29 18:40:39.288101 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.288026 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" containerName="kube-rbac-proxy-web" Jul 29 18:40:39.293016 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.292999 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.295850 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.295826 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 18:40:39.295850 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.295827 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 18:40:39.296001 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.295831 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 18:40:39.296001 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.295882 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 18:40:39.296001 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.295985 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vngct\"" Jul 29 18:40:39.296209 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.296193 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 18:40:39.296382 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.296369 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 18:40:39.296476 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.296413 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 18:40:39.296476 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.296413 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 18:40:39.301983 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.301966 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 18:40:39.306720 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.306701 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:40:39.406167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjq6t\" (UniqueName: \"kubernetes.io/projected/9f6659d2-748d-406b-a7f5-f236c84918f9-kube-api-access-hjq6t\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406167 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f6659d2-748d-406b-a7f5-f236c84918f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406249 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f6659d2-748d-406b-a7f5-f236c84918f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f6659d2-748d-406b-a7f5-f236c84918f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406366 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-web-config\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406444 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406443 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f6659d2-748d-406b-a7f5-f236c84918f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406715 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406477 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406715 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406511 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406715 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406546 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.406715 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.406586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f6659d2-748d-406b-a7f5-f236c84918f9-config-out\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507532 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f6659d2-748d-406b-a7f5-f236c84918f9-config-out\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507532 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507502 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjq6t\" (UniqueName: \"kubernetes.io/projected/9f6659d2-748d-406b-a7f5-f236c84918f9-kube-api-access-hjq6t\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507532 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f6659d2-748d-406b-a7f5-f236c84918f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507563 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f6659d2-748d-406b-a7f5-f236c84918f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f6659d2-748d-406b-a7f5-f236c84918f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-web-config\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507669 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f6659d2-748d-406b-a7f5-f236c84918f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507705 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.507745 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507743 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.508159 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.507771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.508159 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.508012 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f6659d2-748d-406b-a7f5-f236c84918f9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.508695 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.508667 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f6659d2-748d-406b-a7f5-f236c84918f9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.508893 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.508865 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f6659d2-748d-406b-a7f5-f236c84918f9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.510821 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.510680 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f6659d2-748d-406b-a7f5-f236c84918f9-config-out\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.510821 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.510680 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.510821 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.510742 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.510821 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.510763 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.510821 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.510774 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f6659d2-748d-406b-a7f5-f236c84918f9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.510821 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.510790 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.511141 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.511124 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-web-config\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.511568 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.511553 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.512498 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.512482 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f6659d2-748d-406b-a7f5-f236c84918f9-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.516659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.516639 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjq6t\" (UniqueName: \"kubernetes.io/projected/9f6659d2-748d-406b-a7f5-f236c84918f9-kube-api-access-hjq6t\") pod \"alertmanager-main-0\" (UID: \"9f6659d2-748d-406b-a7f5-f236c84918f9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.602761 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.602727 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 18:40:39.741647 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.741625 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 18:40:39.743941 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:40:39.743906 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6659d2_748d_406b_a7f5_f236c84918f9.slice/crio-144b6db8f969e108afc23ba379e60c76e7e3aea5b31b64fc9dd60cb2381ec93b WatchSource:0}: Error finding container 144b6db8f969e108afc23ba379e60c76e7e3aea5b31b64fc9dd60cb2381ec93b: Status 404 returned error can't find the container with id 144b6db8f969e108afc23ba379e60c76e7e3aea5b31b64fc9dd60cb2381ec93b Jul 29 18:40:39.956917 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:39.956884 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65a29d1-8dd0-4cee-a377-ee247c81d0f7" path="/var/lib/kubelet/pods/b65a29d1-8dd0-4cee-a377-ee247c81d0f7/volumes" Jul 29 18:40:40.232229 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:40.232195 2573 generic.go:356] "Generic (PLEG): container finished" podID="9f6659d2-748d-406b-a7f5-f236c84918f9" containerID="8938a46167b7996bb8f30d0126cffe570beaf1099d25a14afb9f8d9ff9f7e165" exitCode=0 Jul 29 18:40:40.232407 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:40.232279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerDied","Data":"8938a46167b7996bb8f30d0126cffe570beaf1099d25a14afb9f8d9ff9f7e165"} Jul 29 18:40:40.232407 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:40.232356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"144b6db8f969e108afc23ba379e60c76e7e3aea5b31b64fc9dd60cb2381ec93b"} Jul 29 18:40:41.239408 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.239370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"0e425bf939ea751ea80c6cb0d71afc788eb469221648ff5bba31242746a466de"} Jul 29 18:40:41.239749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.239450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"fbcd0430165bf7bcd39e1da779fca8eccc6d1507eb1984b5e05d0f2a92adfb76"} Jul 29 18:40:41.239749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.239493 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"4abb002b56e65ca864f15624573b4618fdc87ebf264af7b963ceab8053d6c83b"} Jul 29 18:40:41.239749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.239527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"957e1573f288780376e40ff9c0e7de9f38d9530e47c9abc7cdb2c454457cf497"} Jul 29 18:40:41.239749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.239565 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"89b1040734b09c6babbb9eaa21762630b9b84483706d1d755fb7ece79ec03421"} Jul 29 18:40:41.239749 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.239601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f6659d2-748d-406b-a7f5-f236c84918f9","Type":"ContainerStarted","Data":"b46aba94d1836ffa21d5213d378c6ccee64e79deb73c1eca379428aeffee220d"} Jul 29 18:40:41.267354 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:41.267309 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.25202241 podStartE2EDuration="2.267278072s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.255662ms" isStatefulPod=false podCreationTimestamp="2026-07-29 18:40:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:41.265365767 +0000 UTC m=+387.932582967" watchObservedRunningTime="2026-07-29 18:40:41.267278072 +0000 UTC m=+387.934495313" Jul 29 18:40:47.694207 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.694173 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bcd955c96-9d6xj"] Jul 29 18:40:47.697666 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.697639 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.710099 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.710068 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcd955c96-9d6xj"] Jul 29 18:40:47.772926 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.772894 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-service-ca\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.773106 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.772953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-trusted-ca-bundle\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.773106 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.773052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-oauth-serving-cert\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.773106 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.773089 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-config\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.773234 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.773118 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rlk2\" (UniqueName: \"kubernetes.io/projected/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-kube-api-access-6rlk2\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.773234 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.773169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-oauth-config\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.773234 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.773215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-serving-cert\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874025 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.873978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-config\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rlk2\" (UniqueName: \"kubernetes.io/projected/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-kube-api-access-6rlk2\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874066 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-oauth-config\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874084 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-serving-cert\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-service-ca\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874131 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-trusted-ca-bundle\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-oauth-serving-cert\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874851 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874817 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-config\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874978 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874855 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-oauth-serving-cert\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.874978 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874855 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-service-ca\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.875082 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.874996 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-trusted-ca-bundle\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.876506 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.876475 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-oauth-config\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.876652 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.876635 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-serving-cert\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:47.882611 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:47.882593 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rlk2\" (UniqueName: \"kubernetes.io/projected/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-kube-api-access-6rlk2\") pod \"console-bcd955c96-9d6xj\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:48.010964 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:48.010930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:48.142475 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:48.142449 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcd955c96-9d6xj"] Jul 29 18:40:48.145101 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:40:48.145075 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4dba58_174e_4bfe_8e68_ea8cbd54eb23.slice/crio-2210ec35819d9e223efe44babfc3ed707cc34f243bd570410cd29eefe08861c9 WatchSource:0}: Error finding container 2210ec35819d9e223efe44babfc3ed707cc34f243bd570410cd29eefe08861c9: Status 404 returned error can't find the container with id 2210ec35819d9e223efe44babfc3ed707cc34f243bd570410cd29eefe08861c9 Jul 29 18:40:48.272462 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:48.272369 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcd955c96-9d6xj" event={"ID":"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23","Type":"ContainerStarted","Data":"b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a"} Jul 29 18:40:48.272462 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:48.272437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcd955c96-9d6xj" event={"ID":"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23","Type":"ContainerStarted","Data":"2210ec35819d9e223efe44babfc3ed707cc34f243bd570410cd29eefe08861c9"} Jul 29 18:40:48.293812 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:48.293752 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bcd955c96-9d6xj" podStartSLOduration=1.293732721 podStartE2EDuration="1.293732721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:40:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:40:48.293395974 +0000 UTC m=+394.960613179" watchObservedRunningTime="2026-07-29 18:40:48.293732721 +0000 UTC m=+394.960949923" Jul 29 18:40:58.011075 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:58.011040 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:58.011497 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:58.011102 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:58.015959 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:58.015937 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:58.313722 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:58.313655 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:40:58.369320 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:40:58.369274 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f79d6f56-677gw"] Jul 29 18:41:23.390666 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.390601 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54f79d6f56-677gw" podUID="5c34decd-e74c-47ff-9dbc-b5e537da8436" containerName="console" containerID="cri-o://daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a" gracePeriod=15 Jul 29 18:41:23.634586 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.634562 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:41:23.673055 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.672984 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-trusted-ca-bundle\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673055 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673014 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-oauth-config\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673250 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673069 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-serving-cert\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673250 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673088 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-config\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673250 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673117 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hd7l\" (UniqueName: \"kubernetes.io/projected/5c34decd-e74c-47ff-9dbc-b5e537da8436-kube-api-access-4hd7l\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673250 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673144 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-oauth-serving-cert\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673250 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673184 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-service-ca\") pod \"5c34decd-e74c-47ff-9dbc-b5e537da8436\" (UID: \"5c34decd-e74c-47ff-9dbc-b5e537da8436\") " Jul 29 18:41:23.673532 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673417 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:41:23.674034 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673597 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-config" (OuterVolumeSpecName: "console-config") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:41:23.674203 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.673951 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:41:23.674203 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.674099 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:41:23.675571 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.675536 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:41:23.675571 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.675551 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:41:23.675571 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.675561 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c34decd-e74c-47ff-9dbc-b5e537da8436-kube-api-access-4hd7l" (OuterVolumeSpecName: "kube-api-access-4hd7l") pod "5c34decd-e74c-47ff-9dbc-b5e537da8436" (UID: "5c34decd-e74c-47ff-9dbc-b5e537da8436"). InnerVolumeSpecName "kube-api-access-4hd7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:41:23.774141 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774106 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-trusted-ca-bundle\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:23.774141 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774136 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-oauth-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:23.774141 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774148 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-serving-cert\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:23.774401 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774161 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-console-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:23.774401 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774174 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hd7l\" (UniqueName: \"kubernetes.io/projected/5c34decd-e74c-47ff-9dbc-b5e537da8436-kube-api-access-4hd7l\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:23.774401 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774187 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-oauth-serving-cert\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:23.774401 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:23.774197 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c34decd-e74c-47ff-9dbc-b5e537da8436-service-ca\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:24.411263 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.411228 2573 generic.go:356] "Generic (PLEG): container finished" podID="5c34decd-e74c-47ff-9dbc-b5e537da8436" containerID="daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a" exitCode=0 Jul 29 18:41:24.411773 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.411280 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f79d6f56-677gw" Jul 29 18:41:24.411773 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.411344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f79d6f56-677gw" event={"ID":"5c34decd-e74c-47ff-9dbc-b5e537da8436","Type":"ContainerDied","Data":"daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a"} Jul 29 18:41:24.411773 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.411408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f79d6f56-677gw" event={"ID":"5c34decd-e74c-47ff-9dbc-b5e537da8436","Type":"ContainerDied","Data":"a4b43fed2f28cf6642dcfc11db7b52ae63e4b8d3b3b734b75dd82a469716ffcf"} Jul 29 18:41:24.411773 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.411445 2573 scope.go:117] "RemoveContainer" containerID="daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a" Jul 29 18:41:24.419971 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.419953 2573 scope.go:117] "RemoveContainer" containerID="daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a" Jul 29 18:41:24.420260 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:41:24.420243 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a\": container with ID starting with daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a not found: ID does not exist" containerID="daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a" Jul 29 18:41:24.420324 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.420268 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a"} err="failed to get container status \"daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a\": rpc error: code = NotFound desc = could not find container \"daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a\": container with ID starting with daea12aec12f9b1204b5f42ecf342f8b7453c86da7b5a9cb7db85c25be11d49a not found: ID does not exist" Jul 29 18:41:24.430642 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.430610 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f79d6f56-677gw"] Jul 29 18:41:24.435106 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:24.435085 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f79d6f56-677gw"] Jul 29 18:41:25.960509 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:25.957888 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c34decd-e74c-47ff-9dbc-b5e537da8436" path="/var/lib/kubelet/pods/5c34decd-e74c-47ff-9dbc-b5e537da8436/volumes" Jul 29 18:41:31.369422 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.369388 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm"] Jul 29 18:41:31.369827 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.369674 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c34decd-e74c-47ff-9dbc-b5e537da8436" containerName="console" Jul 29 18:41:31.369827 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.369684 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c34decd-e74c-47ff-9dbc-b5e537da8436" containerName="console" Jul 29 18:41:31.369827 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.369738 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c34decd-e74c-47ff-9dbc-b5e537da8436" containerName="console" Jul 29 18:41:31.374171 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.374154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.377051 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.377028 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 18:41:31.377205 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.377094 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 18:41:31.378218 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.378199 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q5qlr\"" Jul 29 18:41:31.382966 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.382945 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm"] Jul 29 18:41:31.435988 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.435955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.436154 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.436013 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpwvn\" (UniqueName: \"kubernetes.io/projected/0ea36805-e3af-4df2-8b03-337e3874addf-kube-api-access-kpwvn\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.436154 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.436056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.536953 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.536911 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpwvn\" (UniqueName: \"kubernetes.io/projected/0ea36805-e3af-4df2-8b03-337e3874addf-kube-api-access-kpwvn\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.537132 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.536975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.537132 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.537042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.537401 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.537381 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.537457 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.537430 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.546125 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.546092 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpwvn\" (UniqueName: \"kubernetes.io/projected/0ea36805-e3af-4df2-8b03-337e3874addf-kube-api-access-kpwvn\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.684213 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.684171 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:31.811618 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:31.811596 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm"] Jul 29 18:41:31.813794 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:41:31.813768 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea36805_e3af_4df2_8b03_337e3874addf.slice/crio-0b976c28365f9c555d6f84243975ea083377a2fdfa2d47b8c43aeac2b723cb32 WatchSource:0}: Error finding container 0b976c28365f9c555d6f84243975ea083377a2fdfa2d47b8c43aeac2b723cb32: Status 404 returned error can't find the container with id 0b976c28365f9c555d6f84243975ea083377a2fdfa2d47b8c43aeac2b723cb32 Jul 29 18:41:32.450683 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:32.450624 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" event={"ID":"0ea36805-e3af-4df2-8b03-337e3874addf","Type":"ContainerStarted","Data":"0b976c28365f9c555d6f84243975ea083377a2fdfa2d47b8c43aeac2b723cb32"} Jul 29 18:41:39.478592 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:39.478557 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ea36805-e3af-4df2-8b03-337e3874addf" containerID="599d7faacf0af833896b83ac95f91667be05234f0c2a5764ecd0a2a59b82bf87" exitCode=0 Jul 29 18:41:39.478984 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:39.478623 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" event={"ID":"0ea36805-e3af-4df2-8b03-337e3874addf","Type":"ContainerDied","Data":"599d7faacf0af833896b83ac95f91667be05234f0c2a5764ecd0a2a59b82bf87"} Jul 29 18:41:42.493597 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:42.493567 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ea36805-e3af-4df2-8b03-337e3874addf" containerID="a0f1e7c14f747ba5849d9f6a4037639007691c8d0014a3579e8b35d921a55766" exitCode=0 Jul 29 18:41:42.494005 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:42.493647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" event={"ID":"0ea36805-e3af-4df2-8b03-337e3874addf","Type":"ContainerDied","Data":"a0f1e7c14f747ba5849d9f6a4037639007691c8d0014a3579e8b35d921a55766"} Jul 29 18:41:50.528028 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:50.527991 2573 generic.go:356] "Generic (PLEG): container finished" podID="0ea36805-e3af-4df2-8b03-337e3874addf" containerID="1552ac922f4605b9d47a68f48eaba13e22ba79837f92a6f1cc722fb87b79d6c3" exitCode=0 Jul 29 18:41:50.528470 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:50.528067 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" event={"ID":"0ea36805-e3af-4df2-8b03-337e3874addf","Type":"ContainerDied","Data":"1552ac922f4605b9d47a68f48eaba13e22ba79837f92a6f1cc722fb87b79d6c3"} Jul 29 18:41:51.687651 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.687617 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:51.822979 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.822889 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-util\") pod \"0ea36805-e3af-4df2-8b03-337e3874addf\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " Jul 29 18:41:51.822979 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.822927 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-bundle\") pod \"0ea36805-e3af-4df2-8b03-337e3874addf\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " Jul 29 18:41:51.822979 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.822963 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpwvn\" (UniqueName: \"kubernetes.io/projected/0ea36805-e3af-4df2-8b03-337e3874addf-kube-api-access-kpwvn\") pod \"0ea36805-e3af-4df2-8b03-337e3874addf\" (UID: \"0ea36805-e3af-4df2-8b03-337e3874addf\") " Jul 29 18:41:51.823576 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.823538 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-bundle" (OuterVolumeSpecName: "bundle") pod "0ea36805-e3af-4df2-8b03-337e3874addf" (UID: "0ea36805-e3af-4df2-8b03-337e3874addf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:41:51.825131 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.825109 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea36805-e3af-4df2-8b03-337e3874addf-kube-api-access-kpwvn" (OuterVolumeSpecName: "kube-api-access-kpwvn") pod "0ea36805-e3af-4df2-8b03-337e3874addf" (UID: "0ea36805-e3af-4df2-8b03-337e3874addf"). InnerVolumeSpecName "kube-api-access-kpwvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:41:51.827965 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.827941 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-util" (OuterVolumeSpecName: "util") pod "0ea36805-e3af-4df2-8b03-337e3874addf" (UID: "0ea36805-e3af-4df2-8b03-337e3874addf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 18:41:51.924254 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.924217 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-util\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:51.924254 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.924244 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ea36805-e3af-4df2-8b03-337e3874addf-bundle\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:51.924254 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:51.924255 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpwvn\" (UniqueName: \"kubernetes.io/projected/0ea36805-e3af-4df2-8b03-337e3874addf-kube-api-access-kpwvn\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:41:52.537376 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:52.537344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" event={"ID":"0ea36805-e3af-4df2-8b03-337e3874addf","Type":"ContainerDied","Data":"0b976c28365f9c555d6f84243975ea083377a2fdfa2d47b8c43aeac2b723cb32"} Jul 29 18:41:52.537540 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:52.537394 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b976c28365f9c555d6f84243975ea083377a2fdfa2d47b8c43aeac2b723cb32" Jul 29 18:41:52.537540 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:52.537361 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5z49mm" Jul 29 18:41:59.088787 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.088748 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9"] Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089045 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="extract" Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089057 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="extract" Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089072 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="util" Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089078 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="util" Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089087 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="pull" Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089094 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="pull" Jul 29 18:41:59.089239 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.089139 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea36805-e3af-4df2-8b03-337e3874addf" containerName="extract" Jul 29 18:41:59.091159 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.091138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.094759 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.094737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-5jx7d\"" Jul 29 18:41:59.094905 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.094803 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 18:41:59.095000 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.094984 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 18:41:59.095144 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.095130 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 18:41:59.116478 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.116453 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9"] Jul 29 18:41:59.187503 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.187471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btvpm\" (UniqueName: \"kubernetes.io/projected/305c2010-9cf7-4056-94c1-4b19e1a97c34-kube-api-access-btvpm\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9\" (UID: \"305c2010-9cf7-4056-94c1-4b19e1a97c34\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.187503 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.187513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/305c2010-9cf7-4056-94c1-4b19e1a97c34-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9\" (UID: \"305c2010-9cf7-4056-94c1-4b19e1a97c34\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.288676 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.288637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btvpm\" (UniqueName: \"kubernetes.io/projected/305c2010-9cf7-4056-94c1-4b19e1a97c34-kube-api-access-btvpm\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9\" (UID: \"305c2010-9cf7-4056-94c1-4b19e1a97c34\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.288676 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.288680 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/305c2010-9cf7-4056-94c1-4b19e1a97c34-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9\" (UID: \"305c2010-9cf7-4056-94c1-4b19e1a97c34\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.290960 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.290937 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/305c2010-9cf7-4056-94c1-4b19e1a97c34-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9\" (UID: \"305c2010-9cf7-4056-94c1-4b19e1a97c34\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.310791 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.310763 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btvpm\" (UniqueName: \"kubernetes.io/projected/305c2010-9cf7-4056-94c1-4b19e1a97c34-kube-api-access-btvpm\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9\" (UID: \"305c2010-9cf7-4056-94c1-4b19e1a97c34\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.405746 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.405705 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:41:59.553649 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.553612 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9"] Jul 29 18:41:59.554656 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:41:59.554630 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305c2010_9cf7_4056_94c1_4b19e1a97c34.slice/crio-d09b7f151df15aa0886b84a5dadd70408358fe646099e71f85342ebefa4521a7 WatchSource:0}: Error finding container d09b7f151df15aa0886b84a5dadd70408358fe646099e71f85342ebefa4521a7: Status 404 returned error can't find the container with id d09b7f151df15aa0886b84a5dadd70408358fe646099e71f85342ebefa4521a7 Jul 29 18:41:59.565958 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:41:59.565932 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" event={"ID":"305c2010-9cf7-4056-94c1-4b19e1a97c34","Type":"ContainerStarted","Data":"d09b7f151df15aa0886b84a5dadd70408358fe646099e71f85342ebefa4521a7"} Jul 29 18:42:03.269009 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.268978 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-w7t7j"] Jul 29 18:42:03.271310 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.271280 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.274180 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.274158 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 18:42:03.274331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.274165 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 29 18:42:03.274331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.274254 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mjj87\"" Jul 29 18:42:03.282851 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.282830 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-w7t7j"] Jul 29 18:42:03.321517 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.321486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2ts\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-kube-api-access-pj2ts\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.321692 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.321532 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.321692 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.321600 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-cabundle0\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.421987 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.421950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-cabundle0\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.422194 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.422001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2ts\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-kube-api-access-pj2ts\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.422194 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.422034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.422194 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.422157 2573 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 29 18:42:03.422194 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.422172 2573 secret.go:281] references non-existent secret key: ca.crt Jul 29 18:42:03.422194 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.422179 2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 18:42:03.422194 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.422191 2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-w7t7j: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 18:42:03.422523 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.422241 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates podName:a794f2c7-c8ff-4c1e-b86b-13d3185c3911 nodeName:}" failed. No retries permitted until 2026-07-29 18:42:03.92222473 +0000 UTC m=+470.589441907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates") pod "keda-operator-77f648d694-w7t7j" (UID: "a794f2c7-c8ff-4c1e-b86b-13d3185c3911") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 18:42:03.422624 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.422605 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-cabundle0\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.431709 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.431687 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2ts\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-kube-api-access-pj2ts\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.586325 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.586214 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-xk49p"] Jul 29 18:42:03.588540 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.588519 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" event={"ID":"305c2010-9cf7-4056-94c1-4b19e1a97c34","Type":"ContainerStarted","Data":"763a8f5f4b2823406139ba4750a49962d98e6e0ce95a31532d56777b14b7ec97"} Jul 29 18:42:03.588655 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.588550 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:42:03.588655 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.588615 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.592841 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.592821 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 18:42:03.598654 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.598633 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-xk49p"] Jul 29 18:42:03.613204 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.613164 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" podStartSLOduration=1.626106002 podStartE2EDuration="4.613145627s" totalImagesPullingTime="2.987039625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:42:03.612167841 +0000 UTC m=+470.279385041" watchObservedRunningTime="2026-07-29 18:42:03.613145627 +0000 UTC m=+470.280362826" Jul 29 18:42:03.623681 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.623659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-certificates\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.623681 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.623687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqhn\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-kube-api-access-grqhn\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.623855 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.623833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/ce6d8017-a745-480a-ae4e-a80082ac3132-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.724711 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.724677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-certificates\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.724711 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.724713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqhn\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-kube-api-access-grqhn\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.724925 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.724742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/ce6d8017-a745-480a-ae4e-a80082ac3132-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.724925 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.724823 2573 secret.go:281] references non-existent secret key: tls.crt Jul 29 18:42:03.724925 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.724838 2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 29 18:42:03.724925 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.724855 2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-xk49p: references non-existent secret key: tls.crt Jul 29 18:42:03.724925 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.724906 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-certificates podName:ce6d8017-a745-480a-ae4e-a80082ac3132 nodeName:}" failed. No retries permitted until 2026-07-29 18:42:04.224891867 +0000 UTC m=+470.892109048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-certificates") pod "keda-metrics-apiserver-55557df8c-xk49p" (UID: "ce6d8017-a745-480a-ae4e-a80082ac3132") : references non-existent secret key: tls.crt Jul 29 18:42:03.725120 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.725094 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/ce6d8017-a745-480a-ae4e-a80082ac3132-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.735603 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.735581 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqhn\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-kube-api-access-grqhn\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:03.926158 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:03.926122 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:03.926368 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.926256 2573 secret.go:281] references non-existent secret key: ca.crt Jul 29 18:42:03.926368 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.926273 2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 18:42:03.926368 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.926282 2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-w7t7j: references non-existent secret key: ca.crt Jul 29 18:42:03.926368 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:42:03.926346 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates podName:a794f2c7-c8ff-4c1e-b86b-13d3185c3911 nodeName:}" failed. No retries permitted until 2026-07-29 18:42:04.926331524 +0000 UTC m=+471.593548702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates") pod "keda-operator-77f648d694-w7t7j" (UID: "a794f2c7-c8ff-4c1e-b86b-13d3185c3911") : references non-existent secret key: ca.crt Jul 29 18:42:04.227930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:04.227849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-certificates\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:04.230257 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:04.230234 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ce6d8017-a745-480a-ae4e-a80082ac3132-certificates\") pod \"keda-metrics-apiserver-55557df8c-xk49p\" (UID: \"ce6d8017-a745-480a-ae4e-a80082ac3132\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:04.499831 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:04.499744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:04.651339 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:04.651318 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-xk49p"] Jul 29 18:42:04.653520 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:42:04.653490 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6d8017_a745_480a_ae4e_a80082ac3132.slice/crio-9f4bbe64f790567494661ce0d26f5dc56162eaa0d5b80df2f3acc4ed27f1eff0 WatchSource:0}: Error finding container 9f4bbe64f790567494661ce0d26f5dc56162eaa0d5b80df2f3acc4ed27f1eff0: Status 404 returned error can't find the container with id 9f4bbe64f790567494661ce0d26f5dc56162eaa0d5b80df2f3acc4ed27f1eff0 Jul 29 18:42:04.935026 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:04.934989 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:04.937452 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:04.937428 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a794f2c7-c8ff-4c1e-b86b-13d3185c3911-certificates\") pod \"keda-operator-77f648d694-w7t7j\" (UID: \"a794f2c7-c8ff-4c1e-b86b-13d3185c3911\") " pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:05.081318 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:05.081253 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:05.209164 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:05.209135 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-w7t7j"] Jul 29 18:42:05.211278 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:42:05.211248 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda794f2c7_c8ff_4c1e_b86b_13d3185c3911.slice/crio-4066a1e4d89a464b681e16ccf017b8e49831e642baa65210e54ccc92372c0bf4 WatchSource:0}: Error finding container 4066a1e4d89a464b681e16ccf017b8e49831e642baa65210e54ccc92372c0bf4: Status 404 returned error can't find the container with id 4066a1e4d89a464b681e16ccf017b8e49831e642baa65210e54ccc92372c0bf4 Jul 29 18:42:05.598479 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:05.598377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-w7t7j" event={"ID":"a794f2c7-c8ff-4c1e-b86b-13d3185c3911","Type":"ContainerStarted","Data":"4066a1e4d89a464b681e16ccf017b8e49831e642baa65210e54ccc92372c0bf4"} Jul 29 18:42:05.599455 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:05.599435 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" event={"ID":"ce6d8017-a745-480a-ae4e-a80082ac3132","Type":"ContainerStarted","Data":"9f4bbe64f790567494661ce0d26f5dc56162eaa0d5b80df2f3acc4ed27f1eff0"} Jul 29 18:42:09.618331 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:09.618279 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-w7t7j" event={"ID":"a794f2c7-c8ff-4c1e-b86b-13d3185c3911","Type":"ContainerStarted","Data":"9bf2a7bc07632f49f83c79775bde0ad5e9c77b8943d359b4a63222ac045dea4a"} Jul 29 18:42:09.618882 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:09.618398 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:42:09.619957 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:09.619929 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" event={"ID":"ce6d8017-a745-480a-ae4e-a80082ac3132","Type":"ContainerStarted","Data":"6f364fdd8287b1ad585e4b7330cba1938fb6d761a111e29b6f0c89bb04fb2f3b"} Jul 29 18:42:09.620065 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:09.619983 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:09.637853 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:09.637809 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-w7t7j" podStartSLOduration=3.175346061 podStartE2EDuration="6.637795832s" totalImagesPullingTime="3.462449771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:42:09.635761299 +0000 UTC m=+476.302978500" watchObservedRunningTime="2026-07-29 18:42:09.637795832 +0000 UTC m=+476.305013094" Jul 29 18:42:09.655552 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:09.655507 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" podStartSLOduration=2.64052252 podStartE2EDuration="6.655491564s" totalImagesPullingTime="4.014969044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:42:09.654905009 +0000 UTC m=+476.322122211" watchObservedRunningTime="2026-07-29 18:42:09.655491564 +0000 UTC m=+476.322708764" Jul 29 18:42:20.634109 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:20.630652 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-xk49p" Jul 29 18:42:24.595682 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:24.595644 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-8zsr9" Jul 29 18:42:30.627680 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:42:30.627648 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-w7t7j" Jul 29 18:43:11.134504 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.134468 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-bcfrr"] Jul 29 18:43:11.136569 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.136552 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.140451 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.140430 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 18:43:11.140556 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.140502 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 18:43:11.140751 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.140737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-w2l9c\"" Jul 29 18:43:11.141962 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.141945 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 18:43:11.154160 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.154135 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-bcfrr"] Jul 29 18:43:11.193599 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.193570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3035bb99-b788-425a-80c0-0f0c14b35313-cert\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.193754 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.193624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l6fv\" (UniqueName: \"kubernetes.io/projected/3035bb99-b788-425a-80c0-0f0c14b35313-kube-api-access-9l6fv\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.294328 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.294255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l6fv\" (UniqueName: \"kubernetes.io/projected/3035bb99-b788-425a-80c0-0f0c14b35313-kube-api-access-9l6fv\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.294522 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.294366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3035bb99-b788-425a-80c0-0f0c14b35313-cert\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.294522 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:11.294483 2573 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 29 18:43:11.294615 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:11.294530 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3035bb99-b788-425a-80c0-0f0c14b35313-cert podName:3035bb99-b788-425a-80c0-0f0c14b35313 nodeName:}" failed. No retries permitted until 2026-07-29 18:43:11.794513824 +0000 UTC m=+538.461731003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3035bb99-b788-425a-80c0-0f0c14b35313-cert") pod "llmisvc-controller-manager-67d95fdc48-bcfrr" (UID: "3035bb99-b788-425a-80c0-0f0c14b35313") : secret "llmisvc-webhook-server-cert" not found Jul 29 18:43:11.303207 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.303176 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l6fv\" (UniqueName: \"kubernetes.io/projected/3035bb99-b788-425a-80c0-0f0c14b35313-kube-api-access-9l6fv\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.798753 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.798704 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3035bb99-b788-425a-80c0-0f0c14b35313-cert\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:11.801033 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:11.801002 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3035bb99-b788-425a-80c0-0f0c14b35313-cert\") pod \"llmisvc-controller-manager-67d95fdc48-bcfrr\" (UID: \"3035bb99-b788-425a-80c0-0f0c14b35313\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:12.046264 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:12.046232 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:12.172698 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:12.172481 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-bcfrr"] Jul 29 18:43:12.174930 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:43:12.174896 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3035bb99_b788_425a_80c0_0f0c14b35313.slice/crio-93dc26a38bc9c4f1fe5e6a8bda964c3c5c509cd69e53e4c93212d43cb4edf694 WatchSource:0}: Error finding container 93dc26a38bc9c4f1fe5e6a8bda964c3c5c509cd69e53e4c93212d43cb4edf694: Status 404 returned error can't find the container with id 93dc26a38bc9c4f1fe5e6a8bda964c3c5c509cd69e53e4c93212d43cb4edf694 Jul 29 18:43:12.898812 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:12.898773 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerStarted","Data":"93dc26a38bc9c4f1fe5e6a8bda964c3c5c509cd69e53e4c93212d43cb4edf694"} Jul 29 18:43:14.909225 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:14.909187 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerStarted","Data":"9058fe1fcb6e88ae97dc523e339d30414c1fe46823598b12898b8215e5843df3"} Jul 29 18:43:14.909721 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:14.909329 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:14.928619 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:14.928550 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podStartSLOduration=1.977627464 podStartE2EDuration="3.928535196s" totalImagesPullingTime="1.950907732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:43:14.928021258 +0000 UTC m=+541.595238463" watchObservedRunningTime="2026-07-29 18:43:14.928535196 +0000 UTC m=+541.595752396" Jul 29 18:43:15.914641 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:15.914611 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="9058fe1fcb6e88ae97dc523e339d30414c1fe46823598b12898b8215e5843df3" exitCode=1 Jul 29 18:43:15.915023 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:15.914709 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"9058fe1fcb6e88ae97dc523e339d30414c1fe46823598b12898b8215e5843df3"} Jul 29 18:43:15.915023 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:15.914915 2573 scope.go:117] "RemoveContainer" containerID="9058fe1fcb6e88ae97dc523e339d30414c1fe46823598b12898b8215e5843df3" Jul 29 18:43:16.921077 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:16.921041 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerStarted","Data":"a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c"} Jul 29 18:43:16.921579 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:16.921179 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:17.927692 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:17.927657 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c" exitCode=1 Jul 29 18:43:17.928162 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:17.927711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c"} Jul 29 18:43:17.928162 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:17.927760 2573 scope.go:117] "RemoveContainer" containerID="9058fe1fcb6e88ae97dc523e339d30414c1fe46823598b12898b8215e5843df3" Jul 29 18:43:17.928162 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:17.927960 2573 scope.go:117] "RemoveContainer" containerID="a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c" Jul 29 18:43:17.928341 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:17.928212 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:43:18.934077 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:18.934052 2573 scope.go:117] "RemoveContainer" containerID="a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c" Jul 29 18:43:18.934475 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:18.934234 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:43:22.046413 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:22.046377 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:22.046819 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:22.046738 2573 scope.go:117] "RemoveContainer" containerID="a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c" Jul 29 18:43:22.046915 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:22.046897 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:43:34.952271 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:34.952232 2573 scope.go:117] "RemoveContainer" containerID="a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c" Jul 29 18:43:36.008267 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:36.008235 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" exitCode=1 Jul 29 18:43:36.008755 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:36.008324 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b"} Jul 29 18:43:36.008755 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:36.008385 2573 scope.go:117] "RemoveContainer" containerID="a4ae4472e63f37b373ed74ffb070956f6bc32e8794a2c32b47f900b2592ba05c" Jul 29 18:43:36.008755 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:36.008730 2573 scope.go:117] "RemoveContainer" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" Jul 29 18:43:36.008961 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:36.008941 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:43:36.921810 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:36.921774 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:37.015047 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:37.015022 2573 scope.go:117] "RemoveContainer" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" Jul 29 18:43:37.015486 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:37.015194 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:43:42.047024 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:42.046996 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:43:42.047555 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:42.047368 2573 scope.go:117] "RemoveContainer" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" Jul 29 18:43:42.047555 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:42.047536 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:43:54.951859 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:43:54.951825 2573 scope.go:117] "RemoveContainer" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" Jul 29 18:43:54.952352 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:43:54.951985 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:05.952482 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:05.952454 2573 scope.go:117] "RemoveContainer" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" Jul 29 18:44:07.143068 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:07.143038 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" exitCode=1 Jul 29 18:44:07.143469 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:07.143120 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571"} Jul 29 18:44:07.143469 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:07.143181 2573 scope.go:117] "RemoveContainer" containerID="636ba81f13bc9c565eab388e9cf50f71064ffe3a9b5c1c4ab1bb2d3dab16e68b" Jul 29 18:44:07.143553 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:07.143488 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:07.143689 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:07.143669 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:11.921584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:11.921536 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:44:11.921994 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:11.921897 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:11.922096 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:11.922075 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:12.046649 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:12.046617 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:44:12.166938 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:12.166910 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:12.167157 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:12.167135 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:13.775903 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:13.775870 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:44:13.776609 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:13.776592 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:44:22.951757 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:22.951731 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:22.954229 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:22.951946 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:37.952659 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:37.952585 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:37.953079 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:37.952770 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:42.920518 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.920479 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-687f87df56-krtd8"] Jul 29 18:44:42.923840 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.923818 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.937375 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.937352 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687f87df56-krtd8"] Jul 29 18:44:42.961786 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.961751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-config\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.961955 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.961820 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-serving-cert\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.961955 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.961908 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-oauth-serving-cert\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.961955 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.961951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-oauth-config\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.962087 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.961976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wgc\" (UniqueName: \"kubernetes.io/projected/65896aa8-2f39-404b-a38c-5ff55b6102b8-kube-api-access-k2wgc\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.962087 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.962045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-trusted-ca-bundle\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:42.962087 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:42.962072 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-service-ca\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063097 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-serving-cert\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063097 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063100 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-oauth-serving-cert\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063327 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-oauth-config\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063327 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063242 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wgc\" (UniqueName: \"kubernetes.io/projected/65896aa8-2f39-404b-a38c-5ff55b6102b8-kube-api-access-k2wgc\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063468 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-trusted-ca-bundle\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063468 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063396 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-service-ca\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063468 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063457 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-config\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.063935 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.063905 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-oauth-serving-cert\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.064076 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.064053 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-config\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.064395 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.064372 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-service-ca\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.064447 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.064422 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65896aa8-2f39-404b-a38c-5ff55b6102b8-trusted-ca-bundle\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.065639 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.065621 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-oauth-config\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.065756 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.065736 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/65896aa8-2f39-404b-a38c-5ff55b6102b8-console-serving-cert\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.072619 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.072598 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wgc\" (UniqueName: \"kubernetes.io/projected/65896aa8-2f39-404b-a38c-5ff55b6102b8-kube-api-access-k2wgc\") pod \"console-687f87df56-krtd8\" (UID: \"65896aa8-2f39-404b-a38c-5ff55b6102b8\") " pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.233929 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.233839 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:43.369174 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:43.369148 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-687f87df56-krtd8"] Jul 29 18:44:43.371648 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:44:43.371621 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65896aa8_2f39_404b_a38c_5ff55b6102b8.slice/crio-a05504413a857aeedfb97b497e1008d610b9d6203180608dd3aacc880fb2e43f WatchSource:0}: Error finding container a05504413a857aeedfb97b497e1008d610b9d6203180608dd3aacc880fb2e43f: Status 404 returned error can't find the container with id a05504413a857aeedfb97b497e1008d610b9d6203180608dd3aacc880fb2e43f Jul 29 18:44:44.305591 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:44.305560 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687f87df56-krtd8" event={"ID":"65896aa8-2f39-404b-a38c-5ff55b6102b8","Type":"ContainerStarted","Data":"4340e372b9cb4b4cee4c84ffff0282d63e6a736e764c71825db0ad5dd2c762c0"} Jul 29 18:44:44.306000 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:44.305606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-687f87df56-krtd8" event={"ID":"65896aa8-2f39-404b-a38c-5ff55b6102b8","Type":"ContainerStarted","Data":"a05504413a857aeedfb97b497e1008d610b9d6203180608dd3aacc880fb2e43f"} Jul 29 18:44:44.325768 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:44.325717 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-687f87df56-krtd8" podStartSLOduration=2.325700532 podStartE2EDuration="2.325700532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:44:44.324670492 +0000 UTC m=+630.991887694" watchObservedRunningTime="2026-07-29 18:44:44.325700532 +0000 UTC m=+630.992917732" Jul 29 18:44:51.952406 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:51.952374 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:51.952864 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:51.952664 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 18:44:52.345743 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:52.345712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerStarted","Data":"fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a"} Jul 29 18:44:52.345927 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:52.345913 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:44:53.234802 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.234710 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:53.234802 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.234769 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:53.239728 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.239708 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:53.352595 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.352560 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" exitCode=1 Jul 29 18:44:53.352782 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.352637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a"} Jul 29 18:44:53.352782 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.352706 2573 scope.go:117] "RemoveContainer" containerID="d235cee190d0e3053535124365d65fedaab8967eb610d8cdcad4620547dec571" Jul 29 18:44:53.352912 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.352879 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:44:53.353102 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:53.353082 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:44:53.356693 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.356673 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-687f87df56-krtd8" Jul 29 18:44:53.417927 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:53.417894 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcd955c96-9d6xj"] Jul 29 18:44:54.358643 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:44:54.358612 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:44:54.359010 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:44:54.358794 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:45:02.047024 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:02.046972 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:45:02.047450 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:02.047362 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:45:02.047548 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:45:02.047528 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:45:16.951702 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:16.951671 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:45:16.952094 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:45:16.951835 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:45:18.442794 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.442748 2573 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bcd955c96-9d6xj" podUID="6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" containerName="console" containerID="cri-o://b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a" gracePeriod=15 Jul 29 18:45:18.693781 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.693719 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:45:18.867941 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.867909 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-serving-cert\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.867941 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.867949 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-trusted-ca-bundle\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.868144 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.867998 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-service-ca\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.868200 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868178 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-config\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.868246 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868224 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-oauth-config\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.868535 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868286 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-oauth-serving-cert\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.868535 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868368 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rlk2\" (UniqueName: \"kubernetes.io/projected/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-kube-api-access-6rlk2\") pod \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\" (UID: \"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23\") " Jul 29 18:45:18.868535 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868392 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-service-ca" (OuterVolumeSpecName: "service-ca") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:45:18.868535 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868420 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:45:18.868805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868608 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-config" (OuterVolumeSpecName: "console-config") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:45:18.868805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868695 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-trusted-ca-bundle\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:18.868805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868713 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-service-ca\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:18.868805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868727 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:18.868805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.868717 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 18:45:18.870208 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.870178 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:45:18.870334 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.870311 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 18:45:18.870429 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.870409 2573 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-kube-api-access-6rlk2" (OuterVolumeSpecName: "kube-api-access-6rlk2") pod "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" (UID: "6b4dba58-174e-4bfe-8e68-ea8cbd54eb23"). InnerVolumeSpecName "kube-api-access-6rlk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 18:45:18.969515 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.969426 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-serving-cert\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:18.969515 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.969456 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-console-oauth-config\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:18.969515 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.969465 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-oauth-serving-cert\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:18.969515 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:18.969474 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rlk2\" (UniqueName: \"kubernetes.io/projected/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23-kube-api-access-6rlk2\") on node \"ip-10-0-141-242.ec2.internal\" DevicePath \"\"" Jul 29 18:45:19.476819 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.476786 2573 generic.go:356] "Generic (PLEG): container finished" podID="6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" containerID="b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a" exitCode=0 Jul 29 18:45:19.477231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.476832 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcd955c96-9d6xj" Jul 29 18:45:19.477231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.476846 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcd955c96-9d6xj" event={"ID":"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23","Type":"ContainerDied","Data":"b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a"} Jul 29 18:45:19.477231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.476885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcd955c96-9d6xj" event={"ID":"6b4dba58-174e-4bfe-8e68-ea8cbd54eb23","Type":"ContainerDied","Data":"2210ec35819d9e223efe44babfc3ed707cc34f243bd570410cd29eefe08861c9"} Jul 29 18:45:19.477231 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.476904 2573 scope.go:117] "RemoveContainer" containerID="b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a" Jul 29 18:45:19.485656 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.485635 2573 scope.go:117] "RemoveContainer" containerID="b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a" Jul 29 18:45:19.485935 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:45:19.485911 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a\": container with ID starting with b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a not found: ID does not exist" containerID="b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a" Jul 29 18:45:19.486032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.485940 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a"} err="failed to get container status \"b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a\": rpc error: code = NotFound desc = could not find container \"b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a\": container with ID starting with b71fe451c6759d55b87bf3169d842c91b5d3909310ba254fad279f0c3c1ba18a not found: ID does not exist" Jul 29 18:45:19.501449 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.501423 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcd955c96-9d6xj"] Jul 29 18:45:19.504816 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.504786 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bcd955c96-9d6xj"] Jul 29 18:45:19.957979 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:19.957937 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" path="/var/lib/kubelet/pods/6b4dba58-174e-4bfe-8e68-ea8cbd54eb23/volumes" Jul 29 18:45:28.952672 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:28.952637 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:45:28.953144 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:45:28.952795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:45:41.952771 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:41.952732 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:45:41.953237 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:45:41.952927 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:45:56.952155 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:45:56.952122 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:45:56.952599 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:45:56.952348 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:46:07.952872 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:07.952790 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:46:07.953322 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:46:07.952985 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:46:22.952589 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:22.952548 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:46:23.745738 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:23.745704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerStarted","Data":"663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb"} Jul 29 18:46:23.746054 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:23.746035 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:46:24.752138 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:24.752101 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" exitCode=1 Jul 29 18:46:24.752603 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:24.752202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb"} Jul 29 18:46:24.752603 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:24.752330 2573 scope.go:117] "RemoveContainer" containerID="fdbd5719842a75a3621e836f166dc3836995462251920984b76c0c3bf6da581a" Jul 29 18:46:24.752603 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:24.752565 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:46:24.752786 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:46:24.752764 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:46:25.758612 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:25.758584 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:46:25.758972 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:46:25.758751 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:46:32.047212 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:32.047173 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:46:32.047624 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:32.047587 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:46:32.047813 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:46:32.047790 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:46:44.951997 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:44.951965 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:46:44.952426 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:46:44.952166 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:46:55.952370 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:46:55.952336 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:46:55.952965 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:46:55.952518 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:47:07.952152 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:47:07.952121 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:47:07.952572 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:47:07.952345 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:47:18.952389 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:47:18.952356 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:47:18.952777 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:47:18.952527 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:47:32.952119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:47:32.952087 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:47:32.952622 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:47:32.952242 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:47:46.952260 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:47:46.952183 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:47:46.952637 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:47:46.952383 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:48:01.951987 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:48:01.951950 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:48:01.952422 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:48:01.952118 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:48:15.952070 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:48:15.952040 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:48:15.952601 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:48:15.952288 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:48:27.952809 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:48:27.952772 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:48:27.953191 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:48:27.952934 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:48:38.952748 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:48:38.952710 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:48:38.953146 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:48:38.952911 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:48:51.952186 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:48:51.952148 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:48:51.952830 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:48:51.952385 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:49:03.955373 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:03.955342 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:49:03.955776 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:49:03.955513 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:49:13.801119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:13.801090 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:49:13.802329 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:13.802286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:49:15.952841 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:15.952806 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:49:16.488536 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:16.488501 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerStarted","Data":"bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65"} Jul 29 18:49:16.488742 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:16.488724 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:49:17.494525 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:17.494490 2573 generic.go:356] "Generic (PLEG): container finished" podID="3035bb99-b788-425a-80c0-0f0c14b35313" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" exitCode=1 Jul 29 18:49:17.494930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:17.494526 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" event={"ID":"3035bb99-b788-425a-80c0-0f0c14b35313","Type":"ContainerDied","Data":"bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65"} Jul 29 18:49:17.494930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:17.494590 2573 scope.go:117] "RemoveContainer" containerID="663427eacbf2fc3aa5e5e5261ee0b276a0990b834ed8222cdef84781a01355bb" Jul 29 18:49:17.494930 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:17.494776 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:49:17.495049 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:49:17.494985 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:49:18.500461 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:18.500437 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:49:18.500836 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:49:18.500597 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:49:22.047241 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:22.047190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" Jul 29 18:49:22.047683 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:22.047598 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:49:22.047775 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:49:22.047753 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:49:33.954686 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:33.954658 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:49:33.957156 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:49:33.954843 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:49:46.951926 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:49:46.951891 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:49:46.952354 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:49:46.952062 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:50:00.952384 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:50:00.952349 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:50:00.952881 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:50:00.952544 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:50:14.952805 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:50:14.952769 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:50:14.953188 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:50:14.952912 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:50:26.952466 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:50:26.952425 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:50:26.952914 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:50:26.952650 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:50:37.952612 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:50:37.952517 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:50:37.953197 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:50:37.952716 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:50:52.952192 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:50:52.952162 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:50:52.952595 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:50:52.952351 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:51:06.952430 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:51:06.952400 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:51:06.952809 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:51:06.952568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:51:21.952896 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:51:21.952858 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:51:21.953412 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:51:21.953095 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:51:32.952508 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:51:32.952473 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:51:32.952887 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:51:32.952658 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:51:46.952574 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:51:46.952546 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:51:46.952953 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:51:46.952722 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:52:00.951889 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:52:00.951859 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:52:00.952380 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:52:00.952028 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:52:11.952438 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:52:11.952401 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:52:11.952891 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:52:11.952585 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:52:22.952142 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:52:22.952106 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:52:22.952564 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:52:22.952329 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:52:34.952351 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:52:34.952320 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:52:34.952753 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:52:34.952497 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:52:45.952288 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:52:45.952258 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:52:45.952764 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:52:45.952468 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:53:00.952800 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:00.952764 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:53:00.953189 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:53:00.952988 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:53:13.954257 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:13.954228 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:53:13.954878 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:53:13.954424 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:53:17.179030 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:17.179001 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-bcfrr_3035bb99-b788-425a-80c0-0f0c14b35313/manager/6.log" Jul 29 18:53:27.952172 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:27.952135 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:53:27.952778 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:53:27.952369 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:53:40.952272 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:40.952189 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:53:40.952713 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:53:40.952383 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:53:42.649471 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:42.649445 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dg5zm_9618fed2-7fe7-451f-bf88-b9df3edac5ea/global-pull-secret-syncer/0.log" Jul 29 18:53:42.827218 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:42.827190 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ktcr6_63429306-cfe7-4a9f-8d2d-ac253dd01537/konnectivity-agent/0.log" Jul 29 18:53:42.924977 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:42.924905 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-242.ec2.internal_2ec71785db9a4db774a1e97c3d7af1b6/haproxy/0.log" Jul 29 18:53:46.556572 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.556543 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/alertmanager/0.log" Jul 29 18:53:46.585417 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.585392 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/config-reloader/0.log" Jul 29 18:53:46.610127 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.610108 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/kube-rbac-proxy-web/0.log" Jul 29 18:53:46.635643 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.635618 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/kube-rbac-proxy/0.log" Jul 29 18:53:46.663813 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.663790 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/kube-rbac-proxy-metric/0.log" Jul 29 18:53:46.685848 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.685823 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/prom-label-proxy/0.log" Jul 29 18:53:46.706998 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.706976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f6659d2-748d-406b-a7f5-f236c84918f9/init-config-reloader/0.log" Jul 29 18:53:46.780724 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.780698 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xmn99_053e37d2-070c-49e3-a5cb-1ca6296cf1d6/kube-state-metrics/0.log" Jul 29 18:53:46.809041 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.808977 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xmn99_053e37d2-070c-49e3-a5cb-1ca6296cf1d6/kube-rbac-proxy-main/0.log" Jul 29 18:53:46.835288 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:46.835266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-xmn99_053e37d2-070c-49e3-a5cb-1ca6296cf1d6/kube-rbac-proxy-self/0.log" Jul 29 18:53:47.046992 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:47.046969 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr2bh_7eabad1e-8c0a-4794-86ae-450b7a75633e/node-exporter/0.log" Jul 29 18:53:47.074617 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:47.074551 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr2bh_7eabad1e-8c0a-4794-86ae-450b7a75633e/kube-rbac-proxy/0.log" Jul 29 18:53:47.107984 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:47.107958 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr2bh_7eabad1e-8c0a-4794-86ae-450b7a75633e/init-textfile/0.log" Jul 29 18:53:49.599344 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:49.599291 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/1.log" Jul 29 18:53:49.603921 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:49.603899 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-x88fj_6c522834-ecea-4bb7-9fda-02b5ed021bf9/console-operator/2.log" Jul 29 18:53:50.021399 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.021358 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-687f87df56-krtd8_65896aa8-2f39-404b-a38c-5ff55b6102b8/console/0.log" Jul 29 18:53:50.775053 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.775021 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg"] Jul 29 18:53:50.775457 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.775344 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" containerName="console" Jul 29 18:53:50.775457 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.775355 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" containerName="console" Jul 29 18:53:50.775457 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.775419 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b4dba58-174e-4bfe-8e68-ea8cbd54eb23" containerName="console" Jul 29 18:53:50.778422 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.778402 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:50.781210 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.781194 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gd9l8\"/\"default-dockercfg-qsrr2\"" Jul 29 18:53:50.781315 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.781194 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd9l8\"/\"kube-root-ca.crt\"" Jul 29 18:53:50.782420 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.782405 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gd9l8\"/\"openshift-service-ca.crt\"" Jul 29 18:53:50.786992 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.786972 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg"] Jul 29 18:53:50.927115 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.927084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-lib-modules\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:50.927319 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.927127 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hj4c\" (UniqueName: \"kubernetes.io/projected/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-kube-api-access-4hj4c\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:50.927319 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.927221 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-podres\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:50.927319 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.927272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-sys\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:50.927431 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:50.927328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-proc\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028281 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-podres\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028281 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028251 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-sys\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028281 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-proc\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028331 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-lib-modules\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028376 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hj4c\" (UniqueName: \"kubernetes.io/projected/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-kube-api-access-4hj4c\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028384 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-sys\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028389 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-proc\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028389 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-podres\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.028584 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.028468 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-lib-modules\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.036735 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.036712 2573 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hj4c\" (UniqueName: \"kubernetes.io/projected/fdcffd20-dd63-4b50-b724-fc65b69c2ac9-kube-api-access-4hj4c\") pod \"perf-node-gather-daemonset-6rwkg\" (UID: \"fdcffd20-dd63-4b50-b724-fc65b69c2ac9\") " pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.088439 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.088404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.215712 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.215685 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg"] Jul 29 18:53:51.217901 ip-10-0-141-242 kubenswrapper[2573]: W0729 18:53:51.217874 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfdcffd20_dd63_4b50_b724_fc65b69c2ac9.slice/crio-fae81a7063ba07d8dd0352e224e4fe7f06c5ddd34786c9a5496dd53b4b113a6f WatchSource:0}: Error finding container fae81a7063ba07d8dd0352e224e4fe7f06c5ddd34786c9a5496dd53b4b113a6f: Status 404 returned error can't find the container with id fae81a7063ba07d8dd0352e224e4fe7f06c5ddd34786c9a5496dd53b4b113a6f Jul 29 18:53:51.450366 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.450339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2tpsg_96f1c45a-418c-47c9-9dc4-c1a63c6f1927/dns/0.log" Jul 29 18:53:51.470801 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.470773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2tpsg_96f1c45a-418c-47c9-9dc4-c1a63c6f1927/kube-rbac-proxy/0.log" Jul 29 18:53:51.609023 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.608940 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nrk9h_be1d0114-c267-4858-843e-af59fea83565/dns-node-resolver/0.log" Jul 29 18:53:51.644374 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.644336 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" event={"ID":"fdcffd20-dd63-4b50-b724-fc65b69c2ac9","Type":"ContainerStarted","Data":"38f14e43202f25f04dd4f07ce98d51bc82a9544732f602cd4e1ddab26ce368dd"} Jul 29 18:53:51.644563 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.644392 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" event={"ID":"fdcffd20-dd63-4b50-b724-fc65b69c2ac9","Type":"ContainerStarted","Data":"fae81a7063ba07d8dd0352e224e4fe7f06c5ddd34786c9a5496dd53b4b113a6f"} Jul 29 18:53:51.644563 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.644420 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:51.660872 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:51.660801 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" podStartSLOduration=1.660774964 podStartE2EDuration="1.660774964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:53:51.659256116 +0000 UTC m=+1178.326473316" watchObservedRunningTime="2026-07-29 18:53:51.660774964 +0000 UTC m=+1178.327992155" Jul 29 18:53:52.121025 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:52.120996 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f5rvc_f718b183-f469-4358-ac39-57cec88134b6/node-ca/0.log" Jul 29 18:53:52.946175 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:52.946142 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d486cb67-p5rkk_3b98f5b4-73f3-4bc8-b30e-b5791fe996da/router/0.log" Jul 29 18:53:53.330328 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.330240 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j5clh_ee7d3668-cbc8-494a-8663-568d792ee2c0/serve-healthcheck-canary/0.log" Jul 29 18:53:53.694032 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.693999 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9fr66_aaac7f5f-9511-42aa-a6c6-2182484fa94a/insights-operator/1.log" Jul 29 18:53:53.694311 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.694277 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-9fr66_aaac7f5f-9511-42aa-a6c6-2182484fa94a/insights-operator/0.log" Jul 29 18:53:53.849157 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.849130 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w265z_597c4525-685a-44e0-82e4-c5b5f3ece064/kube-rbac-proxy/0.log" Jul 29 18:53:53.870431 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.870409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w265z_597c4525-685a-44e0-82e4-c5b5f3ece064/exporter/0.log" Jul 29 18:53:53.890662 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.890635 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w265z_597c4525-685a-44e0-82e4-c5b5f3ece064/extractor/0.log" Jul 29 18:53:53.954723 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:53.954637 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:53:53.954866 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:53:53.954824 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313" Jul 29 18:53:55.897797 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:55.897768 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-bcfrr_3035bb99-b788-425a-80c0-0f0c14b35313/manager/6.log" Jul 29 18:53:55.898187 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:55.897805 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-bcfrr_3035bb99-b788-425a-80c0-0f0c14b35313/manager/6.log" Jul 29 18:53:57.658895 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:57.658865 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gd9l8/perf-node-gather-daemonset-6rwkg" Jul 29 18:53:59.604215 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:59.604183 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-rqlxj_98d6cdcb-041b-4f75-9466-00ccf7db044b/migrator/0.log" Jul 29 18:53:59.624529 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:53:59.624503 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-rqlxj_98d6cdcb-041b-4f75-9466-00ccf7db044b/graceful-termination/0.log" Jul 29 18:54:00.042547 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:00.042518 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr_a7a106b6-c6a8-41d3-bddc-81ef5957d347/kube-storage-version-migrator-operator/1.log" Jul 29 18:54:00.043433 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:00.043414 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-64rgr_a7a106b6-c6a8-41d3-bddc-81ef5957d347/kube-storage-version-migrator-operator/0.log" Jul 29 18:54:00.999701 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:00.999676 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5tblx_66003789-6ffd-45cf-b5bc-3a89c7e36f56/kube-multus/0.log" Jul 29 18:54:01.339721 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.339692 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/kube-multus-additional-cni-plugins/0.log" Jul 29 18:54:01.361236 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.361212 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/egress-router-binary-copy/0.log" Jul 29 18:54:01.382984 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.382958 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/cni-plugins/0.log" Jul 29 18:54:01.404715 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.404687 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/bond-cni-plugin/0.log" Jul 29 18:54:01.425744 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.425717 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/routeoverride-cni/0.log" Jul 29 18:54:01.451580 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.451554 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/whereabouts-cni-bincopy/0.log" Jul 29 18:54:01.476585 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.476561 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qxr9f_ab8983ec-0b07-47a9-a532-9b40d67012d7/whereabouts-cni/0.log" Jul 29 18:54:01.648711 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.648688 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x6szn_224a45b3-ef7f-4a80-877f-8c41a61be9a2/network-metrics-daemon/0.log" Jul 29 18:54:01.669874 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:01.669845 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x6szn_224a45b3-ef7f-4a80-877f-8c41a61be9a2/kube-rbac-proxy/0.log" Jul 29 18:54:02.458862 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.458835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/ovn-controller/0.log" Jul 29 18:54:02.479554 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.479533 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/ovn-acl-logging/0.log" Jul 29 18:54:02.505815 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.505791 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/kube-rbac-proxy-node/0.log" Jul 29 18:54:02.530286 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.530259 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 18:54:02.548583 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.548561 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/northd/0.log" Jul 29 18:54:02.569625 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.569602 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/nbdb/0.log" Jul 29 18:54:02.589898 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.589872 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/sbdb/0.log" Jul 29 18:54:02.626797 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:02.626767 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-krwk9_51e194f0-e997-490a-b028-1cf62de7c601/ovnkube-controller/0.log" Jul 29 18:54:04.033926 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:04.033892 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8fwzd_82e8437d-4a96-4187-9ec3-25ab1fd8b597/network-check-target-container/0.log" Jul 29 18:54:04.962870 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:04.962847 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2cv44_871ed1e1-d27f-4ab5-accd-d01be9f73ffc/iptables-alerter/0.log" Jul 29 18:54:05.664646 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:05.664622 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tv8qt_c2af70ba-db52-4c87-a95d-bc790ee6946d/tuned/0.log" Jul 29 18:54:06.952119 ip-10-0-141-242 kubenswrapper[2573]: I0729 18:54:06.952084 2573 scope.go:117] "RemoveContainer" containerID="bf7c04c1b15ad5ff32742d2837a22ebf5869a689be5a3167f5772b1bd36d7c65" Jul 29 18:54:06.952506 ip-10-0-141-242 kubenswrapper[2573]: E0729 18:54:06.952257 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-bcfrr_kserve(3035bb99-b788-425a-80c0-0f0c14b35313)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-bcfrr" podUID="3035bb99-b788-425a-80c0-0f0c14b35313"